Towards English - Mizo Legal Machine Translation: Corpus Creation, Analysis, and Benchmarks
Organizations: Indian Institute of Technology Guwahati, Assam, India
Abstract
Indian court proceedings are held in English, so speakers of languages with limited translation technology have limited access to them. We present the first English Mizo parallel dataset of Indian court judgments. It contains 13,168 sentence pairs from the Gauhati High Court and the Supreme Court of India. Professional native Mizo translators translated complete documents; sentence pairs were manually aligned, and two independent reviewers checked the results. Our study finds that English words are borrowed in a very selective way: official and legal terms are almost always kept in English, but words for everyday things like actions, situations, and results are usually expressed in native Mizo. Mizo diacritics are also used inconsistently across the corpus. When we fine tune the NLLB 200 1.3B model on our training data, it scores 27.47 BLEU on a balanced legal test set of 1,000 sentence pairs, an improvement of 7.16 BLEU over the base model. However, it still uses English words about three times more often than a human translator does.
Figures & tables
| Statistic | English | Mizo |
|---|---|---|
| Sentence pairs | ||
| Running tokens | ||
| Vocabulary (types) | ||
| Type–token ratio | 0.036 | 0.041 |
| Hapax legomena | ||
| as % of types | 24.00 | 35.45 |
| Top- types | English | Mizo |
|---|---|---|
| 52.73 | 51.55 | |
| 73.98 | 74.96 | |
| 82.09 | 83.11 | |
| 96.69 | 96.34 |
| Measure | Value |
|---|---|
| Shared word types | |
| Mizo tokens also in English vocab. | |
| Mean token-level Jaccard (per-pair) |
| Term | En | Mz | Ret. (%) |
| High retention: institutions and instruments | |||
| CrPC | 17 | 17 | 100.0 |
| FIR | 46 | 46 | 100.0 |
| court | 100.0 | ||
| police | 230 | 230 | 100.0 |
| IPC | 47 | 47 | 100.0 |
| Character | Name | Count |
|---|---|---|
| â | a with circumflex | 294 |
| ṭ | t with dot below | 282 |
| ê | e with circumflex | 171 |
| û | u with circumflex | 94 |
| î | i with circumflex | 41 |
| Base form | Attested variants | Freq. |
|---|---|---|
| chu | chu / chû | |
| te | te / tê | |
| tur | tur / tûr | |
| dan | dan / dân | |
| he | he / hê | |
| awm | awm / âwm |
| Plain | Freq. | Dotted | Freq. |
|---|---|---|---|
| tan | 277 | ṭan | 12 |
| tha | 111 | ṭha | 27 |
| tul | 109 | ṭul | 16 |
| tawng | 13 | ṭawng | 4 |
| Split | Lang. | Sent. | Tokens | Types | TTR |
|---|---|---|---|---|---|
| Train | English | 0.049 | |||
| Mizo | 0.053 | ||||
| Test | English | 0.180 | |||
| Mizo | 0.159 |
| System | BLEU | chrF++ | TER |
|---|---|---|---|
| NLLB-200 B | 20.31 | 42.56 | 77.81 |
| NLLB-FT | 27.47 | 50.39 | 65.68 |
| Stratum | BLEU | chrF++ | TER | |
|---|---|---|---|---|
| Legal terms | 230 | 19.71 | 46.43 | 69.70 |
| Abbreviations | 220 | 34.05 | 53.58 | 63.73 |
| Named entities | 200 | 26.33 | 53.08 | 62.42 |
| Act names | 150 | 32.18 | 52.60 | 63.34 |
| Others | 200 | 21.14 | 46.27 | 68.38 |
| Overall | 27.47 | 50.39 | 65.68 |
| Error type | (%) | Typical case |
|---|---|---|
| Over-retention of | 50 (21.7) | learned , evidence |
| English form | kept verbatim | |
| Spurious nativisation | 19 (8.3) | affidavit native |
| Variant equivalent | 7 (3.0) | order : thupek / |
| (not an error) | thuchhuah | |
| Meaning-shifting | 5 (2.2) | accused |
| Behaviour | (%) | Example |
|---|---|---|
| Transferred correctly | 814 (96.7) | Jogen Kalita |
| Corrupted form | 15 (1.8) | Practices |
| Practises | ||
| Omitted | 13 (1.5) | entity dropped |
Machine Translation
Machine translation develops computational methods for converting text, speech, and visual content between languages while preserving meaning and purpose.
See all 265 papers