GLOSS-MT: Controllable Low-Resource Machine Translation with an Editable Dictionary
Abstract
Adapting a pretrained machine translation (MT) model to new terminology usually requires new parallel data and another round of fine-tuning, which is costly for low-resource languages. We ask whether controllability can be added to MT, and the fine-tuning burden reduced, without degrading the pretrained model. GLOSS-MT looks up the source's noun phrases in an offline English-Twi dictionary, replaces every phrase found by its Twi translation in place, and fine-tunes a translation model once to translate these mixed inputs. We apply the same data and pipeline to NLLB-200 (600M, 1.3B, 3.3B), OPUS-MT en-tw and TranslateGemma 4B. On a document-level English-to-Asante Twi benchmark (84 documents, four domains), every fine-tune scores above its pretrained base in chrF2 (+2.85 to +5.48), and the three NLLB fine-tunes are the best open systems (50.12-50.80). A direct controllability test on human-translated Bible passages shows that the three fine-tunes tested write 79-97% of the dictionary terms, and that replacing every dictionary entry by a different term changes the output accordingly (70-97% of the new terms appear) with no retraining. We release the models, data and code.
Figures & tables
| System | chrF2 | BLEU | Finance | UDHR | Watchtower | Folktales | |
|---|---|---|---|---|---|---|---|
| References | Gemini 3.8 Flash | 54.64 | 17.25 | 52.50 | 56.44 | 69.28 | 40.33 |
| Google Translate | 51.26 | 15.67 | 48.06 | 52.30 | 67.15 | 37.54 | |
| NLLB-200 3.3B | base | 47.74 | 14.15 | 45.25 | 52.05 | 56.89 | 36.76 |
| Gloss-MT | 50.80 (+3.06) | 13.11 | 50.23 | 51.66 | 64.17 | 37.16 | |
| NLLB-200 1.3B | base | 47.42 | 13.68 | 45.72 | 50.47 | 57.46 | 36.05 |
| Gloss-MT | 50.27 (+2.85) | 12.82 | 49.41 | 51.51 | 63.66 | 36.51 |
| Model | Adh. | Nat. | Swap | Leak | chrF2 d/n |
|---|---|---|---|---|---|
| Asante Twi Bible (human references) | |||||
| Gloss-MT TranslateGemma | 96.6 | 26.2 | 97.3 | 1.9 | 37.2 / 32.1 |
| Gloss-MT NLLB 3.3B | 94.4 | 38.4 | 95.2 | 2.2 | 41.2 / 40.9 |
| Gloss-MT OPUS-MT | 79.2 | 32.5 | 69.7 | 1.7 | 36.4 / 33.6 |
| NLLB 3.3B base | 66.0 | 33.9 | 72.0 | 2.8 | 38.9 / 39.6 |
| OPUS-MT base | 1.9 | 30.3 | 0.4 | 1.4 | 19.1 / 30.1 |
Machine Translation
Machine translation develops computational methods for converting text, speech, and visual content between languages while preserving meaning and purpose.
See all 267 papers