North Small Translate: Advanced Cost-Effective Translation (Cohere CAT+)
Organizations: Cohere
Abstract
We present North Small Translate, an open-weight, LLM-based machine translation (MT) model with instruction-following capabilities built on the same foundation as Cohere's Command A Plus, a mixture-of-experts architecture with 25 billion active parameters out of 218 billion total parameters. North Small Translate is trained using difficulty sampling to obtain challenging documents and a five-step training protocol combining supervised fine-tuning, direct preference optimization, and online reinforcement learning. We prioritized throughput through a non-reasoning base model and supplemented with optional agentic capabilities to unlock translation quality gains. North Small Translate is trained to perform MT-related tasks, including post-editing and quality estimation, as well as related tasks such as general instruction following. The model achieves top MT performance across 50 languages in the class of models under 1T parameters, with no need to run expensive reasoning at inference time.
Figures & tables
| Params total (active) | GEMBA WMT26 | xCOMETxl WMT24++ | Terminology | Long context | Structured translation | |
| North Small Translate (Agentic) | 218B (25B) | 84.4 | 80.7 | 87.9 | 47.8 | 93.3 |
| North Small Translate | 218B (25B) | 83.6 | 80.6 | 89.7 | 48.9 | 93.7 |
| Mistral Large 3 | 675B (41B) | 81.6 | 78.3 | 91.2 | 20.0 | 93.8 |
| Qwen 3.5 397B | 397B (17B) | 81.6 | 78.5 | 87.0 | 19.5 | 59.4 |
| DeepL NextGen | 81.4 | 81.8 | 47.8 | 56.5 | 64.5 | |
| Gemma 4 31b | 31B (31B) | 79.5 | 79.2 | 92.1 | 19.4 | 95.1 |
| Step | MT Quality |
| Coarse SFT | 71.3% |
| Fine-grained SFT | 76.2% |
| DPO | 80.1% |
| Online RL | 80.0% |
| Light DPO | 81.8% |
| Metric | Acc (ties) |
| GEMBA-ESA Fluency+Adequacy | 51.0 |
| GEMBA-ESA | 50.6 |
| xCOMETxl | 44.9 |
| spBLEU | 43.7 |
| Params total (active) | All languages | Europe | ME + Asia | Latin script | Other scripts | |
| North Small Translate (Agentic) | 218B (25B) | 84.4 | 82.5 | 87.2 | 83.0 | 86.5 |
| North Small Translate | 218B (25B) | 83.6 | 82.0 | 86.1 | 82.4 | 85.4 |
| Mistral Large 3 | 675B (41B) | 81.6 | 80.3 | 83.5 | 80.3 | 83.5 |
| Qwen 3.5 397B | 397B (17B) | 81.6 | 81.2 | 82.0 | 81.0 | 82.4 |
| DeepL NextGen | 81.4 | 82.3 | 80.0 | 82.4 | 79.9 | |
| Gemma 4 31b | 31B (31B) | 79.5 | 73.5 | 88.4 | 74.9 | 86.3 |
| Language | WMT24 | WMT26 |
| Arabic (MSA) | 19.7% | 34.9% |
| German | 22.9% | 37.1% |
| Spanish (Mexico) | 14.2% | 34.9% |
| French | 7.6% | 13.9% |
| Italian | 11.9% | 11.5% |
| Japanese | 14.6% | 28.9% |
| Params total (active) | All languages | Albanian | Bengali | Bulgarian | Catalan | Croatian | Czech | Danish | Dutch | Egyptian Arabic | Estonian | European Portuguese | |
| North Small Translate (Agentic) | 218B (25B) | 84.4 | 78.7 | 87.5 | 80.1 | 84.0 | 79.0 | 88.8 | 89.1 | 89.5 | 84.2 | 73.5 | 90.4 |
| North Small Translate | 218B (25B) | 83.6 | 77.9 | 82.8 | 79.5 | 83.9 | 78.3 | 89.2 | 85.3 | 89.5 | 84.0 | 72.6 | 89.6 |
| Mistral Large 3 | 675B (41B) | 81.6 | 76.2 | 84.9 | 83.2 | 85.3 | 81.4 | 83.9 | 86.0 | 87.9 | 78.7 | 72.0 | 86.4 |
| Qwen 3.5 397B | 397B (17B) | 81.6 | 81.2 | 83.8 | 83.3 | 82.0 | 83.4 | 81.5 | 85.5 | 87.1 | 75.4 | 75.6 | 80.7 |
| DeepL NextGen | 81.4 | 76.5 | 75.8 | 84.5 | 78.7 | 76.4 | 85.3 | 88.6 | 89.5 | 57.6 | 81.0 | 87.2 | |
| Gemma 4 31b | 31B (31B) | 79.5 | 76.2 | 88.8 | 78.5 | 78.3 | 79.4 | 75.5 | 88.5 | 88.9 | 87.5 | 53.1 | 87.0 |