MT Evaluation

MT: Machine Translation

Ask about this topic

Momentum

15 papers in the last four weeks, up 150% on the four weeks before. 0.1% of all new papers.

Jul 13Week of Sep 28
View on map

Latest papers 106

All topics
CardsList

  1. Generative AI translations in high-stakes emergency messaging

    Oct 6, 2026Nune Ayvazan, Anthony Pym, Yu HaoDisaster ResponseMachine Translation

    Universitat Rovira i Virgili · University of Melbourne

  2. Making COMET Comparable Across Scripts: Diagnosis and Correction of Tokeniser-Induced Script Bias in Indic MT Evaluation

    Oct 6, 2026G. L. John Salvin, Swapnil HingmireMT Evaluation

    Indian Institute of Technology Palakkad

  3. Precision over Scale: A Polish-Silesian Benchmark and a Translation System Outperforming Open-Source and Commercial Models

    Oct 1, 2026Grzegorz Kulik, Mikołaj Pokrywka, Adam Jatowt +1Low-Resource MTMachine Translation

    NASK National Research Institute, Poland · University of Innsbruck, Austria

  4. VISTA-Bench: Benchmarking Multilingual Image Translation with Image-Specific Rubrics

    Sep 29, 2026Bo Lv, Mao Zheng, Zheng Li +3Multilingual VLM EvaluationRubric-Based Evaluation

    Foundation Model Department, Tencent

  5. TermJudge: A Document-Level Metric Judging, Not Counting, Terminology in Machine Translation Evaluation

    Sep 28, 2026Nicolas Dahan, Fran{\cc}ois Yvon, Rachel BawdenAutomated EvaluationDocument-Level MT

    ISIR, ALMAnaCH · MLIA, ISIR · ALMAnaCH

  6. TTLab at AlexandriaX-2026: A Fine-Tuned Surface Tagger for Arabic Machine-Translation Error-Span Detection and Classification

    Sep 24, 2026Ali Abusaleh, Bhuvanesh Verma, Alexander MehlerArabic NLPMachine Translation

    Text Technology Lab (TTLab), Goethe University Frankfurt

  7. COILD: An Indic-Centric Parallel Corpus and Benchmark for Machine Translation Across Indian Languages

    Sep 23, 2026Kshetrimayum Boynao Singh, Nitin Kumar Mishra, Palash Pratim Dutta +22Low-Resource MTMachine Translation

    IIT Patna · IIT Delhi · IIT Guwahati +3

  8. MICRO: Multi-Fidelity Active Search for Severe Error Discovery

    Sep 22, 2026Orlando Leone, Niclas Pokel, Pehuén Moure +2Human-in-the-Loop AnnotationMT Evaluation

    Institute of Neuroinformatics, University of Zurich and ETH Zurich, Switzerland · ETH AI Center, Switzerland · Department of Computational Linguistics, University of Zurich, Switzerland

  9. Evaluating Communicative Success in Machine-Translated Conversation

    Sep 17, 2026Faiz Ghifari Haznitrama, Alice OhMulti-Turn Dialogue EvaluationMachine Translation

    School of Computing, KAIST

  10. LocQE: Principled Domain Adaptation for Localisation Quality Estimation by Leveraging Post-Edits

    Sep 16, 2026Kathy Hämmerl, Gabriel Bretschner, Joern WuebkerDomain AdaptationMachine Translation

    Technical University of Munich · Munich Center for Machine Learning · LILT

  11. TeochewBench: A Human-Reviewed Benchmark for Teochew Hanzi Translation

    Sep 16, 2026Jianan WuMultilingual Language Model EvaluationLow-Resource MT

    Peking University

  12. TACTICS: Taxonomy-Aware Intelligent Corpus Sampling for Machine Translation

    Sep 16, 2026Prasanth Bathala, Anubhav Shrimal, Sukhdeep Singh Kharbanda +2Adaptive SamplingMachine Translation

    Translation Services, Amazon

  13. Can We Triage LLM Translation Errors in Classical Texts Without Human References? Source Novelty, GEMBA Scoring, and Budgeted Review through Pali-to-English Translation

    Sep 14, 2026Máté MetzgerLLM-as-a-JudgeMT Evaluation

    Independent Researcher, Hungary

  14. Mind Which Bird You Favour: Parameterizing Adequacy-Fluency Balance in Meta-Evaluation of Machine Translation

    Sep 13, 2026Behzad Shayegh, Niloofar KazemiImportance WeightingMT Evaluation

    Independent Researchers

  15. TransClean: A Benchmark for Detecting and Extracting Clean Translations from Large Language Model Outputs

    Sep 11, 2026Shenbin Qian, Yves ScherrerMachine TranslationMT Evaluation

    Language Technology Group, Department of Informatics University of Oslo, Norway

  16. Improving Term Evaluation in Machine Translation: Variation Matters

    Sep 8, 2026Nicolas Dahan, Ziqian Peng, François Yvon +1Machine TranslationMT Evaluation

    MLIA, ISIR, ALMAnaCH · Inria, Paris, France · MLIA +3

  17. When Metrics Reward the Worst Translations: Internalizing Cultural Reasoning for Social Media Translation Evaluation

    Sep 8, 2026Yiwen Qiu, Linjuan Wu, Dingming Li +7Reinforcement LearningCultural Knowledge in Language Models

    Zhejiang University · Xiaohongshu Inc.

  18. Last Translation Benchmark

    Sep 3, 2026Vilém Zouhar, Niyati Bafna, Mukund Choudhary +257MT Evaluation

  19. Translation as a Decision Space: A Multi-Agent Perspective on Low-Resource Dialect Generation

    Sep 3, 2026Hasan Alkhder, Mohammad Abboush, Igor Tchappi +2Interpretable MLLow-Resource MT

  20. Beyond BLEU: A Case for Redefining Sign Language Translation Benchmarks

    Sep 3, 2026Oline Ranum, Edward Fish, Simon Hadfield +1Sign Language TranslationMT Evaluation

    Centre for Vision, Speech and Signal Processing (CVSSP), University of Surrey

  21. IndicQE-APE: A Consolidated Benchmark for Quality Estimation and Automatic Post-Editing for Indic Languages

    Aug 17, 2026Diptesh Kanojia, Archchana Sindhujan, Sourabh Deoghare +14Low-Resource Language ProcessingMT Evaluation

    University of Surrey · 2IIT Bombay · University of Oslo +9

  22. When the Knowledge Base Becomes the Gold Standard: Measuring Resource-Shared Evaluation Loops in Entity-Level Machine Translation

    Aug 12, 2026Jinhyung Bae, Dain Kil, Seongmin Oh +1Low-Resource MTMachine Translation

    Hankuk University of Foreign Studies

  23. Cultivar: A Contrastive and Locale-Oriented Translation Benchmark for Investigating Contamination and Localisation Robustness

    Aug 10, 2026Pinzhen Chen, Koel Dutta Chowdhury, Xiaoya Xu +20Data Contamination in Language ModelsLanguage Model Robustness

    Queen’s University Belfast · University of Technology Nuremberg · Saarland University +12

  24. IDRAAK: From Multi-Agent NLP to Few-Shot Prompting for Semantic Drift Detection in Technical Requirements

    Aug 9, 2026Shiva AhirRequirements EngineeringFew-Shot Prompting

    Department of Electrical & Computer Engineering Stony Brook University New York, United States of America

  25. Do Evaluation Metrics Detect Errors in Classical Chinese to English Translations?

    Aug 8, 2026Osvaldo Quinjica, Eric Bennett, Xinchen Yang +2Machine TranslationMT Evaluation

    Department of Computer Science · Department of East Asian Languages and Cultures

  26. Towards End-to-End Multilingual Metaphor Processing: Integrating Detection, Translation, and Evaluation

    Aug 4, 2026Jiahui Liang, Lifeng HanFigurative Language UnderstandingMachine Translation

    Centre for Linguistics, Humanities, Leiden University, NL · LIACS, Leiden University, NL · BDS, Leiden University Medical Centre, NL

  27. M-GATE: Multilingual Grammar, Accuracy in Translation, and Efficiency Benchmark for Large Language Models

    Aug 4, 2026Tomáš Burkert, Angelika Peljak-Łapińska, David ZelenýMultilingual Language Model EvaluationLow-Resource Language Processing

    RWS TrainAI

  28. Looking under the Wrong Lamppost: On the Limitations of Automated Translation Quality Estimation

    Aug 4, 2026Serge Gladkoff, Angelika Vaasa, Sue Ellen Wright +2Automated EvaluationMT Evaluation

    Logrus Global LLC · European Parliament, DG for Translation and Clear Language · Kent State University +2

  29. Predicting Multilingual Classification and Translation Performance of LLMs with Cross-Lingual Alignment \unicodex2013\unicode{x2013} Is English Enough?

    Aug 4, 2026Adnan Al Ali, Kathy Hämmerl, Jindřich Libovický +1Multilingual Language Model EvaluationCross-Lingual Representation Alignment

    Charles University, Faculty of Mathematics and Physics, Czech Republic · Technical University of Munich, Germany · Munich Center for Machine Learning

  30. TQLite: Multi-LLM Jury Guided Distillation for Real-time MQM Translation Quality Evaluation

    Aug 4, 2026Bhavin Jawade, Cameron R. WolfeLLM EvaluationLLM-as-a-Judge

    Netflix