cs.CLSep 8, 2026

FACET at WMT 2026 Automated Translation Quality Evaluation Task

Authors: Ahrii Kim, Chanjun Park, Seong-heum Kim

Organizations: AI-Bio Convergence Research Inst. Soongsil University · School of Software Soongsil University · Dept. of Intelligent Semiconductors Soongsil University

Abstract

Different error types in machine translation require different evidence. Whether meaning is preserved can be judged only against the source, while whether the target is well-formed, or whether it names one entity consistently, can be judged from the target alone. We present FACET, our reference-free submission to the WMT26 Automated Translation Quality Evaluation Task, which decomposes evaluation into Fluency, Accuracy, and Consistency passes and gives each pass only the context its error type requires. A single fixed model is prompted three times, and the merged error spans yield the three task outputs, error spans, quality scores, and error-free labels, with no trained components. We also submit FACET-C, which omits the Consistency pass. Without gold labels, we characterize the predictions of FACET. Its system rankings place post-edited human translation first, and the Consistency pass changes about a tenth of segment scores while leaving the ranking nearly unchanged.

Figures & tables

Explore similar work

CardsList
  1. AskQE: Question Answering as Automatic Evaluation for Machine Translation

    Apr 15, 2025Dayeon Ki, Kevin Duh, Marine CarpuatMT Evaluation

  2. Span-Level Machine Translation Meta-Evaluation

    Mar 20, 2026Stefano Perrella, Eric Morales Agostinho, Hugo ZaragozaMT Evaluation

  3. CompactQE: Interpretable Translation Quality Estimation via Small Open-Weight LLMs

    May 15, 2026Kamil Guttmann, Zofia Fraś, Artur Nowakowski +1Small Language ModelsMT Evaluation