mlsanityData to 14 Oct 2026

FACET at WMT 2026 Automated Translation Quality Evaluation Task

arXiv 2610.00096 ↗First posted 8 Sep 2026cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

Different error types in machine translation require different evidence. Whether meaning is preserved can be judged only against the source, while whether the target is well-formed, or whether it names one entity consistently, can be judged from the target alone. We present FACET, our reference-free submission to the WMT26 Automated Translation Quality Evaluation Task, which decomposes evaluation into Fluency, Accuracy, and Consistency passes and gives each pass only the context its error type requires. A single fixed model is prompted three times, and the merged error spans yield the three task outputs, error spans, quality scores, and error-free labels, with no trained components. We also submit FACET-C, which omits the Consistency pass. Without gold labels, we characterize the predictions of FACET. Its system rankings place post-edited human translation first, and the Consistency pass changes about a tenth of segment scores while leaving the ranking nearly unchanged.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 9 of its 31 references that are in the map. First posted on arXiv 8 Sep 2026.

Builds on

9 of 31 references.

References · 9

  1. 2023Large Language Modelscited by 780
  2. 2023Large Language Models Are State-of-the-Art Evaluators of Translation Qualitycited by 420
  3. 2023xCOMET: Transparent Machine Translation Evaluation through Fine-grained Error Detectioncited by 265
  4. 2022CometKiwi: IST-Unbabel 2022 Submission for the Quality Estimation Shared Taskcited by 207
  5. 2023GEMBA-MQM: Detecting Translation Quality Error Spans with GPT-4cited by 146
  6. 2020TransQuest: Translation Quality Estimation with Cross-lingual Transformerscited by 59
  7. 2024MQM-APE: Toward High-Quality Error Annotation Predictors with Automatic Post-Editing in LLM Translation Evaluatorscited by 22
  8. 2022COMET-QE and Active Learning for Low-Resource Machine Translationcited by 10
  9. 2026Do LLMs Truly Benefit from Longer Context in Automatic Post-Editing?cited by 1

Built on by

Not cited yet.