mlsanityData to 7 Oct 2026

Towards Reliable Machine Translation: Scaling LLMs for Critical Error Detection and Safety

arXiv 2602.11444 ↗First posted 11 Feb 2026cs.CL cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Machine Translation (MT) plays a pivotal role in cross-lingual information access, public policy communication, and equitable knowledge dissemination. However, critical meaning errors, such as factual distortions, intent reversals, or biased translations, can undermine the reliability, fairness, and safety of multilingual systems. In this work, we explore the capacity of instruction-tuned Large Language Models (LLMs) to detect such critical errors, evaluating models across a range of parameters using the publicly accessible data sets. Our findings show that model scaling and adaptation strategies (zero-shot, few-shot, fine-tuning) yield consistent improvements, outperforming encoder-only baselines like XLM-R and ModernBERT. We argue that improving critical error detection in MT contributes to safer, more trustworthy, and socially accountable information systems by reducing the risk of disinformation, miscommunication, and linguistic harm, especially in high-stakes or underrepresented contexts. This work positions error detection not merely as a technical challenge, but as a necessary safeguard in the pursuit of just and responsible multilingual AI. The code will be made available at GitHub.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 13 of its 35 references that are in the map. First posted on arXiv 11 Feb 2026.

Builds on

13 of 35 references.

References · 13

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2023GPT-4 Technical Reportcited by 18,132
  3. 2024The Llama 3 Herd of Modelscited by 14,192
  4. 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,907
  5. 2020COMET: A Neural Framework for MT Evaluationcited by 1,024
  6. 2024Smarter, Better, Faster, Longer: A Modern Bidirectional Encoder for Fast, Memory Efficient, and Long Context Finetuning and Inferencecited by 527
  7. 2023Large Language Models Are State-of-the-Art Evaluators of Translation Qualitycited by 416
  8. 2020Unsupervised Quality Estimation for Neural Machine Translationcited by 210
  9. 2023Towards Making the Most of ChatGPT for Machine Translationcited by 138
  10. 2023Error Analysis Prompting Enables Human-Like Translation Evaluation in Large Language Modelscited by 87
  11. 2020MLQE-PE: A Multilingual Quality Estimation and Post-Editing Datasetcited by 47
  12. 2025mmBERT: A Modern Multilingual Encoder with Annealed Language Learningcited by 39
1 more
  1. 2025SynCED-EnDe 2025: A Synthetic and Curated English - German Dataset for Critical Error Detection in Machine Translationcited by 2

Built on by

Not cited yet.