MAATS: A Multi-Agent Automated Translation System Based on MQM Evaluation
On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks
Abstract (arXiv)
We present MAATS, a Multi Agent Automated Translation System that leverages the Multidimensional Quality Metrics (MQM) framework as a fine-grained signal for error detection and refinement. MAATS employs multiple specialized AI agents, each focused on a distinct MQM category (e.g., Accuracy, Fluency, Style, Terminology), followed by a synthesis agent that integrates the annotations to iteratively refine translations. This design contrasts with conventional single-agent methods that rely on self-correction. Evaluated across diverse language pairs and Large Language Models (LLMs), MAATS outperforms zero-shot and single-agent baselines with statistically significant gains in both automatic metrics and human assessments. It excels particularly in semantic accuracy, locale adaptation, and linguistically distant language pairs. Qualitative analysis highlights its strengths in multi-layered error diagnosis, omission detection across perspectives, and context-aware refinement. By aligning modular agent roles with interpretable MQM dimensions, MAATS narrows the gap between black-box LLMs and human translation workflows, shifting focus from surface fluency to deeper semantic and contextual fidelity.
Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 9 of its 19 references that are in the map. First posted on arXiv 20 May 2025.
Builds on
9 of 19 references.
References · 9
- 2020BLEURT: Learning Robust Metrics for Text Generationcited by 1,203
- 2020COMET: A Neural Framework for MT Evaluationcited by 1,033
- 2021Experts, Errors, and Context: A Large-Scale Study of Human Evaluation for Machine Translationcited by 338
- 2023Towards Making the Most of ChatGPT for Machine Translationcited by 138
- 2024Pride and Prejudice: LLM Amplifies Self-Bias in Self-Refinementcited by 114
- 2024Evaluating LLMs at Detecting Errors in LLM Responsescited by 50
- 2024TEaR: Improving LLM-based Machine Translation with Systematic Self-Refinementcited by 39
- 2024Beyond Correlation: Interpretable Evaluation of Machine Translation Metricscited by 10
- 2024Benchmarking GPT-4 against Human Translators: A Comprehensive Evaluation Across Languages, Domains, and Expertise Levelscited by 9
Built on by
Citing papers per year: 2025: 2; 2026: 3.
5 papers.
- 2025Rubric-Conditioned LLM Grading: Alignment, Uncertainty, and Robustnesscited by 5
- 2025Building Large-Scale English-Romanian Literary Translation Resources with Open Modelscited by 2
- 2026SAMAS: A Spectrum-Guided Multi-Agent System for Achieving Style Fidelity in Literary Translationcited by 0
- 2026Ladders in Chaos: When, How, (and Perhaps Why) Does Test-Time Scaling Improve LLM Machine Translationcited by 0
- 2026Breaking Babel: A Self-Evolving Multi-Agent System for Long-Form Subtitle Translationcited by 0
- 2026Breaking Babel: A Self-Evolving Multi-Agent System for Long-Form Subtitle Translation29 Sep 2026
- 2026Ladders in Chaos: When, How, (and Perhaps Why) Does Test-Time Scaling Improve LLM Machine Translation28 Aug 2026
- 2026SAMAS: A Spectrum-Guided Multi-Agent System for Achieving Style Fidelity in Literary Translation23 Feb 2026
- 2025Rubric-Conditioned LLM Grading: Alignment, Uncertainty, and Robustness21 Dec 2025
- 2025Building Large-Scale English-Romanian Literary Translation Resources with Open Models9 Sep 2025
Similar, not cited
Close in wording, no citation either way
- 2025HiMATE: A Hierarchical Multi-Agent Framework for Machine Translation Evaluation
- 2024M-MAD: Multidimensional Multi-Agent Debate for Advanced Machine Translation Evaluation
- 2026Beyond Literal Mapping: Benchmarking and Improving Non-Literal Translation Evaluation
- 2025AI agents may be worth the hype but not the resources (yet): An initial exploration of machine translation quality and costs in three language pairs in the legal and news domains
- 2026Agentic AI Translate: An Agentic Translator Prototype for Translation as Communication Design
- 2026GAIA-v2-LILT: Multilingual Adaptation of Agent Benchmark beyond Translation
- 2025Preserving Cultural Identity with Context-Aware Translation Through Multi-Agent AI Systems
- 2024(Perhaps) Beyond Human Translation: Harnessing Multi-Agent Collaboration for Translating Ultra-Long Literary Texts