mlsanityData to 14 Oct 2026

(Perhaps) Beyond Human Translation: Harnessing Multi-Agent Collaboration for Translating Ultra-Long Literary Texts

arXiv 2405.11804 ↗First posted 20 May 2024cs.CLcited by 49

On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks

Abstract (arXiv)

Literary translation remains one of the most challenging frontiers in machine translation due to the complexity of capturing figurative language, cultural nuances, and unique stylistic elements. In this work, we introduce TransAgents, a novel multi-agent framework that simulates the roles and collaborative practices of a human translation company, including a CEO, Senior Editor, Junior Editor, Translator, Localization Specialist, and Proofreader. The translation process is divided into two stages: a preparation stage where the team is assembled and comprehensive translation guidelines are drafted, and an execution stage that involves sequential translation, localization, proofreading, and a final quality check. Furthermore, we propose two innovative evaluation strategies: Monolingual Human Preference (MHP), which evaluates translations based solely on target language quality and cultural appropriateness, and Bilingual LLM Preference (BLP), which leverages large language models like GPT-4} for direct text comparison. Although TransAgents achieves lower d-BLEU scores, due to the limited diversity of references, its translations are significantly better than those of other baselines and are preferred by both human evaluators and LLMs over traditional human references and GPT-4} translations. Our findings highlight the potential of multi-agent collaboration in enhancing translation quality, particularly for longer texts.

Key facts. Cited by 49 papers in the map (data through 14 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 96 of its 141 references that are in the map. First posted on arXiv 20 May 2024.

Builds on

96 of 141 references.

Closest ancestors · 5

Same direction, newest first

  1. 2024Large Language Model based Multi-Agents: A Survey of Progress and Challenges21 Jan
  2. 2023ChatEval: Towards Better LLM-based Evaluators through Multi-Agent Debate14 Aug
  3. 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Framework1 Aug
  4. 2023Building Cooperative Embodied Agents Modularly with Large Language Models5 Jul
  5. 2023Describe, Explain, Plan and Select: Interactive Planning with Large Language Models Enables Open-World Multi-Task Agents3 Feb

Other references · 91

  1. 2017Attention Is All You Needcited by 60,361
  2. 2020Language Models are Few-Shot Learnerscited by 32,419
  3. 2023GPT-4 Technical Reportcited by 18,396
  4. 2022Training language models to follow instructions with human feedbackcited by 15,971
  5. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
  6. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
  7. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
  8. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
  9. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 8,065
  10. 2020Measuring Massive Multitask Language Understandingcited by 7,963
  11. 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,718
  12. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,276
38 more
  1. 2014Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translationcited by 4,057
  2. 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,780
  3. 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,568
  4. 2023QLoRA: Efficient Finetuning of Quantized LLMscited by 3,418
  5. 2023Qwen Technical Reportcited by 3,344
  6. 2022Scaling Instruction-Finetuned Language Modelscited by 3,024
  7. 2014Sequence to Sequence Learning with Neural Networkscited by 2,986
  8. 2022Self-Instruct: Aligning Language Models with Self-Generated Instructionscited by 2,724
  9. 2018A Call for Clarity in Reporting BLEU Scorescited by 1,799
  10. 2023Improving Factuality and Reasoning in Language Models through Multiagent Debatecited by 1,784
  11. 2021Multitask Prompted Training Enables Zero-Shot Task Generalizationcited by 1,470
  12. 2023LongBench: A Bilingual, Multitask Benchmark for Long Context Understandingcited by 1,417
  13. 2022No Language Left Behind: Scaling Human-Centered Machine Translationcited by 1,312
  14. 2020BLEURT: Learning Robust Metrics for Text Generationcited by 1,203
  15. 2020Multilingual Denoising Pre-training for Neural Machine Translationcited by 1,035
  16. 2020COMET: A Neural Framework for MT Evaluationcited by 1,033
  17. 2023Encouraging Divergent Thinking in Large Language Models through Multi-Agent Debatecited by 1,011
  18. 2024Length-Controlled AlpacaEval: A Simple Way to Debias Automatic Evaluatorscited by 897
  19. 2022Super-NaturalInstructions: Generalization via Declarative Instructions on 1600+ NLP Taskscited by 868
  20. 2024DoRA: Weight-Decomposed Low-Rank Adaptationcited by 758
  21. 2023The Flan Collection: Designing Data and Methods for Effective Instruction Tuningcited by 739
  22. 2023WizardCoder: Empowering Code Large Language Models with Evol-Instructcited by 733
  23. 2023Siren's Song in the AI Ocean: A Survey on Hallucination in Large Language Modelscited by 698
  24. 2024ORPO: Monolithic Preference Optimization without Reference Modelcited by 562
  25. 2020Beyond English-Centric Multilingual Machine Translationcited by 561
  26. 2017Convolutional Sequence to Sequence Learningcited by 552
  27. 2023MAmmoTH: Building Math Generalist Models through Hybrid Instruction Tuningcited by 487
  28. 2017Non-Autoregressive Neural Machine Translationcited by 463
  29. 2023Large Language Models Are State-of-the-Art Evaluators of Translation Qualitycited by 420
  30. 2024Contrastive Preference Optimization: Pushing the Boundaries of LLM Performance in Machine Translationcited by 394
  31. 2021Experts, Errors, and Context: A Large-Scale Study of Human Evaluation for Machine Translationcited by 338
  32. 2024Replacing Judges with Juries: Evaluating LLM Generations with a Panel of Diverse Modelscited by 326
  33. 2023Effective Long-Context Scaling of Foundation Modelscited by 303
  34. 2022Social Simulacra: Creating Populated Prototypes for Social Computing Systemscited by 301
  35. 2022UL2: Unifying Language Learning Paradigmscited by 295
  36. 2024Long-context LLMs Struggle with Long In-context Learningcited by 286
  37. 2023xCOMET: Transparent Machine Translation Evaluation through Fine-grained Error Detectioncited by 265
  38. 2023Self-collaboration Code Generation via ChatGPTcited by 258

50 most cited of 91 All 91 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 12; 2025: 24; 2026: 13.

49 papers.

Sort:

By area:

  1. 2025Multi-Agent Collaboration Mechanisms: A Survey of LLMscited by 431
  2. 2024Survey of Cultural Awareness in Language Models: Text and Beyondcited by 103
  3. 2024On the Resilience of LLM-Based Multi-Agent Collaboration with Faulty Agentscited by 99
  4. 2025LLM Agents for Education: Advances and Applicationscited by 59
  5. 2024Translating Step-by-Step: Decomposing the Translation Process for Improved Translation Quality of Long-Form Textscited by 31
  6. 2025The Bitter Lesson Learned from 2,000+ Multilingual Benchmarkscited by 31
  7. 2025FilmAgent: A Multi-Agent Framework for End-to-End Film Automation in Virtual 3D Spacescited by 28
  8. 2024DelTA: An Online Document-Level Translation Agent Based on Multi-Level Memorycited by 27
  9. 2025Evaluating o1-Like LLMs: Unlocking Reasoning for Translation through Comprehensive Analysiscited by 26
  10. 2024How Good Are LLMs for Literary Translation, Really? Literary Translation Evaluation with Humans and LLMscited by 23
  11. 2024GPT-4 vs. Human Translators: A Comprehensive Evaluation of Translation Quality Across Languages, Domains, and Expertise Levelscited by 21
  12. 2024Findings of the WMT 2024 Shared Task on Discourse-Level Literary Translationcited by 15
37 more
  1. 2025ComfyUI-R1: Exploring Reasoning Models for Workflow Generationcited by 15
  2. 2024Agentic LLM Workflows for Generating Patient-Friendly Medical Reportscited by 13
  3. 2025Agentic AI Systems Applied to tasks in Financial Services: Modeling and model risk management crewscited by 12
  4. 2025Multilingual Contextualization of Large Language Models for Document-Level Machine Translationcited by 11
  5. 2026The Five Ws of Multi-Agent Communication: Who Talks to Whom, When, What, and Why -- A Survey from MARL to Emergent Language and LLMscited by 10
  6. 2024Benchmarking GPT-4 against Human Translators: A Comprehensive Evaluation Across Languages, Domains, and Expertise Levelscited by 9
  7. 2024LLM-based Translation Inference with Iterative Bilingual Understandingcited by 6
  8. 2025Doc-Guided Sent2Sent++: A Sent2Sent++ Agent with Doc-Guided memory for Document-level Machine Translationcited by 6
  9. 2026Human oversight of agentic systems in practice: Examining the oversight work, challenges, and heuristics of developers using software agentscited by 6
  10. 2025TACTIC: Translation Agents with Cognitive-Theoretic Interactive Collaborationcited by 5
  11. 2025DefenderBench: A Toolkit for Evaluating Language Agents in Cybersecurity Environmentscited by 4
  12. 2024Rewarding What Matters: Step-by-Step Reinforcement Learning for Task-Oriented Dialoguecited by 3
  13. 2024Towards a Science Exocortexcited by 3
  14. 2025Solving the Unsolvable: Translating Case Law in Hong Kongcited by 3
  15. 2025Can LLMs Simulate Personas with Reversed Performance? A Systematic Investigation for Counterfactual Instruction Following in Math Reasoning Contextcited by 3
  16. 2025Steering Large Language Models for Machine Translation Personalizationcited by 3
  17. 2025MELAC: Massive Evaluation of Large Language Models with Alignment of Culture in Persian Languagecited by 3
  18. 2025TransLaw: A Large-Scale Dataset and Multi-Agent Benchmark Simulating Professional Translation of Hong Kong Case Lawcited by 2
  19. 2025Building from Scratch: A Multi-Agent Framework with Human-in-the-Loop for Multilingual Legal Terminology Mappingcited by 2
  20. 2025TransBench: Benchmarking Machine Translation for Industrial-Scale Applicationscited by 1
  21. 2025Learning to Summarize by Learning to Quiz: Adversarial Agentic Collaboration for Long Document Summarizationcited by 1
  22. 2025Liaozhai through the Looking-Glass: On Paratextual Explicitation of Culture-Bound Terms in Machine Translationcited by 1
  23. 2025Discourse Graph Guided Document Translation with Large Language Modelscited by 1
  24. 2026On the Creativity of AI Agentscited by 1
  25. 2026Beyond Reproduction: A Paired-Task Framework for Assessing LLM Comprehension and Creativity in Literary Translationcited by 1
  26. 2026Beyond Accuracy: Community Perspectives on Machine Translationcited by 1
  27. 2025Interpretable Style Takagi-Sugeno-Kang Fuzzy Clusteringcited by 0
  28. 2025Beyond the Sentence: A Survey on Context-Aware Machine Translation with Large Language Modelscited by 0
  29. 2025TreePrompt: Leveraging Hierarchical Few-Shot Example Selection for Improved English-Persian and English-German Translationcited by 0
  30. 2026SAMAS: A Spectrum-Guided Multi-Agent System for Achieving Style Fidelity in Literary Translationcited by 0
  31. 2026LLMs Should Incorporate Explicit Mechanisms for Human Empathycited by 0
  32. 2026Agentic AI Translate: An Agentic Translator Prototype for Translation as Communication Designcited by 0
  33. 2026Smarter edits? Post-editing with error highlights and translation suggestionscited by 0
  34. 2026Translation as a Decision Space: A Multi-Agent Perspective on Low-Resource Dialect Generationcited by 0
  35. 2026Doc2FRC: Length-Consistent Document-Level Machine Translation via Fixed-Range Chunkingcited by 0
  36. 2026When Do Agents Help? Embedding, LLM and Agentic Alignment of Classical Texts and Their Translationscited by 0
  37. 2026Breaking Babel: A Self-Evolving Multi-Agent System for Long-Form Subtitle Translationcited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2025DITING: A Multi-Agent Evaluation Framework for Benchmarking Web Novel Translation
  2. 2025MAS-LitEval : Multi-Agent System for Literary Translation Quality Assessment
  3. 2026Beyond Literal Mapping: Benchmarking and Improving Non-Literal Translation Evaluation
  4. 2025MAATS: A Multi-Agent Automated Translation System Based on MQM Evaluation
  5. 2025Preserving Cultural Identity with Context-Aware Translation Through Multi-Agent AI Systems
  6. 2025AI agents may be worth the hype but not the resources (yet): An initial exploration of machine translation quality and costs in three language pairs in the legal and news domains
  7. 2025HiMATE: A Hierarchical Multi-Agent Framework for Machine Translation Evaluation
  8. 2024Towards Red Teaming in Multimodal and Multilingual Translation