Breaking Babel: A Self-Evolving Multi-Agent System for Long-Form Subtitle Translation
On the map: LLM agents and tool use → Web, search, and research agents also fits: Agent memory systems
also in 1 more
Abstract (arXiv)
Long-form subtitle translation requires reasoning over discourse and cultural context spanning episodes or entire series, while maintaining consistent terminology and style. Existing single-LLM methods are largely sentence-level, and multi-agent systems often use static workflows that do not adapt to scene complexity or production context. We propose SMART, a Self-evolving Multi-Agent system for long-foRm subtitle Translation. During test-time training, SMART builds persistent series-level memory and translates a subset of sentences through a dynamic router and Mixture-of-Agents layer with tools for terminology verification, subtitle constraint validation, and contextual retrieval. A judge-refiner loop scores candidates and uses textual critiques to update agent prompts and routing policies without retraining the underlying LLMs. During test-time inference, the evolved configuration translates the remaining series. We also introduce Subtitle Arena, covering 14 genres, 2--198 episodes per series, production years 1959--2023, and 15 target locales, together with SubMQM, a subtitle-adapted MQM framework with seven dimensions and 19 error categories. SMART achieves the best overall MQM score in all 15 Subtitle Arena directions, reducing average penalty by 6.9% over the strongest competing agent system. On a public benchmark, MuSC, SMART obtains the best model result across all 4 language pairs. SMART also achieves the best result in human evaluation with an overall score of 4.50/5.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Web, search, and research agents, one of 16 directions in LLM agents and tool use. Builds on 44 of its 62 references that are in the map. First posted on arXiv 29 Sep 2026.
Builds on
44 of 62 references.
References · 44
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
- 2025Qwen3 Technical Reportcited by 8,195
- 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,081
- 2023CAMEL: Communicative Agents for "Mind" Exploration of Large Language Model Societycited by 1,348
- 2022Large Language Models Are Human-Level Prompt Engineerscited by 1,020
- 2025OpenAI GPT-5 System Cardcited by 910
- 2023DSPy: Compiling Declarative Language Model Calls into Self-Improving Pipelinescited by 803
- 2024Large Language Model based Multi-Agents: A Survey of Progress and Challengescited by 752
- 2023Automatic Prompt Optimization with "Gradient Descent" and Beam Searchcited by 628
- 2023Promptbreeder: Self-Referential Self-Improvement Via Prompt Evolutioncited by 521
- 2025Qwen3-Omni Technical Reportcited by 451
- 2025GEPA: Reflective Prompt Evolution Can Outperform Reinforcement Learningcited by 449
32 more
- 2022RLPrompt: Optimizing Discrete Text Prompts with Reinforcement Learningcited by 361
- 2024TextGrad: Automatic "Differentiation" via Textcited by 250
- 2025A Comprehensive Survey of Self-Evolving AI Agents: A New Paradigm Bridging Foundation Models and Lifelong Agentic Systemscited by 177
- 2025A Survey of Self-Evolving Agents: What, When, How, and Where to Evolve on the Path to Artificial Super Intelligencecited by 155
- 2023GEMBA-MQM: Detecting Translation Quality Error Spans with GPT-4cited by 143
- 2025Evo-Memory: Benchmarking LLM Agent Test-time Learning with Self-Evolving Memorycited by 129
- 2024Toward Self-Improvement of LLMs via Imagination, Searching, and Criticizingcited by 123
- 2023The Devil is in the Errors: Leveraging Large Language Models for Fine-grained Machine Translation Evaluationcited by 95
- 2023A Paradigm Shift in Machine Translation: Boosting Translation Performance of Large Language Modelscited by 88
- 2024(Perhaps) Beyond Human Translation: Harnessing Multi-Agent Collaboration for Translating Ultra-Long Literary Textscited by 49
- 2025EvoFlow: Evolving Diverse Agentic Workflows On The Flycited by 49
- 2023Exploring Human-Like Translation Strategy with Large Language Modelscited by 44
- 2025EvoAgentX: An Automated Framework for Evolving Agentic Workflowscited by 43
- 2024TEaR: Improving LLM-based Machine Translation with Systematic Self-Refinementcited by 37
- 2024X-ALMA: Plug & Play Modules and Adaptive Rejection for Quality Translation at Scalecited by 36
- 2026Tool-R0: Self-Evolving LLM Agents for Tool-Learning from Zero Datacited by 31
- 2024DynaSaur: Large Language Agents Beyond Predefined Actionscited by 30
- 2024DRT: Deep Reasoning Translation via Long Chain-of-Thoughtcited by 28
- 2024DelTA: An Online Document-Level Translation Agent Based on Multi-Level Memorycited by 27
- 2024B-STaR: Monitoring and Balancing Exploration and Exploitation in Self-Taught Reasonerscited by 26
- 2024REVOLVE: Optimizing AI Systems by Tracking Response Evolution in Textual Optimizationcited by 20
- 2025SEW: Self-Evolving Agentic Workflows for Automated Code Generationcited by 18
- 2020MuST-Cinema: a Speech-to-Subtitles corpuscited by 17
- 2022SubER: A Metric for Automatic Evaluation of Subtitle Qualitycited by 9
- 2023BigVideo: A Large-scale Video Subtitle Translation Dataset for Multimodal Machine Translationcited by 9
- 2022Direct Speech Translation for Automatic Subtitlingcited by 7
- 2025SIPDO: Closed-Loop Prompt Optimization via Synthetic Data Feedbackcited by 7
- 2025MAATS: A Multi-Agent Automated Translation System Based on MQM Evaluationcited by 5
- 2025TACTIC: Translation Agents with Cognitive-Theoretic Interactive Collaborationcited by 5
- 2025ViDove: A Translation Agent System with Multimodal Context and Memory-Augmented Reasoningcited by 3
- 2026Hermes the Polyglot: A Unified Framework to Enhance Expressiveness for Multimodal Interlingual Subtitlingcited by 2
- 2026From Utterance to Vividity: Training Expressive Subtitle Translation LLM via Adaptive Local Preference Optimizationcited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025LongVideoAgent: Multi-Agent Reasoning with Long Videos
- 2025NexusSum: Hierarchical LLM Agents for Long-Form Narrative Summarization
- 2024Chain of Agents: Large Language Models Collaborating on Long-Context Tasks
- 2026BabelArena: A Large-Scale Multilingual Benchmark for LLM Agents
- 2025Long Context Scaling: Divide and Conquer via Multi-Agent Question-driven Collaboration
- 2026GAIA-v2-LILT: Multilingual Adaptation of Agent Benchmark beyond Translation
- 2024CRAT: A Multi-Agent Framework for Causality-Enhanced Reflective and Retrieval-Augmented Translation with Large Language Models
- 2026Loong: A Human-Like Long Document Translation Agent with Observe-and-Act Adaptive Context Selection