mlsanityData to 7 Oct 2026

How Well Do Large Reasoning Models Translate? A Comprehensive Evaluation for Multi-Domain Machine Translation

arXiv 2505.19987 ↗First posted 26 May 2025cs.CLcited by 5

On the map: LLM reasoning → Reasoning benchmarks and evaluation

Abstract (arXiv)

Large language models (LLMs) have demonstrated strong performance in general-purpose machine translation, but their effectiveness in complex, domain-sensitive translation tasks remains underexplored. Recent advancements in Large Reasoning Models (LRMs), raise the question of whether structured reasoning can enhance translation quality across diverse domains. In this work, we compare the performance of LRMs with traditional LLMs across 15 representative domains and four translation directions. Our evaluation considers various factors, including task difficulty, input length, and terminology density. We use a combination of automatic metrics and an enhanced MQM-based evaluation hierarchy to assess translation quality. Our findings show that LRMs consistently outperform traditional LLMs in semantically complex domains, especially in long-text and high-difficulty translation scenarios. Moreover, domain-adaptive prompting strategies further improve performance by better leveraging the reasoning capabilities of LRMs. These results highlight the potential of structured reasoning in MDMT tasks and provide valuable insights for optimizing translation systems in domain-sensitive contexts.

Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Placed in Reasoning benchmarks and evaluation, one of 17 directions in LLM reasoning. Builds on 31 of its 64 references that are in the map. First posted on arXiv 26 May 2025.

Builds on

31 of 64 references.

Closest ancestors · 7

Same direction, newest first

  1. 2025DeepTrans: Deep Reasoning Translation via Reinforcement Learning14 Apr
  2. 2025MT-R1-Zero: Advancing LLM-based Machine Translation via R1-Zero-like Reinforcement Learning14 Apr
  3. 2025New Trends for Modern Machine Translation with Large Reasoning Models13 Mar
  4. 2025R1-T1: Fully Incentivizing Translation Capability in LLMs via Reasoning Learning27 Feb
  5. 2025Evaluating o1-Like LLMs: Unlocking Reasoning for Translation through Comprehensive Analysis17 Feb
  6. 2024DeepSeek-V3 Technical Report27 Dec
  7. 2024DRT: Deep Reasoning Translation via Long Chain-of-Thought23 Dec

Other references · 24

  1. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
  2. 2024GPT-4o System Cardcited by 4,467
  3. 2022Least-to-Most Prompting Enables Complex Reasoning in Large Language Modelscited by 1,397
  4. 2024OpenAI o1 System Cardcited by 1,220
  5. 2024Do NOT Think That Much for 2+3=? On the Overthinking of o1-Like LLMscited by 564
  6. 2023How Good Are GPT Models at Machine Translation? A Comprehensive Evaluationcited by 344
  7. 2023Is ChatGPT A Good Translator? Yes With GPT-4 As The Enginecited by 172
  8. 2024Marco-o1: Towards Open Reasoning Models for Open-Ended Solutionscited by 142
  9. 2024O1 Replication Journey: A Strategic Progress Report -- Part 1cited by 140
  10. 2025CodeElo: Benchmarking Competition-level Code Generation of LLMs with Human-comparable Elo Ratingscited by 109
  11. 2024O1 Replication Journey -- Part 2: Surpassing O1-preview through Simple Distillation, Big Progress or Bitter Lesson?cited by 90
  12. 2025MATH-Perturb: Benchmarking LLMs' Math Reasoning Abilities against Hard Perturbationscited by 88
12 more
  1. 2024o1-Coder: an o1 Replication for Codingcited by 77
  2. 2024Fine-tuning Large Language Models for Domain-specific Machine Translationcited by 43
  3. 2025Long-Short Chain-of-Thought Mixture Supervised Fine-Tuning Eliciting Efficient Reasoning in Large Language Modelscited by 37
  4. 2025SoRFT: Issue Resolving with Subtask-oriented Reinforced Fine-Tuningcited by 27
  5. 2025MA-LoT: Model-Collaboration Lean-based Long Chain-of-Thought Reasoning enhances Formal Theorem Provingcited by 24
  6. 2024How Good Are LLMs for Literary Translation, Really? Literary Translation Evaluation with Humans and LLMscited by 23
  7. 2024GPT-4 vs. Human Translators: A Comprehensive Evaluation of Translation Quality Across Languages, Domains, and Expertise Levelscited by 20
  8. 2025PromptCoT: Synthesizing Olympiad-level Problems for Mathematical Reasoning in Large Language Modelscited by 20
  9. 2025CodeCriticBench: A Holistic Code Critique Benchmark for Large Language Modelscited by 14
  10. 2024Benchmarking GPT-4 against Human Translators: A Comprehensive Evaluation Across Languages, Domains, and Expertise Levelscited by 9
  11. 2025Science Across Languages: Assessing LLM Multilingual Translation of Scientific Paperscited by 8
  12. 2025DMDTEval: An Evaluation and Analysis of LLMs on Disambiguation in Multi-domain Translationcited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 3; 2026: 2.

5 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Unlocking Reasoning Capability on Machine Translation in Large Language Models
  2. 2025Are Large Reasoning Models Good Translation Evaluators? Analysis and Performance Boost
  3. 2025LLM Reasoning for Machine Translation: Synthetic Data Generation over Thinking Tokens
  4. 2026Reasoning about In-Context Samples for Machine-Translation
  5. 2024Large Language Model for Multi-Domain Translation: Benchmarking and Domain CoT Fine-tuning
  6. 2026Why do Large Language Models Fail in Low-resource Translation? Unraveling the Token Dynamics of Large Language Models for Machine Translation
  7. 2025Please Translate Again: Two Simple Experiments on Whether Human-Like Reasoning Helps Translation
  8. 2026Maistros: A Greek Large Language Model Adapted Through Knowledge Distillation From Large Reasoning Models