ReflectMT: Internalizing Reflection for Efficient and High-Quality Machine Translation
On the map: LLM reasoning → Reasoning benchmarks and evaluation
Abstract (arXiv)
Recent years have witnessed growing interest in applying Large Reasoning Models (LRMs) to Machine Translation (MT). Existing approaches predominantly adopt a "think-first-then-translate" paradigm. Although explicit reasoning trajectories significantly enhance translation quality, they incur prohibitive inference costs and latency. To address these limitations, we propose ReflectMT, a two-stage reflection internalization algorithm for machine translation that employs a "translate-first-think-later" paradigm. Our approach develops the model's "translate-reflect-refine" capability through reinforcement learning. In the first stage, we cultivate the model's capacity for high-quality reflection and refinement, thereby enhancing its semantic comprehension and task-specific knowledge. In the second stage, we train the model to internalize the knowledge acquired during reflection. As a result, during inference, ReflectMT operates in a direct translation mode, producing high-quality translations on the first attempt without any explicit reasoning steps. Experimental results on datasets such as WMT24 demonstrate that our model's first-pass translations during inference outperform multi-step reasoning LRMs such as DeepSeek-R1 in both automatic metrics and GPT-based evaluation, achieving a 2.16-point improvement in GPT-based translation quality evaluation while reducing token consumption by 94.33%.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Reasoning benchmarks and evaluation, one of 17 directions in LLM reasoning. Builds on 14 of its 27 references that are in the map. First posted on arXiv 21 Apr 2026.
Builds on
14 of 27 references.
Closest ancestors · 1
Same direction, newest first
- 2025ExTrans: Multilingual Deep Reasoning Translation via Exemplar-Enhanced Reinforcement Learning19 May
Other references · 13
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,276
- 2023Large Language Models Are State-of-the-Art Evaluators of Translation Qualitycited by 420
- 2022Large Language Models are Better Reasoners with Self-Verificationcited by 307
- 2024Marco-o1: Towards Open Reasoning Models for Open-Ended Solutionscited by 144
- 2024MetricX-24: The Google Submission to the WMT 2024 Metrics Shared Taskcited by 93
- 2023Scaling up COMETKIWI: Unbabel-IST 2023 Submission for the Quality Estimation Shared Taskcited by 88
- 2023Towards Mitigating Hallucination in Large Language Models via Self-Reflectioncited by 81
- 2024TasTe: Teaching Large Language Models to Translate through Self-Reflectioncited by 27
- 2025Instruct-of-Reflection: Enhancing Large Language Models Iterative Reflection Capabilities via Dynamic-Meta Instructioncited by 10
- 2025SlangDIT: Benchmarking LLMs in Interpretative Slang Translationcited by 3
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025New Trends for Modern Machine Translation with Large Reasoning Models
- 2026Translation with Thought: Difficulty-Adaptive Reasoning via Reinforcement Learning for Multi-Domain Machine Translation
- 2026Unlocking Reasoning Capability on Machine Translation in Large Language Models
- 2025R1-T1: Fully Incentivizing Translation Capability in LLMs via Reasoning Learning
- 2026Reasoning about In-Context Samples for Machine-Translation
- 2025How Well Do Large Reasoning Models Translate? A Comprehensive Evaluation for Multi-Domain Machine Translation
- 2025DeepTrans: Deep Reasoning Translation via Reinforcement Learning
- 2026LatentMT: Machine Translation with Latent Reasoning