TAT-R1: Terminology-Aware Translation with Reinforcement Learning and Word Alignment
On the map: LLM reasoning → Reasoning benchmarks and evaluation
Abstract (arXiv)
Recently, deep reasoning large language models(LLMs) like DeepSeek-R1 have made significant progress in tasks such as mathematics and coding. Inspired by this, several studies have employed reinforcement learning(RL) to enhance models' deep reasoning capabilities and improve machine translation(MT) quality. However, the terminology translation, an essential task in MT, remains unexplored in deep reasoning LLMs. In this paper, we propose TAT-R1, a terminology-aware translation model trained with reinforcement learning and word alignment. Specifically, we first extract the keyword translation pairs using a word alignment model. Then we carefully design three types of rule-based alignment rewards with the extracted alignment relationships. With those alignment rewards, the RL-trained translation model can learn to focus on the accurate translation of key information, including terminology in the source text. Experimental results show the effectiveness of TAT-R1. Our model significantly improves terminology translation accuracy compared to the baseline models while maintaining comparable performance on general translation tasks. In addition, we conduct detailed ablation studies of the DeepSeek-R1-like training paradigm for machine translation and reveal several key findings.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Placed in Reasoning benchmarks and evaluation, one of 17 directions in LLM reasoning. Builds on 20 of its 30 references that are in the map. First posted on arXiv 27 May 2025.
Builds on
20 of 30 references.
Closest ancestors · 3
Same direction, newest first
- 2025MT-R1-Zero: Advancing LLM-based Machine Translation via R1-Zero-like Reinforcement Learning14 Apr
- 2025New Trends for Modern Machine Translation with Large Reasoning Models13 Mar
- 2025Evaluating o1-Like LLMs: Unlocking Reasoning for Translation through Comprehensive Analysis17 Feb
Other references · 17
- 2017Proximal Policy Optimization Algorithmscited by 14,441
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
- 2018A Call for Clarity in Reporting BLEU Scorescited by 1,790
- 2020BLEURT: Learning Robust Metrics for Text Generationcited by 1,196
- 2020COMET: A Neural Framework for MT Evaluationcited by 1,024
- 2023Large Language Models Are State-of-the-Art Evaluators of Translation Qualitycited by 416
- 2023xCOMET: Transparent Machine Translation Evaluation through Fine-grained Error Detectioncited by 260
- 2022CometKiwi: IST-Unbabel 2022 Submission for the Quality Estimation Shared Taskcited by 205
- 2020SimAlign: High Quality Word Alignments without Parallel Training Data using Static and Contextualized Embeddingscited by 155
- 2024Marco-o1: Towards Open Reasoning Models for Open-Ended Solutionscited by 142
- 2024MetricX-24: The Google Submission to the WMT 2024 Metrics Shared Taskcited by 92
- 2024o1-Coder: an o1 Replication for Codingcited by 77
5 more
- 2024Fine-tuning Large Language Models for Domain-specific Machine Translationcited by 43
- 2023Domain Terminology Integration into Machine Translation: Leveraging Large Language Modelscited by 17
- 2023Terminology-Aware Translation with Constrained Decoding and Large Language Model Promptingcited by 8
- 2024Efficient Terminology Integration for LLM-based Translation in Specialized Domainscited by 7
- 2024Efficient Technical Term Translation: A Knowledge Distillation Approach for Parenthetical Terminology Translationcited by 1
Built on by
Citing papers per year: 2025: 1; 2026: 2.
3 papers.
Similar, not cited
Close in wording, no citation either way
- 2025DeepTrans: Deep Reasoning Translation via Reinforcement Learning
- 2025R1-T1: Fully Incentivizing Translation Capability in LLMs via Reasoning Learning
- 2026PAMT: Process-Aligned Reinforcement Learning for Multi-Domain Machine Translation
- 2026Translate-R1: Cost-Aware Translation Tool Use via Reinforcement Learning
- 2026Translation with Thought: Difficulty-Adaptive Reasoning via Reinforcement Learning for Multi-Domain Machine Translation
- 2025100 Days After DeepSeek-R1: A Survey on Replication Studies and More Directions for Reasoning Language Models
- 2025TokAlign: Efficient Vocabulary Adaptation via Token Alignment
- 2025Bridging the Linguistic Divide: A Survey on Leveraging Large Language Models for Machine Translation