PAMT: Process-Aligned Reinforcement Learning for Multi-Domain Machine Translation
Not on the map. Why?
Abstract (arXiv)
Multi-domain machine translation (MDMT) requires more than fluent generation: it demands domain-sensitive translation decisions such as domain disambiguation, terminology control, and stylistic adaptation. Large reasoning models (LRMs) make such decisions explicit through intermediate translation steps, but our analysis across 15 domains and four translation directions shows that this explicit reasoning is double-edged: it improves long-form and high-difficulty translation, yet often drifts in terminology-intensive and stylistically constrained settings. We trace this failure to a credit-assignment bottleneck: existing methods optimize final outputs or coarse trajectories, but cannot identify which translation steps actually help the final translation. To address this, we propose PAMT, a process-aligned training framework that combines cold-start domain-aware Long-CoT supervision with reinforcement learning. PAMT uses sequence-level format and outcome rewards for the final translation, together with a step-level process reward that measures how much each explicit translation step increases the likelihood of the reference translation. Across two backbones, PAMT improves over base models, outperforms MT-specialized baselines on average, and remains competitive with strong LLMs/LRMs across in-domain, OOD, and multilingual settings.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 38 of its 54 references that are in the map. First posted on arXiv 4 Aug 2026.
Builds on
38 of 54 references.
References · 38
- 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,767
- 2023Let's Verify Step by Stepcited by 3,598
- 2024HybridFlow: A Flexible and Efficient RLHF Frameworkcited by 1,980
- 2018A Call for Clarity in Reporting BLEU Scorescited by 1,790
- 2024LlamaFactory: Unified Efficient Fine-Tuning of 100+ Language Modelscited by 1,442
- 2020COMET: A Neural Framework for MT Evaluationcited by 1,024
- 2023Math-Shepherd: Verify and Reinforce LLMs Step-by-step without Human Annotationscited by 895
- 2024Improve Mathematical Reasoning in Language Models by Automated Process Supervisioncited by 426
- 2024Contrastive Preference Optimization: Pushing the Boundaries of LLM Performance in Machine Translationcited by 390
- 2021Experts, Errors, and Context: A Large-Scale Study of Human Evaluation for Machine Translationcited by 333
- 2024Step-DPO: Step-wise Preference Optimization for Long-chain Reasoning of LLMscited by 265
- 2022Making Large Language Models Better Reasoners with Step-Aware Verifiercited by 231
26 more
- 2023LEVER: Learning to Verify Language-to-Code Generation with Executioncited by 228
- 2024Tower: An Open Multilingual Large Language Model for Translation-Related Taskscited by 205
- 2020Unsupervised Domain Clusters in Pretrained Language Modelscited by 160
- 2023GEMBA-MQM: Detecting Translation Quality Error Spans with GPT-4cited by 143
- 2018Has Machine Translation Achieved Human Parity? A Case for Document-level Evaluationcited by 88
- 2021BlonDe: An Automatic Evaluation Metric for Document-level Machine Translationcited by 58
- 2023Benchmarking Machine Translation with Cultural Awarenesscited by 53
- 2025MT-R1-Zero: Advancing LLM-based Machine Translation via R1-Zero-like Reinforcement Learningcited by 48
- 2021Domain Adaptation and Multi-Domain Adaptation for Neural Machine Translation: A Surveycited by 46
- 2024Fine-tuning Large Language Models for Domain-specific Machine Translationcited by 43
- 2025Tower+: Bridging Generality and Translation Specialization in Multilingual LLMscited by 40
- 2024TEaR: Improving LLM-based Machine Translation with Systematic Self-Refinementcited by 37
- 2024Translating Step-by-Step: Decomposing the Translation Process for Improved Translation Quality of Long-Form Textscited by 31
- 2024DRT: Deep Reasoning Translation via Long Chain-of-Thoughtcited by 28
- 2024TasTe: Teaching Large Language Models to Translate through Self-Reflectioncited by 27
- 2023Findings of the WMT 2023 Shared Task on Discourse-Level Literary Translation: A Fresh Orb in the Cosmos of LLMscited by 25
- 2024Guiding Large Language Models to Post-Edit Machine Translation with Error Annotationscited by 22
- 2024DUAL-REFLECT: Enhancing Large Language Models for Reflective Translation through Dual Learning Feedback Mechanismscited by 16
- 2024Findings of the WMT 2024 Shared Task on Discourse-Level Literary Translationcited by 15
- 2019Multi-Domain Neural Machine Translation with Word-Level Adaptive Layer-wise Domain Mixingcited by 14
- 2025SSR-Zero: Simple Self-Rewarding Reinforcement Learning for Machine Translationcited by 13
- 2024Large Language Model for Multi-Domain Translation: Benchmarking and Domain CoT Fine-tuningcited by 11
- 2025ExTrans: Multilingual Deep Reasoning Translation via Exemplar-Enhanced Reinforcement Learningcited by 11
- 2025MT-RewardTree: A Comprehensive Framework for Advancing LLM-Based Machine Translation via Reward Modelingcited by 9
- 2025The Box is in the Pen: Evaluating Commonsense Reasoning in Neural Machine Translationcited by 5
- 2025DMDTEval: An Evaluation and Analysis of LLMs on Disambiguation in Multi-domain Translationcited by 3
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Translation with Thought: Difficulty-Adaptive Reasoning via Reinforcement Learning for Multi-Domain Machine Translation
- 2025R1-T1: Fully Incentivizing Translation Capability in LLMs via Reasoning Learning
- 2025TAT-R1: Terminology-Aware Translation with Reinforcement Learning and Word Alignment
- 2025How Well Do Large Reasoning Models Translate? A Comprehensive Evaluation for Multi-Domain Machine Translation
- 2026Translate-R1: Cost-Aware Translation Tool Use via Reinforcement Learning
- 2026Back on Track: Aligning Rewards and States for Reasoning in Diffusion Large Language Models
- 2026ReflectMT: Internalizing Reflection for Efficient and High-Quality Machine Translation
- 2026PEGRL: Improving Machine Translation by Post-Editing Guided Reinforcement Learning