mlsanityData to 14 Oct 2026

Reasoning Before Translation: Enhancing Legal Machine Translation with Structured Reasoning

arXiv 2607.19181 ↗First posted 21 Jul 2026cs.CL cs.AI cs.LGcited by 0

On the map: LLM reasoning → Reasoning benchmarks and evaluation

Abstract (arXiv)

Neural machine translation (NMT) in the legal domain is a linguistically and conceptually demanding task, primarily due to the complexity of legal language and the high level of precision it requires. The recent emergence of reasoning-capable language models opens new possibilities for tackling such challenges. They add to a set of other previously proposed techniques to enhance the translation quality, which includes supervised fine-tuning and reinforcement learning. In this work, we perform a comparison between these various approaches. More particularly, we evaluate small language models such as Qwen3.5 4B, Qwen3.5 9B, and Gemma 3 12B enhanced with various re-training paradigms and compare their performances against frontier reasoning models. We focus on the Swiss legal system, which -- with its unique multilingual statutes -- offers a particularly challenging testbed for reasoning-augmented models. Our results show that the quality of small ``base'' models can be greatly enhanced, and that reinforcement learning with verifiable rewards can be applied to NMT in the legal domain and surpasses the translation quality of supervised fine-tuning. The performance of enhanced small models is close to the one of state-of-the-art reasoning models yet remains inferior. We also note that re-training paradigms yield diminishing returns as model size increase. The code and models are publicly available at https://github.com/aixiuxiuxiu/Legal-MT-SFT-RL.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Reasoning benchmarks and evaluation, one of 17 directions in LLM reasoning. Builds on 23 of its 47 references that are in the map. First posted on arXiv 21 Jul 2026.

Builds on

23 of 47 references.

Closest ancestors · 6

Same direction, newest first

  1. 2025DeepTrans: Deep Reasoning Translation via Reinforcement Learning14 Apr
  2. 2025MT-R1-Zero: Advancing LLM-based Machine Translation via R1-Zero-like Reinforcement Learning14 Apr
  3. 2025New Trends for Modern Machine Translation with Large Reasoning Models13 Mar
  4. 2025R1-T1: Fully Incentivizing Translation Capability in LLMs via Reasoning Learning27 Feb
  5. 2025Evaluating o1-Like LLMs: Unlocking Reasoning for Translation through Comprehensive Analysis17 Feb
  6. 2024LLMs as Models for Analogical Reasoning19 Jun

Other references · 17

  1. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  2. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
  3. 2022Emergent Abilities of Large Language Modelscited by 2,512
  4. 2017Decoupled Weight Decay Regularizationcited by 1,831
  5. 2020COMET: A Neural Framework for MT Evaluationcited by 1,033
  6. 20218-bit Optimizers via Block-wise Quantizationcited by 403
  7. 2023How Good Are GPT Models at Machine Translation? A Comprehensive Evaluationcited by 348
  8. 2017Six Challenges for Neural Machine Translationcited by 335
  9. 2023A Rank Stabilization Scaling Factor for Fine-Tuning with LoRAcited by 243
  10. 2025REINFORCE++: Stabilizing Critic-Free Policy Optimization with Global Advantage Normalizationcited by 241
  11. 2023Is ChatGPT A Good Translator? Yes With GPT-4 As The Enginecited by 176
  12. 2023GEMBA-MQM: Detecting Translation Quality Error Spans with GPT-4cited by 146
5 more
  1. 2025Competitive Programming with Large Reasoning Modelscited by 119
  2. 2025Med-RLVR: Emerging Medical Reasoning from a 3B base model via reinforcement Learningcited by 40
  3. 2023Iterative Translation Refinement with Large Language Modelscited by 27
  4. 2025SwiLTra-Bench: The Swiss Legal Translation Benchmarkcited by 11
  5. 2026TranslateGemma Technical Reportcited by 7

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026The Price of Reasoning: Cost-Quality Tradeoffs in Reinforcement Learning for Neural Machine Translation
  2. 2025Unilaw-R1: A Large Language Model for Legal Reasoning with Reinforcement Learning and Iterative Inference
  3. 2026Translation with Thought: Difficulty-Adaptive Reasoning via Reinforcement Learning for Multi-Domain Machine Translation
  4. 2025How Well Do Large Reasoning Models Translate? A Comprehensive Evaluation for Multi-Domain Machine Translation
  5. 2026Unlocking Reasoning Capability on Machine Translation in Large Language Models
  6. 2024LawInstruct: A Resource for Studying Language Model Adaptation to the Legal Domain
  7. 2025LLM Reasoning for Machine Translation: Synthetic Data Generation over Thinking Tokens
  8. 2025Continual Pre-Training is (not) What You Need in Domain Adaption