LLaMAX2: Your Translation-Enhanced Model also Performs Well in Reasoning
On the map: LLM reasoning → Reasoning benchmarks and evaluation
Abstract (arXiv)
General Large Language Models (LLMs) excel in reasoning, but those enhanced for translation struggle with reasoning tasks. To address this, we propose a novel translationenhanced recipe that begins with instruct models and applies layer-selective tuning only on parallel data. Following this pipeline, we introduce the Qwen3-XPlus models, which demonstrate significant improvements in translation performance across both high- and lowresource languages, achieving 15+ spBLEU and 40+ xComet in low-resource languages, like Swahili. Interestingly, training only with small parallel datasets, Qwen3-XPlus achieves an average improvement of 1+ points on 7 multilingual tasks while maintaining proficiency comparable to the Qwen3 instruct model in 15 popular reasoning datasets. This work offers a promising approach to multilingual enhancement, significantly reducing complexity and enhancing accessibility for a wider range of languages. The code and model are publicly available.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Reasoning benchmarks and evaluation, one of 17 directions in LLM reasoning. Builds on 38 of its 88 references that are in the map. First posted on arXiv 10 Oct 2025.
Builds on
38 of 88 references.
Closest ancestors · 7
Same direction, newest first
- 2025OpenThoughts: Data Recipes for Reasoning Models4 Jun
- 2025Qwen3 Technical Report14 May
- 2025Could Thinking Multilingually Empower LLM Reasoning?16 Apr
- 2025How Instruction and Reasoning Data shape Post-Training: Data Quality through the Lens of Layer-wise Gradients14 Apr
- 2025MT-R1-Zero: Advancing LLM-based Machine Translation via R1-Zero-like Reinforcement Learning14 Apr
- 2024DeepSeek-V3 Technical Report27 Dec
- 2023Code Llama: Open Foundation Models for Code24 Aug
Other references · 31
- 2024The Llama 3 Herd of Modelscited by 14,192
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
- 2021Evaluating Large Language Models Trained on Codecited by 8,053
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
- 2024Qwen2.5 Technical Reportcited by 4,713
- 2021Prefix-Tuning: Optimizing Continuous Prompts for Generationcited by 3,878
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
- 2023Let's Verify Step by Stepcited by 3,598
- 2021Program Synthesis with Large Language Modelscited by 3,509
- 2024Gemma 2: Improving Open Language Models at a Practical Sizecited by 1,928
- 2025Gemma 3 Technical Reportcited by 1,686
- 2022No Language Left Behind: Scaling Human-Centered Machine Translationcited by 1,290
19 more
- 2024Qwen2.5-Coder Technical Reportcited by 1,151
- 2024Qwen2.5-Math Technical Report: Toward Mathematical Expert Model via Self-Improvementcited by 1,057
- 2024An Image is Worth 1/2 Tokens After Layer 2: Plug-and-Play Inference Acceleration for Large Vision-Language Modelscited by 629
- 2025Kimi K2: Open Agentic Intelligencecited by 523
- 2024InternLM2 Technical Reportcited by 391
- 2024DeepSeek-Coder-V2: Breaking the Barrier of Closed-Source Models in Code Intelligencecited by 325
- 2025Layer by Layer: Uncovering Hidden Representations in Language Modelscited by 293
- 2024Aya Model: An Instruction Finetuned Open-Access Multilingual Language Modelcited by 292
- 2024Tower: An Open Multilingual Large Language Model for Translation-Related Taskscited by 205
- 2024Boosting Multimodal Large Language Models with Visual Tokens Withdrawal for Rapid Inferencecited by 137
- 2024Aya Expanse: Combining Research Breakthroughs for a New Multilingual Frontiercited by 121
- 2024Hunyuan-Large: An Open-Source MoE Model with 52 Billion Activated Parameters by Tencentcited by 89
- 2025Challenging the Boundaries of Reasoning: An Olympiad-Level Math Benchmark for Large Language Modelscited by 65
- 2025Tower+: Bridging Generality and Translation Specialization in Multilingual LLMscited by 40
- 2024Does Representation Matter? Exploring Intermediate Layers in Large Language Modelscited by 31
- 2025BenchMAX: A Comprehensive Multilingual Evaluation Suite for Large Language Modelscited by 23
- 2025Sailor2: Sailing in South-East Asia with Inclusive Multilingual LLMscited by 17
- 2025Hunyuan-MT Technical Reportcited by 7
- 2025Continually Adding New Languages to Multilingual Language Modelscited by 7
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025Unlocking Multilingual Reasoning Capability of LLMs and LVLMs through Representation Engineering
- 2025Seed-X: Building Strong Multilingual Translation LLM with 7B Parameters
- 2024The Power of Question Translation Training in Multilingual Reasoning: Broadened Scope and Deepened Insights
- 2025MMLU-ProX: A Multilingual Benchmark for Advanced Large Language Model Evaluation
- 2024Eliciting Better Multilingual Structured Reasoning from LLMs through Code
- 2025How Well Do Large Reasoning Models Translate? A Comprehensive Evaluation for Multi-Domain Machine Translation
- 2023Extrapolating Large Language Models to Non-English by Aligning Languages
- 2024Question Translation Training for Better Multilingual Reasoning