Seed-X: Building Strong Multilingual Translation LLM with 7B Parameters
Not on the map. Why?
Abstract (arXiv)
Multilingual translation stands as a challenging task for large language models (LLMs) to handle intricate language patterns and stilted translations that arise in automated translations. In this paper, we introduce Seed-X, a family of open-source LLMs comprising instruct and reasoning models, pushing the limits of translation capability with 7B parameter size. The base model is pre-trained on a diverse, high-quality dataset encompassing both monolingual and bilingual content across 28 languages, harnessing the full potential of multilingual data. The instruct model is then finetuned to translate by Chain-of-Thought (CoT) reasoning and further enhanced through reinforcement learning (RL) to achieve better generalization across diverse language pairs. Seed-X achieves performance comparable to leading closed-source models, including Gemini-2.5 and GPT-4o, across 28 languages, and significantly outperforms larger open-source models in both automatic metrics and human evaluations. We share the best practices through our optimization process, and make the parameter public available for advancing translation research and applications.
Key facts. Cited by 21 papers in the map (data through 7 Oct 2026). Builds on 40 of its 56 references that are in the map. First posted on arXiv 18 Jul 2025.
Builds on
40 of 56 references.
References · 40
- 2017Attention Is All You Needcited by 59,932
- 2017Proximal Policy Optimization Algorithmscited by 14,441
- 2024The Llama 3 Herd of Modelscited by 14,192
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
- 2020Measuring Massive Multitask Language Understandingcited by 7,768
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
- 2024Qwen2.5 Technical Reportcited by 4,713
- 2018Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challengecited by 4,710
- 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,581
- 2023Mistral 7Bcited by 3,065
- 2015Neural Machine Translation of Rare Words with Subword Unitscited by 2,898
- 2023Code Llama: Open Foundation Models for Codecited by 2,105
28 more
- 2016Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translationcited by 1,471
- 2020BLEURT: Learning Robust Metrics for Text Generationcited by 1,196
- 2020COMET: A Neural Framework for MT Evaluationcited by 1,024
- 2023WizardCoder: Empowering Code Large Language Models with Evol-Instructcited by 728
- 2024DeepSeek LLM: Scaling Open-Source Language Models with Longtermismcited by 621
- 2021The FLORES-101 Evaluation Benchmark for Low-Resource and Multilingual Machine Translationcited by 556
- 2023MAmmoTH: Building Math Generalist Models through Hybrid Instruction Tuningcited by 483
- 2023Scaling Relationship on Learning Mathematical Reasoning with Large Language Modelscited by 417
- 2024Contrastive Preference Optimization: Pushing the Boundaries of LLM Performance in Machine Translationcited by 390
- 2020XCOPA: A Multilingual Dataset for Causal Commonsense Reasoningcited by 330
- 2021Few-shot Learning with Multilingual Language Modelscited by 278
- 2019PAWS-X: A Cross-lingual Adversarial Dataset for Paraphrase Identificationcited by 262
- 2023xCOMET: Transparent Machine Translation Evaluation through Fine-grained Error Detectioncited by 260
- 2023Is ChatGPT A Good Translator? Yes With GPT-4 As The Enginecited by 172
- 2023Multilingual Machine Translation with Large Language Models: Empirical Results and Analysiscited by 156
- 2023MathCoder: Seamless Code Integration in LLMs for Enhanced Mathematical Reasoningcited by 155
- 2024How do Large Language Models Handle Multilingualism?cited by 148
- 2023A Survey of Large Language Models in Medicine: Progress, Application, and Challengecited by 123
- 2023The unreasonable effectiveness of few-shot learning for machine translationcited by 91
- 2023A Paradigm Shift in Machine Translation: Boosting Translation Performance of Large Language Modelscited by 88
- 2023SAILER: Structure-aware Pre-trained Language Model for Legal Case Retrievalcited by 61
- 2023Eliciting the Translation Ability of Large Language Models via Multilingual Finetuning with Translation Instructionscited by 55
- 2024LLaMAX: Scaling Linguistic Horizons of LLM by Enhancing Translation Capabilities Beyond 100 Languagescited by 47
- 2021Language Tags Matter for Zero-Shot Neural Machine Translationcited by 29
- 2024G-DIG: Towards Gradient-based Diverse and High-quality Instruction Data Selection for Machine Translationcited by 29
- 2024Salute the Classic: Revisiting Challenges of Machine Translation in the Age of Large Language Modelscited by 17
- 2024Large Language Models as Agents in Two-Player Gamescited by 10
- 2025Trans-Zero: Self-Play Incentivizes Large Language Models for Multilingual Translation Without Parallel Datacited by 3
Built on by
Citing papers per year: 2025: 8; 2026: 13.
21 papers.
Sort:
By area:
- 2025GLM-4.5: Agentic, Reasoning, and Coding (ARC) Foundation Modelscited by 446
- 2025Hunyuan-MT Technical Reportcited by 7
- 2025Test-Time Scaling of Reasoning Models for Machine Translationcited by 5
- 2026Mending the Holes: Mitigating Reward Hacking in Reinforcement Learning for Multilingual Translationcited by 3
- 2025Understanding Post-Training Structural Changes in Large Language Modelscited by 2
- 2026GRRM: Group Relative Reward Modeling for Machine Translationcited by 2
- 2026Beyond Literal Translation: Evaluating Cultural Effectiveness in Social Media UGCcited by 2
- 2025HY-MT1.5 Technical Reportcited by 1
- 2026Shifting the Breaking Point of Flow Matching for Multi-Instance Editingcited by 1
- 2026Optimizing Korean-Centric LLMs via Token Pruningcited by 1
- 2026Cultivar: A Contrastive and Locale-Oriented Translation Benchmark for Investigating Contamination and Localisation Robustnesscited by 1
- 2026Last Translation Benchmarkcited by 1
9 more
- 2025SmolKalam: Ensemble Quality-Filtered Translation at Scale for High Quality Arabic Post-Training Datacited by 0
- 2025OmniFusion: Simultaneous Multilingual Multimodal Translations via Modular Fusioncited by 0
- 2025Fluent Alignment with Disfluent Judges: Post-training for Lower-resource Languagescited by 0
- 2026DEEP: Docker-based Execution and Evaluation Platformcited by 0
- 2026From Words to Worlds: Benchmarking Cross-Cultural Cultural Understanding in Machine Translationcited by 0
- 2026VEPO: Variable Entropy Policy Optimization for Low-Resource Language Foundation Modelscited by 0
- 2026Two-Stage Multi-Modal Fusion with Adaptive Alignment for Action Quality Assessmentcited by 0
- 2026Studying quantization trade-offs for efficient inference deployment in machine translationcited by 0
- 2026Drift-Constrained Optimization: Only Direction Matters in Fine-Tuning Instruct Modelscited by 0
- 2026Drift-Constrained Optimization: Only Direction Matters in Fine-Tuning Instruct Models12 Sep 2026
- 2026Last Translation Benchmark3 Sep 2026
- 2026Cultivar: A Contrastive and Locale-Oriented Translation Benchmark for Investigating Contamination and Localisation Robustness10 Aug 2026
- 2026Studying quantization trade-offs for efficient inference deployment in machine translation31 Jul 2026
- 2026Two-Stage Multi-Modal Fusion with Adaptive Alignment for Action Quality Assessment8 Jul 2026
- 2026Beyond Literal Translation: Evaluating Cultural Effectiveness in Social Media UGC25 May 2026
- 2026Optimizing Korean-Centric LLMs via Token Pruning17 Apr 2026
- 2026VEPO: Variable Entropy Policy Optimization for Low-Resource Language Foundation Models19 Mar 2026
- 2026From Words to Worlds: Benchmarking Cross-Cultural Cultural Understanding in Machine Translation18 Mar 2026
- 2026Mending the Holes: Mitigating Reward Hacking in Reinforcement Learning for Multilingual Translation13 Mar 2026
- 2026DEEP: Docker-based Execution and Evaluation Platform23 Feb 2026
- 2026GRRM: Group Relative Reward Modeling for Machine Translation15 Feb 2026
9 more
- 2026Shifting the Breaking Point of Flow Matching for Multi-Instance Editing9 Feb 2026
- 2025HY-MT1.5 Technical Report30 Dec 2025
- 2025Fluent Alignment with Disfluent Judges: Post-training for Lower-resource Languages9 Dec 2025
- 2025OmniFusion: Simultaneous Multilingual Multimodal Translations via Modular Fusion28 Nov 2025
- 2025SmolKalam: Ensemble Quality-Filtered Translation at Scale for High Quality Arabic Post-Training Data23 Nov 2025
- 2025Test-Time Scaling of Reasoning Models for Machine Translation7 Oct 2025
- 2025Understanding Post-Training Structural Changes in Large Language Models22 Sep 2025
- 2025Hunyuan-MT Technical Report5 Sep 2025
- 2025GLM-4.5: Agentic, Reasoning, and Coding (ARC) Foundation Models8 Aug 2025
- 2026Optimizing Korean-Centric LLMs via Token Pruningcited by 1
- 2026Optimizing Korean-Centric LLMs via Token Pruning17 Apr 2026
- 2025Hunyuan-MT Technical Reportcited by 7
- 2025Understanding Post-Training Structural Changes in Large Language Modelscited by 2
- 2026Beyond Literal Translation: Evaluating Cultural Effectiveness in Social Media UGCcited by 2
- 2025HY-MT1.5 Technical Reportcited by 1
- 2026Cultivar: A Contrastive and Locale-Oriented Translation Benchmark for Investigating Contamination and Localisation Robustnesscited by 1
- 2026Last Translation Benchmarkcited by 1
- 2025SmolKalam: Ensemble Quality-Filtered Translation at Scale for High Quality Arabic Post-Training Datacited by 0
- 2025OmniFusion: Simultaneous Multilingual Multimodal Translations via Modular Fusioncited by 0
- 2026DEEP: Docker-based Execution and Evaluation Platformcited by 0
- 2026From Words to Worlds: Benchmarking Cross-Cultural Cultural Understanding in Machine Translationcited by 0
- 2026VEPO: Variable Entropy Policy Optimization for Low-Resource Language Foundation Modelscited by 0
- 2026Two-Stage Multi-Modal Fusion with Adaptive Alignment for Action Quality Assessmentcited by 0
12 most cited of 14 All 14 (JSON)
- 2026Drift-Constrained Optimization: Only Direction Matters in Fine-Tuning Instruct Models12 Sep 2026
- 2026Last Translation Benchmark3 Sep 2026
- 2026Cultivar: A Contrastive and Locale-Oriented Translation Benchmark for Investigating Contamination and Localisation Robustness10 Aug 2026
- 2026Studying quantization trade-offs for efficient inference deployment in machine translation31 Jul 2026
- 2026Two-Stage Multi-Modal Fusion with Adaptive Alignment for Action Quality Assessment8 Jul 2026
- 2026Beyond Literal Translation: Evaluating Cultural Effectiveness in Social Media UGC25 May 2026
- 2026VEPO: Variable Entropy Policy Optimization for Low-Resource Language Foundation Models19 Mar 2026
- 2026From Words to Worlds: Benchmarking Cross-Cultural Cultural Understanding in Machine Translation18 Mar 2026
- 2026DEEP: Docker-based Execution and Evaluation Platform23 Feb 2026
- 2025HY-MT1.5 Technical Report30 Dec 2025
- 2025OmniFusion: Simultaneous Multilingual Multimodal Translations via Modular Fusion28 Nov 2025
- 2025SmolKalam: Ensemble Quality-Filtered Translation at Scale for High Quality Arabic Post-Training Data23 Nov 2025
12 newest of 14 All 14 (JSON)
Similar, not cited
Close in wording, no citation either way
- 2025LLaMAX2: Your Translation-Enhanced Model also Performs Well in Reasoning
- 2025The Art of Asking: Multilingual Prompt Optimization for Synthetic Data
- 2025Tower+: Bridging Generality and Translation Specialization in Multilingual LLMs
- 2024FuxiTranyu: A Multilingual Large Language Model Trained with Balanced Data
- 2022Bootstrapping Multilingual Semantic Parsers using Large Language Models
- 2024Refining Translations with LLMs: A Constraint-Aware Iterative Prompting Approach
- 2025Bridging the Linguistic Divide: A Survey on Leveraging Large Language Models for Machine Translation
- 2025MT-R1-Zero: Advancing LLM-based Machine Translation via R1-Zero-like Reinforcement Learning