mlsanityData to 7 Oct 2026

Seed-X: Building Strong Multilingual Translation LLM with 7B Parameters

arXiv 2507.13618 ↗First posted 18 Jul 2025cs.CL cs.AIcited by 21

Not on the map. Why?

Abstract (arXiv)

Multilingual translation stands as a challenging task for large language models (LLMs) to handle intricate language patterns and stilted translations that arise in automated translations. In this paper, we introduce Seed-X, a family of open-source LLMs comprising instruct and reasoning models, pushing the limits of translation capability with 7B parameter size. The base model is pre-trained on a diverse, high-quality dataset encompassing both monolingual and bilingual content across 28 languages, harnessing the full potential of multilingual data. The instruct model is then finetuned to translate by Chain-of-Thought (CoT) reasoning and further enhanced through reinforcement learning (RL) to achieve better generalization across diverse language pairs. Seed-X achieves performance comparable to leading closed-source models, including Gemini-2.5 and GPT-4o, across 28 languages, and significantly outperforms larger open-source models in both automatic metrics and human evaluations. We share the best practices through our optimization process, and make the parameter public available for advancing translation research and applications.

Key facts. Cited by 21 papers in the map (data through 7 Oct 2026). Builds on 40 of its 56 references that are in the map. First posted on arXiv 18 Jul 2025.

Builds on

40 of 56 references.

References · 40

  1. 2017Attention Is All You Needcited by 59,932
  2. 2017Proximal Policy Optimization Algorithmscited by 14,441
  3. 2024The Llama 3 Herd of Modelscited by 14,192
  4. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
  5. 2020Measuring Massive Multitask Language Understandingcited by 7,768
  6. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
  7. 2024Qwen2.5 Technical Reportcited by 4,713
  8. 2018Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challengecited by 4,710
  9. 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,581
  10. 2023Mistral 7Bcited by 3,065
  11. 2015Neural Machine Translation of Rare Words with Subword Unitscited by 2,898
  12. 2023Code Llama: Open Foundation Models for Codecited by 2,105
28 more
  1. 2016Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translationcited by 1,471
  2. 2020BLEURT: Learning Robust Metrics for Text Generationcited by 1,196
  3. 2020COMET: A Neural Framework for MT Evaluationcited by 1,024
  4. 2023WizardCoder: Empowering Code Large Language Models with Evol-Instructcited by 728
  5. 2024DeepSeek LLM: Scaling Open-Source Language Models with Longtermismcited by 621
  6. 2021The FLORES-101 Evaluation Benchmark for Low-Resource and Multilingual Machine Translationcited by 556
  7. 2023MAmmoTH: Building Math Generalist Models through Hybrid Instruction Tuningcited by 483
  8. 2023Scaling Relationship on Learning Mathematical Reasoning with Large Language Modelscited by 417
  9. 2024Contrastive Preference Optimization: Pushing the Boundaries of LLM Performance in Machine Translationcited by 390
  10. 2020XCOPA: A Multilingual Dataset for Causal Commonsense Reasoningcited by 330
  11. 2021Few-shot Learning with Multilingual Language Modelscited by 278
  12. 2019PAWS-X: A Cross-lingual Adversarial Dataset for Paraphrase Identificationcited by 262
  13. 2023xCOMET: Transparent Machine Translation Evaluation through Fine-grained Error Detectioncited by 260
  14. 2023Is ChatGPT A Good Translator? Yes With GPT-4 As The Enginecited by 172
  15. 2023Multilingual Machine Translation with Large Language Models: Empirical Results and Analysiscited by 156
  16. 2023MathCoder: Seamless Code Integration in LLMs for Enhanced Mathematical Reasoningcited by 155
  17. 2024How do Large Language Models Handle Multilingualism?cited by 148
  18. 2023A Survey of Large Language Models in Medicine: Progress, Application, and Challengecited by 123
  19. 2023The unreasonable effectiveness of few-shot learning for machine translationcited by 91
  20. 2023A Paradigm Shift in Machine Translation: Boosting Translation Performance of Large Language Modelscited by 88
  21. 2023SAILER: Structure-aware Pre-trained Language Model for Legal Case Retrievalcited by 61
  22. 2023Eliciting the Translation Ability of Large Language Models via Multilingual Finetuning with Translation Instructionscited by 55
  23. 2024LLaMAX: Scaling Linguistic Horizons of LLM by Enhancing Translation Capabilities Beyond 100 Languagescited by 47
  24. 2021Language Tags Matter for Zero-Shot Neural Machine Translationcited by 29
  25. 2024G-DIG: Towards Gradient-based Diverse and High-quality Instruction Data Selection for Machine Translationcited by 29
  26. 2024Salute the Classic: Revisiting Challenges of Machine Translation in the Age of Large Language Modelscited by 17
  27. 2024Large Language Models as Agents in Two-Player Gamescited by 10
  28. 2025Trans-Zero: Self-Play Incentivizes Large Language Models for Multilingual Translation Without Parallel Datacited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 8; 2026: 13.

21 papers.

Sort:

By area:

  1. 2025GLM-4.5: Agentic, Reasoning, and Coding (ARC) Foundation Modelscited by 446
  2. 2025Hunyuan-MT Technical Reportcited by 7
  3. 2025Test-Time Scaling of Reasoning Models for Machine Translationcited by 5
  4. 2026Mending the Holes: Mitigating Reward Hacking in Reinforcement Learning for Multilingual Translationcited by 3
  5. 2025Understanding Post-Training Structural Changes in Large Language Modelscited by 2
  6. 2026GRRM: Group Relative Reward Modeling for Machine Translationcited by 2
  7. 2026Beyond Literal Translation: Evaluating Cultural Effectiveness in Social Media UGCcited by 2
  8. 2025HY-MT1.5 Technical Reportcited by 1
  9. 2026Shifting the Breaking Point of Flow Matching for Multi-Instance Editingcited by 1
  10. 2026Optimizing Korean-Centric LLMs via Token Pruningcited by 1
  11. 2026Cultivar: A Contrastive and Locale-Oriented Translation Benchmark for Investigating Contamination and Localisation Robustnesscited by 1
  12. 2026Last Translation Benchmarkcited by 1
9 more
  1. 2025SmolKalam: Ensemble Quality-Filtered Translation at Scale for High Quality Arabic Post-Training Datacited by 0
  2. 2025OmniFusion: Simultaneous Multilingual Multimodal Translations via Modular Fusioncited by 0
  3. 2025Fluent Alignment with Disfluent Judges: Post-training for Lower-resource Languagescited by 0
  4. 2026DEEP: Docker-based Execution and Evaluation Platformcited by 0
  5. 2026From Words to Worlds: Benchmarking Cross-Cultural Cultural Understanding in Machine Translationcited by 0
  6. 2026VEPO: Variable Entropy Policy Optimization for Low-Resource Language Foundation Modelscited by 0
  7. 2026Two-Stage Multi-Modal Fusion with Adaptive Alignment for Action Quality Assessmentcited by 0
  8. 2026Studying quantization trade-offs for efficient inference deployment in machine translationcited by 0
  9. 2026Drift-Constrained Optimization: Only Direction Matters in Fine-Tuning Instruct Modelscited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2025LLaMAX2: Your Translation-Enhanced Model also Performs Well in Reasoning
  2. 2025The Art of Asking: Multilingual Prompt Optimization for Synthetic Data
  3. 2025Tower+: Bridging Generality and Translation Specialization in Multilingual LLMs
  4. 2024FuxiTranyu: A Multilingual Large Language Model Trained with Balanced Data
  5. 2022Bootstrapping Multilingual Semantic Parsers using Large Language Models
  6. 2024Refining Translations with LLMs: A Constraint-Aware Iterative Prompting Approach
  7. 2025Bridging the Linguistic Divide: A Survey on Leveraging Large Language Models for Machine Translation
  8. 2025MT-R1-Zero: Advancing LLM-based Machine Translation via R1-Zero-like Reinforcement Learning