mlsanityData to 14 Oct 2026

BigTranslate: Augmenting Large Language Models with Multilingual Translation Capability over 100 Languages

arXiv 2305.18098 ↗First posted 29 May 2023cs.CLcited by 60

Not on the map. Why?

Abstract (arXiv)

Large language models (LLMs) demonstrate promising translation performance among various natural languages. However, many LLMs especially the open-sourced ones, such as BLOOM and LLaMA, are English-dominant and support only dozens of natural languages, making the potential of LLMs on language translation less explored. In this work, we present BigTranslate which adapts LLaMA that covers only 20 languages and enhances it with multilingual translation capability on more than 100 languages. BigTranslate is built upon LLaMA-13B and it is optimized in three steps. First, we continue training LLaMA with massive Chinese monolingual data. Second, we continue training the model with a large-scale parallel dataset that covers 102 natural languages. Third, we instruct-tune the foundation model with multilingual translation instructions, leading to our BigTranslate model. The preliminary experiments on multilingual translation show that BigTranslate performs comparably with ChatGPT and Google Translate in many languages and even outperforms ChatGPT in 8 language pairs. We release the BigTranslate model and hope it can advance the research progress.

Key facts. Cited by 60 papers in the map (data through 14 Oct 2026). Builds on 34 of its 42 references that are in the map. First posted on arXiv 29 May 2023.

Builds on

34 of 42 references.

References · 34

  1. 2020Language Models are Few-Shot Learnerscited by 32,419
  2. 2023GPT-4 Technical Reportcited by 18,396
  3. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
  4. 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,326
  5. 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,780
  6. 2022FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awarenesscited by 3,673
  7. 2022OPT: Open Pre-trained Transformer Language Modelscited by 3,512
  8. 2022Training Compute-Optimal Large Language Modelscited by 3,019
  9. 2015Neural Machine Translation of Rare Words with Subword Unitscited by 2,918
  10. 2023G-Eval: NLG Evaluation using GPT-4 with Better Human Alignmentcited by 2,276
  11. 2018SentencePiece: A simple and language independent subword tokenizer and detokenizer for Neural Text Processingcited by 1,989
  12. 2022BLOOM: A 176B-Parameter Open-Access Multilingual Language Modelcited by 1,984
22 more
  1. 2021Multitask Prompted Training Enables Zero-Shot Task Generalizationcited by 1,470
  2. 2022No Language Left Behind: Scaling Human-Centered Machine Translationcited by 1,312
  3. 2023PaLM 2 Technical Reportcited by 1,162
  4. 2021GLM: General Language Model Pretraining with Autoregressive Blank Infillingcited by 1,031
  5. 2016Training Deep Nets with Sublinear Memory Costcited by 848
  6. 2022GLM-130B: An Open Bilingual Pre-trained Modelcited by 843
  7. 2022Galactica: A Large Language Model for Sciencecited by 744
  8. 2021Cross-Task Generalization via Natural Language Crowdsourcing Instructionscited by 699
  9. 2016Google's Multilingual Neural Machine Translation System: Enabling Zero-Shot Translationcited by 469
  10. 2023How Good Are GPT Models at Machine Translation? A Comprehensive Evaluationcited by 348
  11. 2023Efficient and Effective Text Encoding for Chinese LLaMA and Alpacacited by 305
  12. 2020CLUE: A Chinese Language Understanding Evaluation Benchmarkcited by 278
  13. 2020Improving Massively Multilingual Neural Machine Translation and Zero-Shot Translationcited by 277
  14. 2023Is ChatGPT A Good Translator? Yes With GPT-4 As The Enginecited by 176
  15. 2023Multilingual Machine Translation with Large Language Models: Empirical Results and Analysiscited by 160
  16. 2023Document-Level Machine Translation with Large Language Modelscited by 90
  17. 2023Investigating the Translation Performance of a Large Multilingual Language Model: the Case of BLOOMcited by 59
  18. 2021Learning Language Specific Sub-network for Multilingual Machine Translationcited by 48
  19. 2021Importance-based Neuron Allocation for Multilingual Neural Machine Translationcited by 23
  20. 2021Distributionally Robust Multilingual Machine Translationcited by 18
  21. 2021Parameter Differentiation based Multilingual Neural Machine Translationcited by 5
  22. 2022Unifying the Convergences in Multilingual Neural Machine Translationcited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2023: 4; 2024: 31; 2025: 23; 2026: 2.

60 papers.

Sort:

By area:

  1. 2024A Survey on Data Synthesis and Augmentation for Large Language Modelscited by 41
  2. 2024TEaR: Improving LLM-based Machine Translation with Systematic Self-Refinementcited by 39
  3. 2024Enhancing Multilingual Capabilities of Large Language Models through Self-Distillation from Resource-Rich Languagescited by 36
  4. 2023Empowering Cross-lingual Abilities of Instruction-tuned Large Language Models by Translation-following demonstrationscited by 35
  5. 2024SelectIT: Selective Instruction Tuning for LLMs via Uncertainty-Aware Self-Reflectioncited by 34
  6. 2024Multilingual Pretraining and Instruction Tuning Improve Cross-Lingual Knowledge Alignment, But Only Shallowlycited by 27
  7. 2024The Fine-Tuning Paradox: Boosting Translation Quality Without Sacrificing LLM Abilitiescited by 22
  8. 2024Generative AI Misuse: A Taxonomy of Tactics and Insights from Real-World Datacited by 20
  9. 2024Multilingual Large Language Models: A Systematic Surveycited by 18
  10. 2025AdaMCoT: Rethinking Cross-Lingual Factual Reasoning through Adaptive Multilingual Chain-of-Thoughtcited by 14
  11. 2024Enhancing Document-level Translation of Large Language Model via Translation Mixed-instructionscited by 13
  12. 2024Advancing Translation Preference Modeling with RLHF: A Step Towards Cost-Effective Solutioncited by 13
38 more
  1. 2024mEdIT: Multilingual Text Editing via Instruction Tuningcited by 13
  2. 2024Quality or Quantity? On Data Scale and Diversity in Adapting Large Language Models for Low-Resource Translationcited by 13
  3. 2025LLMs can be easily Confused by Instructional Distractionscited by 13
  4. 2024Ladder: A Model-Agnostic Framework Boosting LLM-based Machine Translation to the Next Levelcited by 12
  5. 2025An Efficient and Precise Training Data Construction Framework for Process-supervised Reward Model in Mathematical Reasoningcited by 12
  6. 2025TokAlign: Efficient Vocabulary Adaptation via Token Alignmentcited by 11
  7. 2024Aurora-M: Open Source Continual Pre-training for Multilingual Language and Codecited by 10
  8. 2023Simultaneous Machine Translation with Large Language Modelscited by 9
  9. 2025Implicit Cross-Lingual Rewarding for Efficient Multilingual Preference Alignmentcited by 9
  10. 2025SinLlama -- A Large Language Model for Sinhalacited by 9
  11. 2025Just Go Parallel: Improving the Multilingual Capabilities of Large Language Modelscited by 8
  12. 2024FASST: Fast LLM-based Simultaneous Speech Translationcited by 7
  13. 2023Data Optimization in Deep Learning: A Surveycited by 6
  14. 2024How Multilingual Are Large Language Models Fine-Tuned for Translation?cited by 6
  15. 2024Not All Languages are Equal: Insights into Multilingual Retrieval-Augmented Generationcited by 6
  16. 2024Beyond Data Quantity: Key Factors Driving Performance in Multilingual Language Modelscited by 6
  17. 2025AlignX: Advancing Multilingual Large Language Models with Multilingual Representation Alignmentcited by 6
  18. 2023On-the-Fly Fusion of Large Language Models and Machine Translationcited by 5
  19. 2024Towards Boosting Many-to-Many Multilingual Machine Translation with Large Language Modelscited by 5
  20. 2024Context-aware and Style-related Incremental Decoding framework for Discourse-Level Literary Translationcited by 5
  21. 2025Trust at Your Own Peril: A Mixed Methods Exploration of the Ability of Large Language Models to Generate Expert-Like Systems Engineering Artifacts and a Characterization of Failure Modescited by 5
  22. 2025Group then Scale: Dynamic Mixture-of-Experts Multilingual Language Modelcited by 5
  23. 2025Improving MLLM's Document Image Machine Translation via Synchronously Self-reviewing Its OCR Proficiencycited by 5
  24. 2024Is It Good Data for Multilingual Instruction Tuning or Just Bad Multilingual Evaluation for Large Language Models?cited by 4
  25. 2024Choose the Final Translation from NMT and LLM hypotheses Using MBR Decoding: HW-TSC's Submission to the WMT24 General MT Shared Taskcited by 4
  26. 2025Understanding LLMs' Cross-Lingual Context Retrieval: How Good It Is And Where It Comes Fromcited by 4
  27. 2024Language Modelling Approaches to Adaptive Machine Translationcited by 3
  28. 2024Thinker-DDM: Modeling Deliberation for Machine Translation with a Drift-Diffusion Processcited by 3
  29. 2024A Novel Paradigm Boosting Translation Capabilities of Large Language Modelscited by 3
  30. 2024XKV: Personalized KV Cache Memory Reduction for Long-Context LLM Inferencecited by 3
  31. 2025CRPO: Confidence-Reward Driven Preference Optimization for Machine Translationcited by 3
  32. 2025Text2Cypher Across Languages: Evaluating and Finetuning LLMscited by 3
  33. 2024Investigating the translation capabilities of Large Language Models trained on parallel data onlycited by 2
  34. 2024Towards Chapter-to-Chapter Context-Aware Literary Translation via Large Language Modelscited by 2
  35. 2024Sing it, Narrate it: Quality Musical Lyrics Translationcited by 2
  36. 2025Mutarjim: Advancing Bidirectional Arabic-English Translation with a Small Language Modelcited by 2
  37. 2025Translate With Care: Addressing Gender Bias, Neutrality, and Reasoning in Large Language Model Translationscited by 2
  38. 2025Semantic Pivots Enable Cross-Lingual Transfer in Large Language Modelscited by 1

50 most cited of 60 All 60 (JSON)