mlsanityData to 7 Oct 2026

Investigating the Translation Performance of a Large Multilingual Language Model: the Case of BLOOM

arXiv 2303.01911 ↗First posted 3 Mar 2023cs.CLcited by 58

Not on the map. Why?

Abstract (arXiv)

The NLP community recently saw the release of a new large open-access multilingual language model, BLOOM (BigScience et al., 2022) covering 46 languages. We focus on BLOOM's multilingual ability by evaluating its machine translation performance across several datasets (WMT, Flores-101 and DiaBLa) and language pairs (high- and low-resourced). Our results show that 0-shot performance suffers from overgeneration and generating in the wrong language, but this is greatly improved in the few-shot setting, with very good results for a number of language pairs. We study several aspects including prompt design, model sizes, cross-lingual transfer and the use of discursive context.

Key facts. Cited by 58 papers in the map (data through 7 Oct 2026). Builds on 39 of its 61 references that are in the map. First posted on arXiv 3 Mar 2023.

Builds on

39 of 61 references.

References · 39

  1. 2020Language Models are Few-Shot Learnerscited by 32,199
  2. 2022Training language models to follow instructions with human feedbackcited by 15,712
  3. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  4. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  5. 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,304
  6. 2021The Power of Scale for Parameter-Efficient Prompt Tuningcited by 3,769
  7. 2022OPT: Open Pre-trained Transformer Language Modelscited by 3,464
  8. 2021Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processingcited by 2,222
  9. 2022BLOOM: A 176B-Parameter Open-Access Multilingual Language Modelcited by 1,968
  10. 2019Language Models as Knowledge Bases?cited by 1,922
  11. 2018A Call for Clarity in Reporting BLEU Scorescited by 1,790
  12. 2021Multitask Prompted Training Enables Zero-Shot Task Generalizationcited by 1,462
27 more
  1. 2022No Language Left Behind: Scaling Human-Centered Machine Translationcited by 1,290
  2. 2020COMET: A Neural Framework for MT Evaluationcited by 1,024
  3. 2016Bag of Tricks for Efficient Text Classificationcited by 869
  4. 2022GLM-130B: An Open Bilingual Pre-trained Modelcited by 837
  5. 2020It's Not Just Size That Matters: Small Language Models Are Also Few-Shot Learnerscited by 668
  6. 2020Beyond English-Centric Multilingual Machine Translationcited by 559
  7. 2021The FLORES-101 Evaluation Benchmark for Low-Resource and Multilingual Machine Translationcited by 556
  8. 2023How Good Are GPT Models at Machine Translation? A Comprehensive Evaluationcited by 344
  9. 2022PromptSource: An Integrated Development Environment and Repository for Natural Language Promptscited by 288
  10. 2021Few-shot Learning with Multilingual Language Modelscited by 278
  11. 2023Prompting Large Language Model for Machine Translation: A Case Studycited by 247
  12. 2018The Natural Language Decathlon: Multitask Learning as Question Answeringcited by 235
  13. 2022Prompting PaLM for Translation: Assessing Strategies and Performancecited by 144
  14. 2016Multi-Way, Multilingual Neural Machine Translation with a Shared Attention Mechanismcited by 117
  15. 2018Context-Aware Neural Machine Translation Learns Anaphora Resolutioncited by 97
  16. 2015Multi-task Sequence to Sequence Learningcited by 94
  17. 2023The unreasonable effectiveness of few-shot learning for machine translationcited by 91
  18. 2022Language Contamination Helps Explain the Cross-lingual Capabilities of English Pretrained Modelscited by 90
  19. 2017Evaluating Discourse Phenomena in Neural Machine Translationcited by 87
  20. 2022Building Machine Translation Systems for the Next Thousand Languagescited by 69
  21. 2018Attaining the Unattainable? Reassessing Claims of Human Parity in Neural Machine Translationcited by 58
  22. 2023Adaptive Machine Translation with Large Language Modelscited by 58
  23. 2022AlexaTM 20B: Few-Shot Learning Using a Large-Scale Multilingual Seq2Seq Modelcited by 57
  24. 2020PALM: Pre-training an Autoencoding&Autoregressive Language Model for Context-conditioned Generationcited by 42
  25. 2017Attention Strategies for Multi-Source Sequence-to-Sequence Learningcited by 32
  26. 2022Using natural language prompts for machine translationcited by 27
  27. 2019DiaBLa: A Corpus of Bilingual Spontaneous Written Dialogues for Machine Translationcited by 12

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 16; 2024: 22; 2025: 13; 2026: 7.

58 papers.

Sort:

By area:

  1. 2024Lessons from the Trenches on Reproducible Evaluation of Language Modelscited by 172
  2. 2023Multilingual Machine Translation with Large Language Models: Empirical Results and Analysiscited by 156
  3. 2023Hallucinations in Large Multilingual Translation Modelscited by 126
  4. 2023Cognitive Mirage: A Review of Hallucinations in Large Language Modelscited by 83
  5. 2023BigTranslate: Augmenting Large Language Models with Multilingual Translation Capability over 100 Languagescited by 60
  6. 2023Steering Large Language Models for Machine Translation with Finetuning and In-Context Learningcited by 48
  7. 2023Exploring Human-Like Translation Strategy with Large Language Modelscited by 44
  8. 2023Mitigating Hallucinations and Off-target Machine Translation with Source-Contrastive and Language-Contrastive Decodingcited by 42
  9. 2023Turning English-centric LLMs Into Polyglots: How Much Multilinguality Is Needed?cited by 39
  10. 2024Improving Machine Translation with Human Feedback: An Exploration of Quality Estimation as a Reward Modelcited by 33
  11. 2024Guiding Large Language Models to Post-Edit Machine Translation with Error Annotationscited by 22
  12. 2025Beyond English: The Impact of Prompt Translation Strategies across Languages and Tasks in Multilingual LLMscited by 22
38 more
  1. 2024In-Context Example Selection via Similarity Search Improves Low-Resource Machine Translationcited by 21
  2. 2024Unlocking Memorization in Large Language Models with Dynamic Soft Promptingcited by 21
  3. 2024Comparing Hallucination Detection Metrics for Multilingual Generationcited by 18
  4. 2024Mitigating the Language Mismatch and Repetition Issues in LLM-based Machine Translation via Model Editingcited by 18
  5. 2023Domain Terminology Integration into Machine Translation: Leveraging Large Language Modelscited by 17
  6. 2024Don't Rank, Combine! Combining Machine Translation Hypotheses Using Quality Estimationcited by 13
  7. 2025Compositional Translation: A Novel LLM-based Approach for Low-resource Machine Translationcited by 13
  8. 2024The power of Prompts: Evaluating and Mitigating Gender Bias in MT with LLMscited by 12
  9. 2024Prefix Text as a Yarn: Eliciting Non-English Alignment in Foundation Language Modelcited by 10
  10. 2024A Preference-driven Paradigm for Enhanced Translation with Large Language Modelscited by 9
  11. 2023Neural Machine Translation Models Can Learn to be Few-shot Learnerscited by 8
  12. 2025Bridging the Linguistic Divide: A Survey on Leveraging Large Language Models for Machine Translationcited by 8
  13. 2024Retrieving Examples from Memory for Retrieval Augmented Neural Machine Translation: A Systematic Comparisoncited by 7
  14. 2023Perturbation-based QE: An Explainable, Unsupervised Word-level Quality Estimation Method for Blackbox Machine Translationcited by 6
  15. 2023Insights into Classifying and Mitigating LLMs' Hallucinationscited by 6
  16. 2024How Multilingual Are Large Language Models Fine-Tuned for Translation?cited by 6
  17. 2025Hearing to Translate: The Effectiveness of Speech Modality Integration into LLMscited by 6
  18. 2023Split and Rephrase with Large Language Modelscited by 5
  19. 2024Instruction-tuned Large Language Models for Machine Translation in the Medical Domaincited by 4
  20. 2024Choose the Final Translation from NMT and LLM hypotheses Using MBR Decoding: HW-TSC's Submission to the WMT24 General MT Shared Taskcited by 4
  21. 2023Gender-specific Machine Translation with Large Language Modelscited by 3
  22. 2024Aligning Translation-Specific Understanding to General Understanding in Large Language Modelscited by 3
  23. 2024Language Modelling Approaches to Adaptive Machine Translationcited by 3
  24. 2025FilBench: Can LLMs Understand and Generate Filipino?cited by 3
  25. 2023Translate to Disambiguate: Zero-shot Multilingual Word Sense Disambiguation with Pretrained Language Modelscited by 2
  26. 2023Dissecting In-Context Learning of Translations in GPTscited by 2
  27. 2024On Creating an English-Thai Code-switched Machine Translation in Medical Domaincited by 2
  28. 2025Conditioning LLMs to Generate Code-Switched Textcited by 2
  29. 2025Compensating for Data with Reasoning: Low-Resource Machine Translation with LLMscited by 2
  30. 2025Prompting LLMs: Length Control for Isometric Machine Translationcited by 2
  31. 2025How Important is `Perfect' English for Machine Translation Prompts?cited by 2
  32. 2024Relay Decoding: Concatenating Large Language Models for Machine Translationcited by 1
  33. 2024A Comparative Study of Translation Bias and Accuracy in Multilingual Large Language Models for Cross-Language Claim Verificationcited by 1
  34. 2025How does a Multilingual LM Handle Multiple Languages?cited by 1
  35. 2026Beyond Many-Shot Translation: Scaling In-Context Demonstrations For Low-Resource Machine Translationcited by 1
  36. 2026Translation Asymmetry in LLMs as a Data Augmentation Factor: A Case Study for 6 Romansh Language Varietiescited by 1
  37. 2026Polite on the Surface, Broken in Practice: A Curated Dataset for Fixing Generation and Register Failures in Low-Resource Bangla Text Generationcited by 1
  38. 2026Which Tokens Need Context? A Reference-Based Analysis of Translation Responsibility Using Fertility and Entropycited by 1

50 most cited of 58 All 58 (JSON)