mlsanityData to 7 Oct 2026

From LLM to NMT: Advancing Low-Resource Machine Translation with Claude

arXiv 2404.13813 ↗First posted 22 Apr 2024cs.CL cs.AIcited by 57

Not on the map. Why?

Abstract (arXiv)

We show that Claude 3 Opus, a large language model (LLM) released by Anthropic in March 2024, exhibits stronger machine translation competence than other LLMs. Though we find evidence of data contamination with Claude on FLORES-200, we curate new benchmarks that corroborate the effectiveness of Claude for low-resource machine translation into English. We find that Claude has remarkable textitresource efficiency -- the degree to which the quality of the translation model depends on a language pair's resource level. Finally, we show that advancements in LLM translation can be compressed into traditional neural machine translation (NMT) models. Using Claude to generate synthetic data, we demonstrate that knowledge distillation advances the state-of-the-art in Yoruba-English translation, meeting or surpassing strong baselines like NLLB-54B and Google Translate.

Key facts. Cited by 57 papers in the map (data through 7 Oct 2026). Builds on 17 of its 34 references that are in the map. First posted on arXiv 22 Apr 2024.

Builds on

17 of 34 references.

References · 17

  1. 2020Language Models are Few-Shot Learnerscited by 32,199
  2. 2023GPT-4 Technical Reportcited by 18,132
  3. 2015Distilling the Knowledge in a Neural Networkcited by 10,076
  4. 2020Scaling Laws for Neural Language Modelscited by 6,411
  5. 2022No Language Left Behind: Scaling Human-Centered Machine Translationcited by 1,290
  6. 2020COMET: A Neural Framework for MT Evaluationcited by 1,024
  7. 2016Sequence-Level Knowledge Distillationcited by 761
  8. 2021The FLORES-101 Evaluation Benchmark for Low-Resource and Multilingual Machine Translationcited by 556
  9. 2019On the Efficacy of Knowledge Distillationcited by 377
  10. 2023NLP Evaluation in trouble: On the Need to Measure LLM Data Contamination for each Benchmarkcited by 339
  11. 2023Prompting Large Language Model for Machine Translation: A Case Studycited by 247
  12. 2023Large language models effectively leverage document-level context for literary translation, but critical errors persistcited by 80
5 more
  1. 2019The FLoRes Evaluation Datasets for Low-Resource Machine Translation: Nepali-English and Sinhala-Englishcited by 61
  2. 2021The Effect of Domain and Diacritics in Yor`ub'a-English Neural Machine Translationcited by 38
  3. 2022Memory-efficient NLLB-200: Language-specific Expert Pruning of a Massively Multilingual Machine Translation Modelcited by 36
  4. 2024MT-PATCHER: Selective and Extendable Knowledge Distillation from Large Language Models for Machine Translationcited by 10
  5. 2020MASRI-HEADSET: A Maltese Corpus for Speech Recognitioncited by 4

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 24; 2025: 24; 2026: 9.

57 papers.

Sort:

By area:

  1. 2024TimeMarker: A Versatile Video-LLM for Long and Short Video Understanding with Superior Temporal Localization Abilitycited by 69
  2. 2024Decision-Making Behavior Evaluation Framework for LLMs under Uncertain Contextcited by 41
  3. 2024MatryoshkaKV: Adaptive KV Compression via Trainable Orthogonal Projectioncited by 29
  4. 2024NADI 2024: The Fifth Nuanced Arabic Dialect Identification Shared Taskcited by 23
  5. 2024Data Contamination Report from the 2024 CONDA Shared Taskcited by 19
  6. 2025Scaling Low-Resource MT via Synthetic Data Generation with LLMscited by 14
  7. 2025Compositional Translation: A Novel LLM-based Approach for Low-resource Machine Translationcited by 13
  8. 2024Graph-based Unsupervised Disentangled Representation Learning via Multimodal Large Language Modelscited by 9
  9. 2024Benchmarking GPT-4 against Human Translators: A Comprehensive Evaluation Across Languages, Domains, and Expertise Levelscited by 9
  10. 2024Geneverse: A collection of Open-source Multimodal Large Language Models for Genomic and Proteomic Researchcited by 8
  11. 2025Evaluating Mathematical Reasoning Across Large Language Models: A Fine-Grained Approachcited by 8
  12. 2025LogicCat: A Chain-of-Thought Text-to-SQL Benchmark for Complex Reasoningcited by 7
38 more
  1. 2024Multi-Document Financial Question Answering using LLMscited by 6
  2. 2024Cross-Lingual and Cross-Cultural Variation in Image Descriptionscited by 5
  3. 2025Truth Knows No Language: Evaluating Truthfulness Beyond Englishcited by 5
  4. 2025Dysfluent WFST: A Framework for Zero-Shot Speech Dysfluency Transcription and Detectioncited by 5
  5. 2025EvoEmpirBench: Dynamic Spatial Reasoning with Agent-ExpVercited by 5
  6. 2024What talking you?: Translating Code-Mixed Messaging Texts to Englishcited by 4
  7. 2024Mufu: Multilingual Fused Learning for Low-Resource Translation with LLMcited by 3
  8. 2024DiDOTS: Knowledge Distillation from Large-Language-Models for Dementia Obfuscation in Transcribed Speechcited by 3
  9. 2024Seed-Free Synthetic Data Generation Framework for Instruction-Tuning LLMs: A Case Study in Thaicited by 3
  10. 2025"See the World, Discover Knowledge": A Chinese Factuality Evaluation for Large Vision Language Modelscited by 3
  11. 2024Towards Large Language Model Aided Program Refinementcited by 2
  12. 2024Towards Robust Knowledge Representations in Multilingual LLMs for Equivalence and Inheritance based Consistent Reasoningcited by 2
  13. 2024Critique of Impure Reason: Unveiling the reasoning behaviour of medical Large Language Modelscited by 2
  14. 2024Exploiting Domain-Specific Parallel Data on Multilingual Language Models for Low-resource Language Translationcited by 2
  15. 2025Decoding Machine Translationese in English-Chinese News: LLMs vs. NMTscited by 2
  16. 2025Astrolabe: Balancing Load in LLM Serving with Randomized Prediction-Guided Schedulingcited by 2
  17. 2026Hermes the Polyglot: A Unified Framework to Enhance Expressiveness for Multimodal Interlingual Subtitlingcited by 2
  18. 2024Efficient Technical Term Translation: A Knowledge Distillation Approach for Parenthetical Terminology Translationcited by 1
  19. 2025Toxicity-Aware Few-Shot Prompting for Low-Resource Singlish Translationcited by 1
  20. 2025SHAMI-MT: A Syrian Arabic Dialect to Modern Standard Arabic Bidirectional Machine Translation Systemcited by 1
  21. 2025TopXGen: Topic-Diverse Parallel Data Generation for Low-Resource Machine Translationcited by 1
  22. 2025OpenWHO: A Document-Level Parallel Corpus for Health Translation in Low-Resource Languagescited by 1
  23. 2025Can Federated Learning Safeguard Private Data in LLM Training? Vulnerabilities, Attacks, and Defense Evaluationcited by 1
  24. 2025Prompt-Guided Spatial Understanding with RGB-D Transformers for Fine-Grained Object Relation Reasoningcited by 1
  25. 2025The Structural Scalpel: Automated Contiguous Layer Pruning for Large Language Modelscited by 1
  26. 2025A Representation Sharpening Framework for Zero Shot Dense Retrievalcited by 1
  27. 2025GeoDiT: A Diffusion-based Vision-Language Model for Geospatial Understandingcited by 1
  28. 2026From Utterance to Vividity: Training Expressive Subtitle Translation LLM via Adaptive Local Preference Optimizationcited by 1
  29. 2026GeoFocus: Blending Efficient Global-to-Local Perception for Multimodal Geometry Problem-Solvingcited by 1
  30. 2026MERIT: Multilingual Expert-Reward Informed Tuning for Chinese-Centric Low-Resource Machine Translationcited by 1
  31. 2026Grammar Engineering Meets LLMs: Development of Cantonese and Irish ParGram Treebankscited by 1
  32. 2024Language Models Learn Metadata: Political Stance Detection Case Studycited by 0
  33. 2024BridG MT: Enhancing LLMs' Machine Translation Capabilities with Sentence Bridging and Gradual MTcited by 0
  34. 2024SandboxAQ's submission to MRL 2024 Shared Task on Multi-lingual Multi-task Information Retrievalcited by 0
  35. 2024Multilingual LLMs Inherently Reward In-Language Time-Sensitive Semantic Alignment for Low-Resource Languagescited by 0
  36. 2024Future Research Avenues for Artificial Intelligence in Digital Gaming: An Exploratory Reportcited by 0
  37. 2025Empirical evaluation of LLMs in predicting fixes of Configuration bugs in Smart Home Systemcited by 0
  38. 2025Beyond the Sentence: A Survey on Context-Aware Machine Translation with Large Language Modelscited by 0

50 most cited of 57 All 57 (JSON)