mlsanityData to 14 Oct 2026

Learning-From-Mistakes Prompting for Indigenous Language Translation

arXiv 2407.13343 ↗First posted 18 Jul 2024cs.CLcited by 2

Not on the map. Why?

Abstract (arXiv)

Using large language models, this paper presents techniques to improve extremely low-resourced indigenous language translations. Our approaches are grounded in the use of (1) the presence of a datastore consisting of a limited number of parallel translation examples, (2) the inherent capabilities of LLMs like GPT-3.5, and (3) a word-level translation dictionary. We harness the potential of LLMs and in-context learning techniques in such a setting for using LLMs as universal translators for extremely low-resourced languages. Our methodology hinges on utilizing LLMs as language compilers for selected language pairs, hypothesizing that they could internalize syntactic structures to facilitate accurate translation. We introduce three techniques: KNNPrompting with Retrieved Prompting Context, Chain-of-Thought Prompting and Learningfrom-Mistakes Prompting, with the last method addressing past errors. The evaluation results suggest that, even with limited corpora, LLMs can effectively translate extremely low-resource languages when paired with proper prompting.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 18 of its 27 references that are in the map. First posted on arXiv 18 Jul 2024.

Builds on

18 of 27 references.

References · 18

  1. 2020Language Models are Few-Shot Learnerscited by 32,419
  2. 2022Training language models to follow instructions with human feedbackcited by 15,971
  3. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
  4. 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,182
  5. 2021The Power of Scale for Parameter-Efficient Prompt Tuningcited by 3,795
  6. 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,780
  7. 2021Cross-Task Generalization via Natural Language Crowdsourcing Instructionscited by 699
  8. 2023MEGA: Multilingual Evaluation of Generative AIcited by 293
  9. 2023ToolQA: A Dataset for LLM Question Answering with External Toolscited by 274
  10. 2023GPT4Tools: Teaching Large Language Model to Use Tools via Self-instructioncited by 248
  11. 2022In-context Examples Selection for Machine Translationcited by 172
  12. 2023Hallucinations in Large Multilingual Translation Modelscited by 129
6 more
  1. 2018Universal Neural Machine Translation for Extremely Low Resource Languagescited by 66
  2. 2023kNN Prompting: Beyond-Context Learning with Calibration-Free Nearest Neighbor Inferencecited by 47
  3. 2023Democratizing LLMs for Low-Resource Languages by Leveraging their English Dominant Abilities with Linguistically-Diverse Promptscited by 45
  4. 2022Privately Fine-Tuning Large Language Models with Differential Privacycited by 39
  5. 2023MultiTool-CoT: GPT-3 Can Use Multiple External Tools with Chain of Thought Promptingcited by 27
  6. 2022Selecting Better Samples from Pre-trained LLMs: A Case Study on Question Generationcited by 17

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 2.

2 papers.

  1. 2026FVRuleLearner: Operator-Level Reasoning Tree (Op-Tree)-Based Rules Learning for Formal Verificationcited by 1
  2. 2026A Komi-Yazva--Russian Parallel Corpus and Evaluation Protocol for Zero- and Few-Shot LLM Translationcited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2024Low-Resource Machine Translation through Retrieval-Augmented LLM Prompting: A Study on the Mambai Language
  2. 2024What do Large Language Models Need for Machine Translation Evaluation?
  3. 2024Refining Translations with LLMs: A Constraint-Aware Iterative Prompting Approach
  4. 2024Towards Neural No-Resource Language Translation: A Comparative Evaluation of Approaches
  5. 2025Compensating for Data with Reasoning: Low-Resource Machine Translation with LLMs
  6. 2025How and Where to Translate? The Impact of Translation Strategies in Cross-lingual LLM Prompting
  7. 2025Is Small Language Model the Silver Bullet to Low-Resource Languages Machine Translation?
  8. 2026From Script to Semantics: Prompting Strategies for African NLI