mlsanityData to 7 Oct 2026

Refining Translations with LLMs: A Constraint-Aware Iterative Prompting Approach

arXiv 2411.08348 ↗First posted 13 Nov 2024cs.CLcited by 2

Not on the map. Why?

Abstract (arXiv)

Large language models (LLMs) have demonstrated remarkable proficiency in machine translation (MT), even without specific training on the languages in question. However, translating rare words in low-resource or domain-specific contexts remains challenging for LLMs. To address this issue, we propose a multi-step prompt chain that enhances translation faithfulness by prioritizing key terms crucial for semantic accuracy. Our method first identifies these keywords and retrieves their translations from a bilingual dictionary, integrating them into the LLM's context using Retrieval-Augmented Generation (RAG). We further mitigate potential output hallucinations caused by long prompts through an iterative self-checking mechanism, where the LLM refines its translations based on lexical and semantic constraints. Experiments using Llama and Qwen as base models on the FLORES-200 and WMT datasets demonstrate significant improvements over baselines, highlighting the effectiveness of our approach in enhancing translation faithfulness and robustness, particularly in low-resource scenarios.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 14 of its 36 references that are in the map. First posted on arXiv 13 Nov 2024.

Builds on

14 of 36 references.

References · 14

  1. 2024The Llama 3 Herd of Modelscited by 14,192
  2. 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,601
  3. 2024Qwen2 Technical Reportcited by 2,076
  4. 2023Self-RAG: Learning to Retrieve, Generate, and Critique through Self-Reflectioncited by 1,800
  5. 2022No Language Left Behind: Scaling Human-Centered Machine Translationcited by 1,290
  6. 2024M3-Embedding: Multi-Linguality, Multi-Functionality, Multi-Granularity Text Embeddings Through Self-Knowledge Distillationcited by 1,050
  7. 2017Word Translation Without Parallel Datacited by 480
  8. 2023Don't Make Your LLM an Evaluation Benchmark Cheatercited by 194
  9. 2023Dictionary-based Phrase-level Prompting of Large Language Models for Machine Translationcited by 74
  10. 2024Efficiently Exploring Large Language Models for Document-Level Machine Translation with In-context Learningcited by 23
  11. 2020Bilingual Dictionary Based Neural Machine Translation without Using Parallel Sentencescited by 19
  12. 2016Bridging Neural Machine Translation and Bilingual Dictionariescited by 18
2 more
  1. 2023Chain-of-Dictionary Prompting Elicits Translation in Large Language Modelscited by 16
  2. 2021Bilingual Dictionary-based Language Model Pretraining for Neural Machine Translationcited by 2

Built on by

Cited by year

Citing papers per year: 2025: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2024Low-Resource Machine Translation through Retrieval-Augmented LLM Prompting: A Study on the Mambai Language
  2. 2025How and Where to Translate? The Impact of Translation Strategies in Cross-lingual LLM Prompting
  3. 2024What do Large Language Models Need for Machine Translation Evaluation?
  4. 2025Bridging the Linguistic Divide: A Survey on Leveraging Large Language Models for Machine Translation
  5. 2025Compensating for Data with Reasoning: Low-Resource Machine Translation with LLMs
  6. 2025The Art of Asking: Multilingual Prompt Optimization for Synthetic Data
  7. 2026Can an Old Dog Be Taught New Tricks? Taking LLMs Beyond Sentence Level Translation
  8. 2024Learning-From-Mistakes Prompting for Indigenous Language Translation