Dictionary-based Phrase-level Prompting of Large Language Models for Machine Translation
Not on the map. Why?
Abstract (arXiv)
Large language models (LLMs) demonstrate remarkable machine translation (MT) abilities via prompting, even though they were not explicitly trained for this task. However, even given the incredible quantities of data they are trained on, LLMs can struggle to translate inputs with rare words, which are common in low resource or domain transfer scenarios. We show that LLM prompting can provide an effective solution for rare words as well, by using prior knowledge from bilingual dictionaries to provide control hints in the prompts. We propose a novel method, DiPMT, that provides a set of possible translations for a subset of the input words, thereby enabling fine-grained phrase-level prompted control of the LLM. Extensive experiments show that DiPMT outperforms the baseline both in low-resource MT, as well as for out-of-domain MT. We further provide a qualitative analysis of the benefits and limitations of this approach, including the overall level of controllability that is achieved.
Key facts. Cited by 74 papers in the map (data through 7 Oct 2026). Builds on 25 of its 30 references that are in the map. First posted on arXiv 15 Feb 2023.
Builds on
25 of 30 references.
References · 25
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2022OPT: Open Pre-trained Transformer Language Modelscited by 3,464
- 2022BLOOM: A 176B-Parameter Open-Access Multilingual Language Modelcited by 1,968
- 2018A Call for Clarity in Reporting BLEU Scorescited by 1,790
- 2020Stanza: A Python Natural Language Processing Toolkit for Many Human Languagescited by 719
- 2021Prompt Programming for Large Language Models: Beyond the Few-Shot Paradigmcited by 599
- 2021The FLORES-101 Evaluation Benchmark for Low-Resource and Multilingual Machine Translationcited by 556
- 2021Datasets: A Community Library for Natural Language Processingcited by 526
- 2017Word Translation Without Parallel Datacited by 480
- 2017Six Challenges for Neural Machine Translationcited by 334
- 2017Lexically Constrained Decoding for Sequence Generation Using Grid Beam Searchcited by 234
- 2020Nearest Neighbor Machine Translationcited by 209
13 more
- 2018Fast Lexically Constrained Decoding with Dynamic Beam Allocation for Neural Machine Translationcited by 181
- 2022In-context Examples Selection for Machine Translationcited by 172
- 2020Unsupervised Domain Clusters in Pretrained Language Modelscited by 160
- 2020SimAlign: High Quality Word Alignments without Parallel Training Data using Static and Contextualized Embeddingscited by 155
- 2022Prompting PaLM for Translation: Assessing Strategies and Performancecited by 144
- 2019Training Neural Machine Translation To Apply Terminology Constraintscited by 73
- 2019Code-Switching for Enhancing NMT with Pre-Specified Translationcited by 53
- 2016Incorporating Discrete Translation Lexicons into Neural Machine Translationcited by 33
- 2022Using natural language prompts for machine translationcited by 27
- 2021Non-Parametric Unsupervised Domain Adaptation for Neural Machine Translationcited by 20
- 2021Bilingual Lexicon Induction via Unsupervised Bitext Construction and Word Alignmentcited by 19
- 2016Bridging Neural Machine Translation and Bilingual Dictionariescited by 18
- 2022Zero-shot Domain Adaptation for Neural Machine Translation with Retrieved Phrase-level Promptscited by 7
Built on by
Citing papers per year: 2023: 16; 2024: 32; 2025: 17; 2026: 9.
74 papers.
Sort:
By area:
- 2023Document-Level Machine Translation with Large Language Modelscited by 90
- 2023Large language models effectively leverage document-level context for literary translation, but critical errors persistcited by 80
- 2023A Benchmark for Learning to Translate a New Language from One Grammar Bookcited by 74
- 2023Benchmarking Machine Translation with Cultural Awarenesscited by 53
- 2023Exploring Human-Like Translation Strategy with Large Language Modelscited by 44
- 2024Fine-tuning Large Language Models for Domain-specific Machine Translationcited by 43
- 2023ParroT: Translating during Chat using Large Language Models tuned with Human Translation and Feedbackcited by 34
- 2024Teaching Large Language Models an Unseen Language on the Flycited by 29
- 2024TasTe: Teaching Large Language Models to Translate through Self-Reflectioncited by 27
- 2024DelTA: An Online Document-Level Translation Agent Based on Multi-Level Memorycited by 27
- 2024Can LLMs Really Learn to Translate a Low-Resource Language from One Grammar Book?cited by 23
- 2023Fine-tuning Large Language Models for Adaptive Machine Translationcited by 21
38 more
- 2023Domain Terminology Integration into Machine Translation: Leveraging Large Language Modelscited by 17
- 2024Shortcomings of LLMs for Low-Resource Translation: Retrieval and Understanding are Both the Problemcited by 17
- 2023Chain-of-Dictionary Prompting Elicits Translation in Large Language Modelscited by 16
- 2024Fine-Tuning Large Language Models to Translate: Will a Touch of Noisy Data in Misaligned Languages Suffice?cited by 16
- 2023Deliberate then Generate: Enhanced Prompting Framework for Text Generationcited by 13
- 2025Compositional Translation: A Novel LLM-based Approach for Low-resource Machine Translationcited by 13
- 2023Explain-then-Translate: An Analysis on Improving Program Translation with Self-generated Explanationscited by 12
- 2024Low-Resource Machine Translation through Retrieval-Augmented LLM Prompting: A Study on the Mambai Languagecited by 12
- 2025Understanding In-Context Machine Translation for Low-Resource Languages: A Case Study on Manchucited by 12
- 2024Large Language Model for Multi-Domain Translation: Benchmarking and Domain CoT Fine-tuningcited by 11
- 2025Lost in Literalism: How Supervised Training Shapes Translationese in LLMscited by 11
- 2024Fairness Definitions in Language Models Explainedcited by 10
- 2024A Preference-driven Paradigm for Enhanced Translation with Large Language Modelscited by 9
- 2023Terminology-Aware Translation with Constrained Decoding and Large Language Model Promptingcited by 8
- 2023Bilex Rx: Lexical Data Augmentation for Massively Multilingual Machine Translationcited by 7
- 2024Efficient Terminology Integration for LLM-based Translation in Specialized Domainscited by 7
- 2025Redefining Machine Translation on Social Network Services with Large Language Modelscited by 6
- 2024A Reality check of the benefits of LLM in businesscited by 5
- 2024GrammaMT: Improving Machine Translation with Grammar-Informed In-Context Learningcited by 5
- 2025Is Small Language Model the Silver Bullet to Low-Resource Languages Machine Translation?cited by 5
- 2025Multilingual Prompt Engineering in Large Language Models: A Survey Across NLP Taskscited by 5
- 2024Self-Augmented In-Context Learning for Unsupervised Word Translationcited by 4
- 2025Leveraging Domain Knowledge at Inference Time for LLM Translation: Retrieval versus Generationcited by 4
- 2025Read it in Two Steps: Translating Extremely Low-Resource Languages with Code-Augmented Grammar Bookscited by 4
- 2024Tuning LLMs with Contrastive Alignment Instructions for Machine Translation in Unseen, Low-resource Languagescited by 3
- 2024Language Modelling Approaches to Adaptive Machine Translationcited by 3
- 2024Thinker-DDM: Modeling Deliberation for Machine Translation with a Drift-Diffusion Processcited by 3
- 2024Prompting Large Language Models with Human Error Markings for Self-Correcting Machine Translationcited by 3
- 2024Mufu: Multilingual Fused Learning for Low-Resource Translation with LLMcited by 3
- 2024Domain-Specific Translation with Open-Source Large Language Models: Resource-Oriented Analysiscited by 3
- 2025LLM-based Generative Error Correction for Rare Words with Synthetic Data and Phonetic Contextcited by 3
- 2023Paradigm Shift in Sustainability Disclosure Analysis: Empowering Stakeholders with CHATREPORT, a Language Model-Based Toolcited by 2
- 2023On Bilingual Lexicon Induction with Large Language Modelscited by 2
- 2024C3Bench: A Comprehensive Classical Chinese Understanding Benchmark for Large Language Modelscited by 2
- 2024CRAT: A Multi-Agent Framework for Causality-Enhanced Reflective and Retrieval-Augmented Translation with Large Language Modelscited by 2
- 2024Refining Translations with LLMs: A Constraint-Aware Iterative Prompting Approachcited by 2
- 2024A Context-aware Framework for Translation-mediated Conversationscited by 2
- 2025LLMs for Translation: Historical, Low-Resourced Languages and Contemporary AI Modelscited by 2
50 most cited of 74 All 74 (JSON)
- 2026Lius: Translation Model Based Instructional Lingustic Using Continual Instruction Tuning In Kupang Malay10 Jun 2026
- 2026Reinforcement Learning Elicits Contextual Learning of Unseen Language Translation4 Jun 2026
- 2026A Komi-Yazva--Russian Parallel Corpus and Evaluation Protocol for Zero- and Few-Shot LLM Translation4 Jun 2026
- 2026Resource-Lean Lexicon Induction for German Dialects26 Apr 2026
- 2026Syntax as a Rosetta Stone: Universal Dependencies for In-Context Coptic Translation20 Apr 2026
- 2026An Empirical Study of Many-Shot In-Context Learning for Machine Translation of Low-Resource Languages3 Apr 2026
- 2026Translation Asymmetry in LLMs as a Data Augmentation Factor: A Case Study for 6 Romansh Language Varieties26 Mar 2026
- 2026Consensus-Aligned Neuron Efficient Fine-Tuning Large Language Models for Multi-Domain Machine Translation5 Feb 2026
- 2026Benchmarking Machine Translation on Chinese Social Media Texts30 Jan 2026
- 2025LLMs for Low-Resource Dialect Translation Using Context-Aware Prompting: A Case Study on Sylheti24 Nov 2025
- 2025Multilingual LLM Prompting Strategies for Medical English-Vietnamese Machine Translation19 Sep 2025
- 2025Read it in Two Steps: Translating Extremely Low-Resource Languages with Code-Augmented Grammar Books2 Jun 2025
38 more
- 2025Translate With Care: Addressing Gender Bias, Neutrality, and Reasoning in Large Language Model Translations31 May 2025
- 2025Enhancing Large Language Models'Machine Translation via Dynamic Focus Anchoring29 May 2025
- 2025LLM-based Generative Error Correction for Rare Words with Synthetic Data and Phonetic Context23 May 2025
- 2025Multilingual Prompt Engineering in Large Language Models: A Survey Across NLP Tasks16 May 2025
- 2025Fine-Tuning LLMs for Low-Resource Dialect Translation: The Case of Lebanese30 Apr 2025
- 2025Translation Analytics for Freelancers: I. Introduction, Data Preparation, Baseline Evaluations20 Apr 2025
- 2025Redefining Machine Translation on Social Network Services with Large Language Models10 Apr 2025
- 2025Is Small Language Model the Silver Bullet to Low-Resource Languages Machine Translation?31 Mar 2025
- 2025LLMs for Translation: Historical, Low-Resourced Languages and Contemporary AI Models14 Mar 2025
- 2025Leveraging Domain Knowledge at Inference Time for LLM Translation: Retrieval versus Generation6 Mar 2025
- 2025Compositional Translation: A Novel LLM-based Approach for Low-resource Machine Translation6 Mar 2025
- 2025Lost in Literalism: How Supervised Training Shapes Translationese in LLMs6 Mar 2025
- 2025Understanding In-Context Machine Translation for Low-Resource Languages: A Case Study on Manchu17 Feb 2025
- 2025DialUp! Modeling the Language Continuum by Adapting Models to Dialects and Dialects to Models27 Jan 2025
- 2024Domain-Specific Translation with Open-Source Large Language Models: Resource-Oriented Analysis8 Dec 2024
- 2024A Context-aware Framework for Translation-mediated Conversations5 Dec 2024
- 2024From Priest to Doctor: Domain Adaptation for Low-Resource Neural Machine Translation1 Dec 2024
- 2024Refining Translations with LLMs: A Constraint-Aware Iterative Prompting Approach13 Nov 2024
- 2024Using Language Models to Disambiguate Lexical Choices in Translation8 Nov 2024
- 2024CRAT: A Multi-Agent Framework for Causality-Enhanced Reflective and Retrieval-Augmented Translation with Large Language Models28 Oct 2024
- 2024GrammaMT: Improving Machine Translation with Grammar-Informed In-Context Learning24 Oct 2024
- 2024Efficient Terminology Integration for LLM-based Translation in Specialized Domains21 Oct 2024
- 2024DelTA: An Online Document-Level Translation Agent Based on Multi-Level Memory10 Oct 2024
- 2024Large Language Model for Multi-Domain Translation: Benchmarking and Domain CoT Fine-tuning3 Oct 2024
- 2024Can LLMs Really Learn to Translate a Low-Resource Language from One Grammar Book?27 Sep 2024
- 2024On Translating Technical Terminology: A Translation Workflow for Machine-Translated Acronyms26 Sep 2024
- 2024Mufu: Multilingual Fused Learning for Low-Resource Translation with LLM20 Sep 2024
- 2024A Data Selection Approach for Enhancing Low Resource Machine Translation Using Cross-Lingual Sentence Representations4 Sep 2024
- 2024DELIA: Diversity-Enhanced Learning for Instruction Adaptation in Large Language Models19 Aug 2024
- 2024SCOI: Syntax-augmented Coverage-based In-context Example Selection for Machine Translation9 Aug 2024
- 2024Fairness Definitions in Language Models Explained26 Jul 2024
- 2024Shortcomings of LLMs for Low-Resource Translation: Retrieval and Understanding are Both the Problem21 Jun 2024
- 2024TasTe: Teaching Large Language Models to Translate through Self-Reflection12 Jun 2024
- 2024A Reality check of the benefits of LLM in business9 Jun 2024
- 2024Prompting Large Language Models with Human Error Markings for Self-Correcting Machine Translation4 Jun 2024
- 2024LexMatcher: Dictionary-centric Data Collection for LLM-based Machine Translation3 Jun 2024
- 2024C3Bench: A Comprehensive Classical Chinese Understanding Benchmark for Large Language Models28 May 2024
- 2024Fine-Tuning Large Language Models to Translate: Will a Touch of Noisy Data in Misaligned Languages Suffice?22 Apr 2024
50 newest of 74 All 74 (JSON)
- 2023Document-Level Machine Translation with Large Language Modelscited by 90
- 2023Large language models effectively leverage document-level context for literary translation, but critical errors persistcited by 80
- 2023A Benchmark for Learning to Translate a New Language from One Grammar Bookcited by 74
- 2023Benchmarking Machine Translation with Cultural Awarenesscited by 53
- 2023Exploring Human-Like Translation Strategy with Large Language Modelscited by 44
- 2024Fine-tuning Large Language Models for Domain-specific Machine Translationcited by 43
- 2023ParroT: Translating during Chat using Large Language Models tuned with Human Translation and Feedbackcited by 34
- 2024Teaching Large Language Models an Unseen Language on the Flycited by 29
- 2024TasTe: Teaching Large Language Models to Translate through Self-Reflectioncited by 27
- 2024Can LLMs Really Learn to Translate a Low-Resource Language from One Grammar Book?cited by 23
- 2023Fine-tuning Large Language Models for Adaptive Machine Translationcited by 21
- 2023Domain Terminology Integration into Machine Translation: Leveraging Large Language Modelscited by 17
12 most cited of 67 All 67 (JSON)
- 2026Lius: Translation Model Based Instructional Lingustic Using Continual Instruction Tuning In Kupang Malay10 Jun 2026
- 2026Reinforcement Learning Elicits Contextual Learning of Unseen Language Translation4 Jun 2026
- 2026A Komi-Yazva--Russian Parallel Corpus and Evaluation Protocol for Zero- and Few-Shot LLM Translation4 Jun 2026
- 2026Resource-Lean Lexicon Induction for German Dialects26 Apr 2026
- 2026Syntax as a Rosetta Stone: Universal Dependencies for In-Context Coptic Translation20 Apr 2026
- 2026An Empirical Study of Many-Shot In-Context Learning for Machine Translation of Low-Resource Languages3 Apr 2026
- 2026Translation Asymmetry in LLMs as a Data Augmentation Factor: A Case Study for 6 Romansh Language Varieties26 Mar 2026
- 2026Consensus-Aligned Neuron Efficient Fine-Tuning Large Language Models for Multi-Domain Machine Translation5 Feb 2026
- 2026Benchmarking Machine Translation on Chinese Social Media Texts30 Jan 2026
- 2025LLMs for Low-Resource Dialect Translation Using Context-Aware Prompting: A Case Study on Sylheti24 Nov 2025
- 2025Multilingual LLM Prompting Strategies for Medical English-Vietnamese Machine Translation19 Sep 2025
- 2025Read it in Two Steps: Translating Extremely Low-Resource Languages with Code-Augmented Grammar Books2 Jun 2025
12 newest of 67 All 67 (JSON)