Six Challenges for Neural Machine Translation
Not on the map. Why?
Abstract (arXiv)
We explore six challenges for neural machine translation: domain mismatch, amount of training data, rare words, long sentences, word alignment, and beam search. We show both deficiencies and improvements over the quality of phrase-based statistical machine translation.
Key facts. Cited by 335 papers in the map (data through 14 Oct 2026). First posted on arXiv 12 Jun 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 89; 2022: 63; 2023: 63; 2024: 52; 2025: 36; 2026: 32.
335 papers.
Sort:
By area:
- 2022Survey of Hallucination in Natural Language Generationcited by 2,075
- 2021Datasets: A Community Library for Natural Language Processingcited by 530
- 2023Trustworthy LLMs: a Survey and Guideline for Evaluating Large Language Models' Alignmentcited by 401
- 2023A Stitch in Time Saves Nine: Detecting and Mitigating Hallucinations of LLMs by Validating Low-Confidence Generationcited by 206
- 2022In-context Examples Selection for Machine Translationcited by 172
- 2025Thoughts Are All Over the Place: On the Underthinking of o1-Like LLMscited by 163
- 2021The Curious Case of Hallucinations in Neural Machine Translationcited by 161
- 2023Towards Making the Most of ChatGPT for Machine Translationcited by 138
- 2024From Decoding to Meta-Generation: Inference-time Algorithms for Large Language Modelscited by 137
- 2021Samanantar: The Largest Publicly Available Parallel Corpora Collection for 11 Indic Languagescited by 136
- 2021Q2: Evaluating Factual Consistency in Knowledge-Grounded Dialogues via Question Generation and Question Answeringcited by 132
- 2023End-to-End Speech Recognition: A Surveycited by 129
38 more
- 2023DDCoT: Duty-Distinct Chain-of-Thought Prompting for Multimodal Reasoning in Language Modelscited by 128
- 2022Calibrating Sequence likelihood Improves Conditional Language Generationcited by 121
- 2021Neural Machine Translation for Low-Resource Languages: A Surveycited by 109
- 2021Neural Path Hunter: Reducing Hallucination in Dialogue Systems via Path Groundingcited by 106
- 2021Efficient Nearest Neighbor Language Modelscited by 93
- 2021Survey of Low-Resource Machine Translationcited by 92
- 2021Protecting Intellectual Property of Language Generation APIs with Lexical Watermarkcited by 84
- 2022CATER: Intellectual Property Protection on Text Generation APIs via Conditional Watermarkscited by 76
- 2023Calibration in Deep Learning: A Survey of the State-of-the-Artcited by 75
- 2023Dictionary-based Phrase-level Prompting of Large Language Models for Machine Translationcited by 74
- 2022RankGen: Improving Text Generation with Large Ranking Modelscited by 72
- 2021Sampling-Based Approximations to Minimum Bayes Risk Decoding for Neural Machine Translationcited by 65
- 2021Neural Machine Translation with Monolingual Translation Memorycited by 61
- 2022Looking for a Needle in a Haystack: A Comprehensive Study of Hallucinations in Neural Machine Translationcited by 61
- 2022Neuro-Symbolic Language Modeling with Automaton-augmented Retrievalcited by 60
- 2021BlonDe: An Automatic Evaluation Metric for Document-level Machine Translationcited by 58
- 2021Adaptive Nearest Neighbor Machine Translationcited by 58
- 2021Understanding the Properties of Minimum Bayes Risk Decoding in Neural Machine Translationcited by 56
- 2021A Systematic Investigation of Commonsense Knowledge in Large Language Modelscited by 56
- 2022Multi-VALUE: A Framework for Cross-Dialectal English NLPcited by 53
- 2023It's MBR All the Way Down: Modern Generation Techniques Through the Lens of Minimum Bayes Riskcited by 51
- 2022Quality-Aware Decoding for Neural Machine Translationcited by 49
- 2025Large Language Models Hallucination: A Comprehensive Surveycited by 49
- 2021Domain Adaptation and Multi-Domain Adaptation for Neural Machine Translation: A Surveycited by 46
- 2021G-Transformer for Document-level Machine Translationcited by 46
- 2021They, Them, Theirs: Rewriting with Gender-Neutral Englishcited by 44
- 2022Learning to Reason Deductively: Math Word Problem Solving as Complex Relation Extractioncited by 44
- 2023Decoder-Only or Encoder-Decoder? Interpreting Language Model as a Regularized Encoder-Decodercited by 44
- 2023Uncertainty in Natural Language Processing: Sources, Quantification, and Applicationscited by 44
- 2024Fine-tuning Large Language Models for Domain-specific Machine Translationcited by 43
- 2023Mitigating Hallucinations and Off-target Machine Translation with Source-Contrastive and Language-Contrastive Decodingcited by 42
- 2021Improving Pretrained Cross-Lingual Language Models via Self-Labeled Word Alignmentcited by 41
- 2022Melting Pot 2.0cited by 40
- 2021Fast Nearest Neighbor Machine Translationcited by 37
- 2021BERT, mBERT, or BiBERT? A Study on Contextualized Embeddings for Neural Machine Translationcited by 35
- 2021Sequence Length is a Domain: Length-based Overfitting in Transformer Modelscited by 35
- 2021MSP: Multi-Stage Prompting for Making Pre-trained Language Models Better Translatorscited by 35
- 2023Lost in Translation: Large Language Models in Non-English Content Analysiscited by 35
50 most cited of 335 All 335 (JSON)
- 2026Diagnose, Then Repair: A Two-Stage MQM-Guided Post-Editing Framework for Domain-Specific Machine Translation19 Sep 2026
- 2026Machine Translation between English and Syriac (East Syriac Dialect) using Statistical Machine Learning16 Sep 2026
- 2026HintMiner: Automatic Question Hints Mining From Q&A Web Posts with Language Model via Self-Supervised Learning13 Sep 2026
- 2026The University of Melbourne WMT 2026 CreoleMT Submission: A Domain-Balanced Approach to Low-Resource Pacific Creole Machine Translation12 Sep 2026
- 2026Last Translation Benchmark3 Sep 2026
- 2026The Interlingua Hypothesis: LLMs Translate via a Latent Task-agnostic Feature Space1 Sep 2026
- 2026EnSiTa - A Trilingual Multi-Domain Parallel Dataset and Benchmark for Domain-Specific Machine Translation25 Aug 2026
- 2026Unified Multi-Dialectal Neural Machine Translation for Bangla Using the Dwadash Benchmark Corpus12 Aug 2026
- 2026Multilingual Emotion Neurons in Large Audio-Language Models9 Aug 2026
- 2026Cross-Lingual Transfer for Machine Translation in Turkic Languages31 Jul 2026
- 2026Systematic Analysis of Large Language Models and Transformer-Based Machine Translation for English-Tamil and Tamil-English Across Diverse Datasets27 Jul 2026
- 2026Reasoning Before Translation: Enhancing Legal Machine Translation with Structured Reasoning21 Jul 2026
38 more
- 2026When Reranking Hurts: Uncertainty-Based Gating for Few-Shot Reranking30 Jun 2026
- 2026When are likely answers right? On Sequence Probability and Correctness in LLMs25 Jun 2026
- 2026Non-Autoregressive Minimum Bayes' Risk Decoding for Fast Speech Recognition16 Jun 2026
- 2026English-to-Prakrit Machine Translation via Multilingual Transfer Learning4 Jun 2026
- 2026Reference-Free Reinforcement Learning Fine-Tuning for MT: A Seq2Seq Perspective15 May 2026
- 2026On Stable Long-Form Generation: Benchmarking and Mitigating Length Volatility2 May 2026
- 2026Efficient Test-Time Inference via Deterministic Exploration of Truncated Decoding Trees22 Apr 2026
- 2026No One Fits All: From Fixed Prompting to Learned Routing in Multilingual LLMs18 Apr 2026
- 2026Round-Trip Translation Reveals What Frontier Multilingual Benchmarks Miss14 Apr 2026
- 2026EnsemHalDet: Robust VLM Hallucination Detection via Ensemble of Internal State Detectors3 Apr 2026
- 2026SAGE: Sustainable Agent-Guided Expert-tuning for Culturally Attuned Translation in Low-Resource Southeast Asia20 Mar 2026
- 2026Ensemble Self-Training for Unsupervised Machine Translation17 Mar 2026
- 2026Mitigating Structural Noise in Low-Resource S2TT: An Optimized Cascaded Nepali-English Pipeline with Punctuation Restoration25 Feb 2026
- 2026Flow of Spans: Generalizing Language Models to Dynamic Span-Vocabulary via GFlowNets11 Feb 2026
- 2026Beyond Many-Shot Translation: Scaling In-Context Demonstrations For Low-Resource Machine Translation4 Feb 2026
- 2026Assessing the Impact of Typological Features on Multilingual Machine Translation in the Age of Large Language Models3 Feb 2026
- 2026KD4MT: A Survey of Knowledge Distillation for Machine Translation22 Jan 2026
- 2026Responsible AI for General-Purpose Systems: Overview, Challenges, and A Path Forward19 Jan 2026
- 2026Improving Low-Resource Machine Translation via Round-Trip Reinforcement Learning18 Jan 2026
- 2026Context Volume Drives Performance: Tackling Domain Shift in Extremely Low-Resource Translation via RAG15 Jan 2026
- 2025Opportunities and Challenges of Natural Language Processing for Low-Resource Senegalese Languages in Social Science Research24 Dec 2025
- 2025An Empirical Study on Chinese Character Decomposition in Multiword Expression-Aware Neural Machine Translation17 Dec 2025
- 2025Building from Scratch: A Multi-Agent Framework with Human-in-the-Loop for Multilingual Legal Terminology Mapping15 Dec 2025
- 2025Agreement-Constrained Probabilistic Minimum Bayes Risk Decoding1 Dec 2025
- 2025LLMs for Low-Resource Dialect Translation Using Context-Aware Prompting: A Case Study on Sylheti24 Nov 2025
- 2025Efficient Covariance Estimation for Sparsified Functional Data23 Nov 2025
- 2025Ready to Translate, Not to Represent? Bias and Performance Gaps in Multilingual LLMs Across Language Families and Domains9 Oct 2025
- 2025Large Language Models Hallucination: A Comprehensive Survey5 Oct 2025
- 2025Low-Resource English-Tigrinya MT: Leveraging Multilingual Models, Custom Tokenizers, and Clean Evaluation Benchmarks24 Sep 2025
- 2025Case-Based Decision-Theoretic Decoding with Quality Memories16 Sep 2025
- 2025MetaRAG: Metamorphic Testing for Hallucination Detection in RAG Systems11 Sep 2025
- 2025From Scarcity to Efficiency: Investigating the Effects of Data Augmentation on African Machine Translation9 Sep 2025
- 2025Evaluating the Impact of Verbal Multiword Expressions on Machine Translation24 Aug 2025
- 2025Exploiting Vocabulary Frequency Imbalance in Language Model Pre-training21 Aug 2025
- 2025Overcoming Latency Bottlenecks in On-Device Speech Translation: A Cascaded Approach with Alignment-Based Streaming MT18 Aug 2025
- 2025Are All Prompt Components Value-Neutral? Understanding the Heterogeneous Adversarial Robustness of Dissected Prompt in Large Language Models3 Aug 2025
- 2025SynAdapt: Learning Adaptive Reasoning in Large Language Models via Synthetic Continuous Chain-of-Thought1 Aug 2025
- 2025Theoretical Foundations and Mitigation of Hallucination in Large Language Models20 Jul 2025
50 newest of 335 All 335 (JSON)
- 2025Thoughts Are All Over the Place: On the Underthinking of o1-Like LLMscited by 163
- 2023DDCoT: Duty-Distinct Chain-of-Thought Prompting for Multimodal Reasoning in Language Modelscited by 128
- 2022Learning to Reason Deductively: Math Word Problem Solving as Complex Relation Extractioncited by 44
- 2025New Trends for Modern Machine Translation with Large Reasoning Modelscited by 17
- 2025SynAdapt: Learning Adaptive Reasoning in Large Language Models via Synthetic Continuous Chain-of-Thoughtcited by 13
- 2023PathFinder: Guided Search over Multi-Step Reasoning Pathscited by 12
- 2024SUTRA: Scalable Multilingual Language Model Architecturecited by 11
- 2026Efficient Test-Time Inference via Deterministic Exploration of Truncated Decoding Treescited by 1
- 2026Reasoning Before Translation: Enhancing Legal Machine Translation with Structured Reasoningcited by 0
- 2026Reasoning Before Translation: Enhancing Legal Machine Translation with Structured Reasoning21 Jul 2026
- 2026Efficient Test-Time Inference via Deterministic Exploration of Truncated Decoding Trees22 Apr 2026
- 2025SynAdapt: Learning Adaptive Reasoning in Large Language Models via Synthetic Continuous Chain-of-Thought1 Aug 2025
- 2025New Trends for Modern Machine Translation with Large Reasoning Models13 Mar 2025
- 2025Thoughts Are All Over the Place: On the Underthinking of o1-Like LLMs30 Jan 2025
- 2024SUTRA: Scalable Multilingual Language Model Architecture7 May 2024
- 2023PathFinder: Guided Search over Multi-Step Reasoning Paths8 Dec 2023
- 2023DDCoT: Duty-Distinct Chain-of-Thought Prompting for Multimodal Reasoning in Language Models25 Oct 2023
- 2022Learning to Reason Deductively: Math Word Problem Solving as Complex Relation Extraction19 Mar 2022
- 2021Rejuvenating Low-Frequency Words: Making the Most of Parallel Data in Non-Autoregressive Translationcited by 34
- 2023Distilling Autoregressive Models to Obtain High-Performance Non-Autoregressive Solvers for Vehicle Routing Problems with Faster Inference Speedcited by 19
- 2022Improving Simultaneous Machine Translation with Monolingual Datacited by 13
- 2021Multilingual Neural Machine Translation:Can Linguistic Hierarchies Help?cited by 2
- 2026KD4MT: A Survey of Knowledge Distillation for Machine Translationcited by 2
- 2026KD4MT: A Survey of Knowledge Distillation for Machine Translation22 Jan 2026
- 2023Distilling Autoregressive Models to Obtain High-Performance Non-Autoregressive Solvers for Vehicle Routing Problems with Faster Inference Speed19 Dec 2023
- 2022Improving Simultaneous Machine Translation with Monolingual Data2 Dec 2022
- 2021Multilingual Neural Machine Translation:Can Linguistic Hierarchies Help?15 Oct 2021
- 2021Rejuvenating Low-Frequency Words: Making the Most of Parallel Data in Non-Autoregressive Translation2 Jun 2021
- 2022Improving Retrieval Augmented Neural Machine Translation by Controlling Source and Fuzzy-Match Interactionscited by 7
- 2024Retrieving Examples from Memory for Retrieval Augmented Neural Machine Translation: A Systematic Comparisoncited by 7
- 2022Improving Robustness of Retrieval Augmented Translation via Shuffling of Suggestionscited by 2
- 2025MetaRAG: Metamorphic Testing for Hallucination Detection in RAG Systemscited by 2
- 2025MetaRAG: Metamorphic Testing for Hallucination Detection in RAG Systems11 Sep 2025
- 2024Retrieving Examples from Memory for Retrieval Augmented Neural Machine Translation: A Systematic Comparison3 Apr 2024
- 2022Improving Robustness of Retrieval Augmented Translation via Shuffling of Suggestions11 Oct 2022
- 2022Improving Retrieval Augmented Neural Machine Translation by Controlling Source and Fuzzy-Match Interactions10 Oct 2022
- 2025MAPS: A Multilingual Benchmark for Agent Performance and Securitycited by 7
- 2025Building from Scratch: A Multi-Agent Framework with Human-in-the-Loop for Multilingual Legal Terminology Mappingcited by 2
- 2026SAGE: Sustainable Agent-Guided Expert-tuning for Culturally Attuned Translation in Low-Resource Southeast Asiacited by 2
- 2026SAGE: Sustainable Agent-Guided Expert-tuning for Culturally Attuned Translation in Low-Resource Southeast Asia20 Mar 2026
- 2025Building from Scratch: A Multi-Agent Framework with Human-in-the-Loop for Multilingual Legal Terminology Mapping15 Dec 2025
- 2025MAPS: A Multilingual Benchmark for Agent Performance and Security21 May 2025
- 2023Aligning Neural Machine Translation Models: Human Feedback in Training and Inferencecited by 19
- 2024Modeling User Preferences with Automatic Metrics: Creating a High-Quality Preference Dataset for Machine Translationcited by 8
- 2024Is Preference Alignment Always the Best Option to Enhance LLM-Based Translation? An Empirical Analysiscited by 4
- 2024Modeling User Preferences with Automatic Metrics: Creating a High-Quality Preference Dataset for Machine Translation10 Oct 2024
- 2024Is Preference Alignment Always the Best Option to Enhance LLM-Based Translation? An Empirical Analysis30 Sep 2024
- 2023Aligning Neural Machine Translation Models: Human Feedback in Training and Inference15 Nov 2023
- 2025Latent Beam Diffusion Models for Generating Visual Sequences26 Mar 2025
- 2022Survey of Hallucination in Natural Language Generationcited by 2,075
- 2021Datasets: A Community Library for Natural Language Processingcited by 530
- 2023Trustworthy LLMs: a Survey and Guideline for Evaluating Large Language Models' Alignmentcited by 401
- 2023A Stitch in Time Saves Nine: Detecting and Mitigating Hallucinations of LLMs by Validating Low-Confidence Generationcited by 206
- 2022In-context Examples Selection for Machine Translationcited by 172
- 2021The Curious Case of Hallucinations in Neural Machine Translationcited by 161
- 2023Towards Making the Most of ChatGPT for Machine Translationcited by 138
- 2024From Decoding to Meta-Generation: Inference-time Algorithms for Large Language Modelscited by 137
- 2021Samanantar: The Largest Publicly Available Parallel Corpora Collection for 11 Indic Languagescited by 136
- 2021Q2: Evaluating Factual Consistency in Knowledge-Grounded Dialogues via Question Generation and Question Answeringcited by 132
- 2023End-to-End Speech Recognition: A Surveycited by 129
- 2022Calibrating Sequence likelihood Improves Conditional Language Generationcited by 121
12 most cited of 303 All 303 (JSON)
- 2026Diagnose, Then Repair: A Two-Stage MQM-Guided Post-Editing Framework for Domain-Specific Machine Translation19 Sep 2026
- 2026Machine Translation between English and Syriac (East Syriac Dialect) using Statistical Machine Learning16 Sep 2026
- 2026HintMiner: Automatic Question Hints Mining From Q&A Web Posts with Language Model via Self-Supervised Learning13 Sep 2026
- 2026The University of Melbourne WMT 2026 CreoleMT Submission: A Domain-Balanced Approach to Low-Resource Pacific Creole Machine Translation12 Sep 2026
- 2026Last Translation Benchmark3 Sep 2026
- 2026The Interlingua Hypothesis: LLMs Translate via a Latent Task-agnostic Feature Space1 Sep 2026
- 2026EnSiTa - A Trilingual Multi-Domain Parallel Dataset and Benchmark for Domain-Specific Machine Translation25 Aug 2026
- 2026Unified Multi-Dialectal Neural Machine Translation for Bangla Using the Dwadash Benchmark Corpus12 Aug 2026
- 2026Multilingual Emotion Neurons in Large Audio-Language Models9 Aug 2026
- 2026Cross-Lingual Transfer for Machine Translation in Turkic Languages31 Jul 2026
- 2026Systematic Analysis of Large Language Models and Transformer-Based Machine Translation for English-Tamil and Tamil-English Across Diverse Datasets27 Jul 2026
- 2026When Reranking Hurts: Uncertainty-Based Gating for Few-Shot Reranking30 Jun 2026
12 newest of 303 All 303 (JSON)