Minimum Risk Training for Neural Machine Translation
Not on the map. Why?
Abstract (arXiv)
We propose minimum risk training for end-to-end neural machine translation. Unlike conventional maximum likelihood estimation, minimum risk training is capable of optimizing model parameters directly with respect to arbitrary evaluation metrics, which are not necessarily differentiable. Experiments show that our approach achieves significant improvements over maximum likelihood estimation on a state-of-the-art neural machine translation system across various languages pairs. Transparent to architectures, our approach can be applied to more neural networks and potentially benefit more NLP tasks.
Key facts. Cited by 114 papers in the map (data through 7 Oct 2026). First posted on arXiv 8 Dec 2015.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2018: 1; 2019: 1; 2020: 1; 2021: 34; 2022: 21; 2023: 28; 2024: 12; 2025: 9; 2026: 7.
114 papers.
Sort:
By area:
- 2022Quark: Controllable Text Generation with Reinforced Unlearningcited by 236
- 2023Automatically Correcting Large Language Models: Surveying the landscape of diverse self-correction strategiescited by 236
- 2023ReMax: A Simple, Effective, and Efficient Reinforcement Learning Method for Aligning Large Language Modelscited by 184
- 2022BRIO: Bringing Order to Abstractive Summarizationcited by 161
- 2021SimCLS: A Simple Framework for Contrastive Learning of Abstractive Summarizationcited by 131
- 2025LLM Post-Training: A Deep Dive into Reasoning Large Language Modelscited by 129
- 2022Why Exposure Bias Matters: An Imitation Learning Perspective of Error Accumulation in Language Generationcited by 106
- 2021Survey of Low-Resource Machine Translationcited by 92
- 2024RLHF Deciphered: A Critical Analysis of Reinforcement Learning from Human Feedback for LLMscited by 89
- 2023On Learning to Summarize with Large Language Models as Referencescited by 80
- 2023RMM: Reinforced Memory Management for Class-Incremental Learningcited by 66
- 2020Text Generation by Learning from Demonstrationscited by 64
38 more
- 2023Uncertainty in Natural Language Generation: From Theory to Applicationscited by 61
- 2018Reliability and Learnability of Human Bandit Feedback for Sequence-to-Sequence Reinforcement Learningcited by 57
- 2021Order-Agnostic Cross Entropy for Non-Autoregressive Machine Translationcited by 57
- 2021Understanding the Properties of Minimum Bayes Risk Decoding in Neural Machine Translationcited by 56
- 2021Machine Translation Decoding beyond Beam Searchcited by 55
- 2023Bridging the Gap: A Survey on Integrating (Human) Feedback for Natural Language Generationcited by 55
- 2022LENS: A Learnable Evaluation Metric for Text Simplificationcited by 54
- 2022Quality-Aware Decoding for Neural Machine Translationcited by 49
- 2023Learning to Generate Better Than Your LLMcited by 49
- 2023It's MBR All the Way Down: Modern Generation Techniques Through the Lens of Minimum Bayes Riskcited by 49
- 2021Domain Adaptation and Multi-Domain Adaptation for Neural Machine Translation: A Surveycited by 46
- 2022Rainier: Reinforced Knowledge Introspector for Commonsense Question Answeringcited by 43
- 2022Identifying Weaknesses in Machine Translation Metrics Through Minimum Bayes Risk Decoding: A Case Study for COMETcited by 41
- 2023Tuning computer vision models with task rewardscited by 36
- 2021Prevent the Language Model from being Overconfident in Neural Machine Translationcited by 34
- 2023MBR and QE Finetuning: Training-time Distillation of the Best and Most Expensive Decoding Methodscited by 33
- 2024Improving Machine Translation with Human Feedback: An Exploration of Quality Estimation as a Reward Modelcited by 33
- 2021Revisiting the Weaknesses of Reinforcement Learning for Neural Machine Translationcited by 32
- 2023Gender Biases in Automatic Evaluation Metrics for Image Captioningcited by 24
- 2023BLEURT Has Universal Translations: An Analysis of Automatic Metrics by Minimum Risk Trainingcited by 24
- 2021AutoLoss-Zero: Searching Loss Functions from Scratch for Generic Taskscited by 19
- 2023Aligning Neural Machine Translation Models: Human Feedback in Training and Inferencecited by 19
- 2021Sequence-Level Training for Non-Autoregressive Neural Machine Translationcited by 18
- 2021Don't Take It Literally: An Edit-Invariant Sequence Loss for Text Generationcited by 17
- 2021Modelling Latent Translations for Cross-Lingual Transfercited by 16
- 2021Bandits Don't Follow Rules: Balancing Multi-Facet Machine Translation with Multi-Armed Banditscited by 16
- 2024QUEST: Quality-Aware Metropolis-Hastings Sampling for Machine Translationcited by 16
- 2023Understanding and Bridging the Modality Gap for Speech Translationcited by 15
- 2023ESRL: Efficient Sampling-based Reinforcement Learning for Sequence Generationcited by 15
- 2021Reward Optimization for Neural Machine Translation with Learned Metricscited by 12
- 2019An Empirical Comparison on Imitation Learning and Reinforcement Learning for Paraphrase Generationcited by 11
- 2021Smoothing and Shrinking the Sparse Seq2Seq Search Spacecited by 11
- 2021Scheduled Sampling Based on Decoding Steps for Neural Machine Translationcited by 11
- 2021Conditional Poisson Stochastic Beam Searchcited by 11
- 2022Teacher Forcing Recovers Reward Functions for Text Generationcited by 11
- 2024Fine-Grained Reward Optimization for Machine Translation using Error Severity Mappingscited by 11
- 2021Confidence-Aware Scheduled Sampling for Neural Machine Translationcited by 10
- 2023Can Diffusion Model Achieve Better Performance in Text Generation? Bridging the Gap between Training and Inference!cited by 10
50 most cited of 114 All 114 (JSON)
- 2026A foundation for systematic analysis of transformers and RNNs for tractography1 Oct 2026
- 2026Entropy Regularization: A Free Correction to Cross-Entropy for Verified Demonstrations24 Sep 2026
- 2026Enhancing Small Language Models for Power Outage Report Generation via Minimum Risk Training23 Sep 2026
- 2026Reference-Free Reinforcement Learning Fine-Tuning for MT: A Seq2Seq Perspective15 May 2026
- 2026COMO: Closed-Loop Optical Molecule Recognition with Minimum Risk Training26 Apr 2026
- 2026VEPO: Variable Entropy Policy Optimization for Low-Resource Language Foundation Models19 Mar 2026
- 2026Alignment-Aware Model Adaptation via Feedback-Guided Optimization2 Feb 2026
- 2025Adaptive Constraint Propagation: Scaling Structured Inference for Large Language Models via Meta-Reinforcement Learning31 Dec 2025
- 2025DiffGRM: Diffusion-based Generative Recommendation Model21 Oct 2025
- 2025Drax: Speech Recognition with Discrete Flow Matching5 Oct 2025
- 2025Reward Models are Metrics in a Trench Coat3 Oct 2025
- 2025MT-RewardTree: A Comprehensive Framework for Advancing LLM-Based Machine Translation via Reward Modeling15 Mar 2025
38 more
- 2025LLM Post-Training: A Deep Dive into Reasoning Large Language Models28 Feb 2025
- 2025Improved Diffusion-based Generative Model with Better Adversarial Robustness24 Feb 2025
- 2025Entailment-Preserving First-order Logic Representations in Natural Language Entailment24 Feb 2025
- 2025Sequence-level Large Language Model Training with Contrastive Preference Optimization23 Feb 2025
- 2024Fine-Grained Reward Optimization for Machine Translation using Error Severity Mappings8 Nov 2024
- 2024Modeling User Preferences with Automatic Metrics: Creating a High-Quality Preference Dataset for Machine Translation10 Oct 2024
- 2024LLMR: Knowledge Distillation with a Large Language Model-Induced Reward19 Sep 2024
- 2024An Empirical Study on Self-correcting Large Language Models for Data Science Code Generation28 Aug 2024
- 2024Don't Throw Away Data: Better Sequence Knowledge Distillation15 Jul 2024
- 2024LLM See, LLM Do: Guiding Data Generation to Target Non-Differentiable Objectives1 Jul 2024
- 2024On the Transformations across Reward Model, Parameter Update, and In-Context Prompt24 Jun 2024
- 2024Improving Autoregressive Training with Dynamic Oracles13 Jun 2024
- 2024Language Generation with Strictly Proper Scoring Rules29 May 2024
- 2024QUEST: Quality-Aware Metropolis-Hastings Sampling for Machine Translation28 May 2024
- 2024RLHF Deciphered: A Critical Analysis of Reinforcement Learning from Human Feedback for LLMs12 Apr 2024
- 2024Improving Machine Translation with Human Feedback: An Exploration of Quality Estimation as a Reward Model23 Jan 2024
- 2023Aligning Neural Machine Translation Models: Human Feedback in Training and Inference15 Nov 2023
- 2023Context Consistency between Training and Testing in Simultaneous Machine Translation13 Nov 2023
- 2023Robustness Tests for Automatic Machine Translation Metrics with Adversarial Attacks1 Nov 2023
- 2023Beyond MLE: Convex Learning for Text Generation26 Oct 2023
- 2023Reference Free Domain Adaptation for Translation of Noisy Questions with Question Specific Rewards23 Oct 2023
- 2023ReMax: A Simple, Effective, and Efficient Reinforcement Learning Method for Aligning Large Language Models16 Oct 2023
- 2023It's MBR All the Way Down: Modern Generation Techniques Through the Lens of Minimum Bayes Risk2 Oct 2023
- 2023Language Model Decoding as Direct Metrics Optimization2 Oct 2023
- 2023Unlikelihood Tuning on Negative Samples Amazingly Improves Zero-Shot Translation28 Sep 2023
- 2023MBR and QE Finetuning: Training-time Distillation of the Best and Most Expensive Decoding Methods19 Sep 2023
- 2023Learning Evaluation Models from Large Language Models for Sequence Generation8 Aug 2023
- 2023Automatically Correcting Large Language Models: Surveying the landscape of diverse self-correction strategies6 Aug 2023
- 2023ESRL: Efficient Sampling-based Reinforcement Learning for Sequence Generation4 Aug 2023
- 2023Uncertainty in Natural Language Generation: From Theory to Applications28 Jul 2023
- 2023Enhancing Supervised Learning with Contrastive Markings in Neural Machine Translation Training17 Jul 2023
- 2023Improving Factuality of Abstractive Summarization via Contrastive Reward Learning10 Jul 2023
- 2023Assessing the efficacy of large language models in generating accurate teacher responses9 Jul 2023
- 2023BLEURT Has Universal Translations: An Analysis of Automatic Metrics by Minimum Risk Training6 Jul 2023
- 2023Learning to Generate Better Than Your LLM20 Jun 2023
- 2023Gender Biases in Automatic Evaluation Metrics for Image Captioning24 May 2023
- 2023On Learning to Summarize with Large Language Models as References23 May 2023
- 2023Understanding and Bridging the Modality Gap for Speech Translation15 May 2023
50 newest of 114 All 114 (JSON)
- 2023ReMax: A Simple, Effective, and Efficient Reinforcement Learning Method for Aligning Large Language Modelscited by 184
- 2024RLHF Deciphered: A Critical Analysis of Reinforcement Learning from Human Feedback for LLMscited by 89
- 2018Reliability and Learnability of Human Bandit Feedback for Sequence-to-Sequence Reinforcement Learningcited by 57
- 2023Bridging the Gap: A Survey on Integrating (Human) Feedback for Natural Language Generationcited by 55
- 2024Improving Machine Translation with Human Feedback: An Exploration of Quality Estimation as a Reward Modelcited by 33
- 2023Aligning Neural Machine Translation Models: Human Feedback in Training and Inferencecited by 19
- 2024Fine-Grained Reward Optimization for Machine Translation using Error Severity Mappingscited by 11
- 2024Modeling User Preferences with Automatic Metrics: Creating a High-Quality Preference Dataset for Machine Translationcited by 8
- 2025Sequence-level Large Language Model Training with Contrastive Preference Optimizationcited by 3
- 2025Reward Models are Metrics in a Trench Coatcited by 2
- 2024On the Transformations across Reward Model, Parameter Update, and In-Context Promptcited by 1
- 2025Reward Models are Metrics in a Trench Coat3 Oct 2025
- 2025Sequence-level Large Language Model Training with Contrastive Preference Optimization23 Feb 2025
- 2024Fine-Grained Reward Optimization for Machine Translation using Error Severity Mappings8 Nov 2024
- 2024Modeling User Preferences with Automatic Metrics: Creating a High-Quality Preference Dataset for Machine Translation10 Oct 2024
- 2024On the Transformations across Reward Model, Parameter Update, and In-Context Prompt24 Jun 2024
- 2024RLHF Deciphered: A Critical Analysis of Reinforcement Learning from Human Feedback for LLMs12 Apr 2024
- 2024Improving Machine Translation with Human Feedback: An Exploration of Quality Estimation as a Reward Model23 Jan 2024
- 2023Aligning Neural Machine Translation Models: Human Feedback in Training and Inference15 Nov 2023
- 2023ReMax: A Simple, Effective, and Efficient Reinforcement Learning Method for Aligning Large Language Models16 Oct 2023
- 2023Bridging the Gap: A Survey on Integrating (Human) Feedback for Natural Language Generation1 May 2023
- 2018Reliability and Learnability of Human Bandit Feedback for Sequence-to-Sequence Reinforcement Learning27 May 2018
- 2023Can Diffusion Model Achieve Better Performance in Text Generation? Bridging the Gap between Training and Inference!cited by 10
- 2025DiffGRM: Diffusion-based Generative Recommendation Modelcited by 4
- 2025Improved Diffusion-based Generative Model with Better Adversarial Robustnesscited by 3
- 2025Drax: Speech Recognition with Discrete Flow Matchingcited by 3
- 2025DiffGRM: Diffusion-based Generative Recommendation Model21 Oct 2025
- 2025Drax: Speech Recognition with Discrete Flow Matching5 Oct 2025
- 2025Improved Diffusion-based Generative Model with Better Adversarial Robustness24 Feb 2025
- 2023Can Diffusion Model Achieve Better Performance in Text Generation? Bridging the Gap between Training and Inference!8 May 2023
- 2023Automatically Correcting Large Language Models: Surveying the landscape of diverse self-correction strategiescited by 236
- 2025LLM Post-Training: A Deep Dive into Reasoning Large Language Modelscited by 129
- 2025MT-RewardTree: A Comprehensive Framework for Advancing LLM-Based Machine Translation via Reward Modelingcited by 9
- 2025MT-RewardTree: A Comprehensive Framework for Advancing LLM-Based Machine Translation via Reward Modeling15 Mar 2025
- 2025LLM Post-Training: A Deep Dive into Reasoning Large Language Models28 Feb 2025
- 2023Automatically Correcting Large Language Models: Surveying the landscape of diverse self-correction strategies6 Aug 2023
- 2022Quark: Controllable Text Generation with Reinforced Unlearningcited by 236
- 2022BRIO: Bringing Order to Abstractive Summarizationcited by 161
- 2021SimCLS: A Simple Framework for Contrastive Learning of Abstractive Summarizationcited by 131
- 2022Why Exposure Bias Matters: An Imitation Learning Perspective of Error Accumulation in Language Generationcited by 106
- 2021Survey of Low-Resource Machine Translationcited by 92
- 2023On Learning to Summarize with Large Language Models as Referencescited by 80
- 2023RMM: Reinforced Memory Management for Class-Incremental Learningcited by 66
- 2023Uncertainty in Natural Language Generation: From Theory to Applicationscited by 61
- 2021Order-Agnostic Cross Entropy for Non-Autoregressive Machine Translationcited by 57
- 2021Understanding the Properties of Minimum Bayes Risk Decoding in Neural Machine Translationcited by 56
- 2021Machine Translation Decoding beyond Beam Searchcited by 55
- 2022LENS: A Learnable Evaluation Metric for Text Simplificationcited by 54
- 2022Quality-Aware Decoding for Neural Machine Translationcited by 49
12 most cited of 92 All 92 (JSON)
- 2026A foundation for systematic analysis of transformers and RNNs for tractography1 Oct 2026
- 2026Entropy Regularization: A Free Correction to Cross-Entropy for Verified Demonstrations24 Sep 2026
- 2026Enhancing Small Language Models for Power Outage Report Generation via Minimum Risk Training23 Sep 2026
- 2026Reference-Free Reinforcement Learning Fine-Tuning for MT: A Seq2Seq Perspective15 May 2026
- 2026COMO: Closed-Loop Optical Molecule Recognition with Minimum Risk Training26 Apr 2026
- 2026VEPO: Variable Entropy Policy Optimization for Low-Resource Language Foundation Models19 Mar 2026
- 2026Alignment-Aware Model Adaptation via Feedback-Guided Optimization2 Feb 2026
- 2025Adaptive Constraint Propagation: Scaling Structured Inference for Large Language Models via Meta-Reinforcement Learning31 Dec 2025
- 2025Entailment-Preserving First-order Logic Representations in Natural Language Entailment24 Feb 2025
- 2024LLMR: Knowledge Distillation with a Large Language Model-Induced Reward19 Sep 2024
- 2024An Empirical Study on Self-correcting Large Language Models for Data Science Code Generation28 Aug 2024
- 2024Don't Throw Away Data: Better Sequence Knowledge Distillation15 Jul 2024
12 newest of 92 All 92 (JSON)