mlsanityData to 7 Oct 2026

Linear-time Minimum Bayes Risk Decoding with Reference Aggregation

arXiv 2402.04251 ↗First posted 6 Feb 2024cs.CLcited by 21

Not on the map. Why?

Abstract (arXiv)

Minimum Bayes Risk (MBR) decoding is a text generation technique that has been shown to improve the quality of machine translations, but is expensive, even if a sampling-based approximation is used. Besides requiring a large number of sampled sequences, it requires the pairwise calculation of a utility metric, which has quadratic complexity. In this paper, we propose to approximate pairwise metric scores with scores calculated against aggregated reference representations. This changes the complexity of utility estimation from O(n2) to O(n), while empirically preserving most of the quality gains of MBR decoding. We release our source code at https://github.com/ZurichNLP/mbr

Key facts. Cited by 21 papers in the map (data through 7 Oct 2026). Builds on 20 of its 37 references that are in the map. First posted on arXiv 6 Feb 2024.

Builds on

20 of 37 references.

References · 20

  1. 2017Attention Is All You Needcited by 59,932
  2. 2015Rethinking the Inception Architecture for Computer Visioncited by 5,451
  3. 2018A Call for Clarity in Reporting BLEU Scorescited by 1,790
  4. 2022Fast Inference from Transformers via Speculative Decodingcited by 1,615
  5. 2019fairseq: A Fast, Extensible Toolkit for Sequence Modelingcited by 1,486
  6. 2020BLEURT: Learning Robust Metrics for Text Generationcited by 1,196
  7. 2020COMET: A Neural Framework for MT Evaluationcited by 1,024
  8. 2023Accelerating Large Language Model Decoding with Speculative Samplingcited by 975
  9. 2023xCOMET: Transparent Machine Translation Evaluation through Fine-grained Error Detectioncited by 260
  10. 2019Facebook FAIR's WMT19 News Translation Task Submissioncited by 179
  11. 2020Is MAP Decoding All You Need? The Inadequacy of the Mode in Neural Machine Translationcited by 137
  12. 2022Truncation Sampling as Language Model Desmoothingcited by 121
8 more
  1. 2021High Quality Rather than High Model Probability: Minimum Bayes Risk Decoding with Neural Metricscited by 104
  2. 2021Sampling-Based Approximations to Minimum Bayes Risk Decoding for Neural Machine Translationcited by 63
  3. 2023Epsilon Sampling Rocks: Investigating Sampling Strategies for Minimum Bayes Risk Decoding for Machine Translationcited by 57
  4. 2022Identifying Weaknesses in Machine Translation Metrics Through Minimum Bayes Risk Decoding: A Case Study for COMETcited by 41
  5. 2023Faster Minimum Bayes Risk Decoding with Confidence-based Pruningcited by 34
  6. 2023MBR and QE Finetuning: Training-time Distillation of the Best and Most Expensive Decoding Methodscited by 33
  7. 2023Direct Preference Optimization for Neural Machine Translation with Minimum Bayes Risk Decodingcited by 28
  8. 2024Hyperparameter-Free Approach for Faster Minimum Bayes Risk Decodingcited by 15

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 11; 2025: 8; 2026: 2.

21 papers.

Sort:

By area:

  1. 2024Regularized Best-of-N Sampling with Minimum Bayes Risk Objective for Language Model Alignmentcited by 24
  2. 2024Mitigating Metric Bias in Minimum Bayes Risk Decodingcited by 15
  3. 2024Efficient Minimum Bayes Risk Decoding using Low-Rank Matrix Completion Algorithmscited by 13
  4. 2024Improving Minimum Bayes Risk Decoding with Multi-Promptcited by 13
  5. 2024mbrs: A Library for Minimum Bayes Risk Decodingcited by 13
  6. 2024Centroid-Based Efficient Minimum Bayes Risk Decodingcited by 12
  7. 2024Introducing the NewsPaLM MBR and QE Dataset: LLM-Generated High-Quality Parallel Data Outperforms Traditional Web-Crawled Datacited by 10
  8. 2025Uncertainty-Aware Decoding with Minimum Bayes Riskcited by 10
  9. 2024Diversity Explains Inference Scaling Laws: Through a Case Study of Minimum Bayes Risk Decodingcited by 8
  10. 2025Theoretical Guarantees for Minimum Bayes Risk Decodingcited by 3
  11. 2024A Bayesian Optimization Approach to Machine Translation Rerankingcited by 2
  12. 2024A Context-aware Framework for Translation-mediated Conversationscited by 2
9 more
  1. 2025Early-Exit and Instant Confidence Translation Quality Estimationcited by 2
  2. 2025Agreement-Constrained Probabilistic Minimum Bayes Risk Decodingcited by 2
  3. 2025Case-Based Decision-Theoretic Decoding with Quality Memoriescited by 1
  4. 2025Structure-Conditional Minimum Bayes Risk Decodingcited by 1
  5. 2024Unveiling the Power of Source: Source-based Minimum Bayes Risk Decoding for Neural Machine Translationcited by 0
  6. 2025Multi-Hypothesis Distillation of Multilingual Neural Translation Models for Low-Resource Languagescited by 0
  7. 2025Minimum Bayes Risk Decoding for Error Span Detection in Reference-Free Automatic Machine Translation Evaluationcited by 0
  8. 2026MLLP-VRAIN UPV system for the IWSLT 2026 Simultaneous Speech Translation taskcited by 0
  9. 2026Quit While You're Ahead: Quit for Efficient Candidate Generation in Machine Translation Rerankingcited by 0