mlsanityData to 7 Oct 2026

Beam Search Strategies for Neural Machine Translation

arXiv 1702.01806 ↗First posted 6 Feb 2017cs.CLcited by 232

Not on the map. Why?

Abstract (arXiv)

The basic concept in Neural Machine Translation (NMT) is to train a large Neural Network that maximizes the translation performance on a given parallel corpus. NMT is then using a simple left-to-right beam-search decoder to generate new translations that approximately maximize the trained conditional probability. The current beam search strategy generates the target sentence word by word from left-to- right while keeping a fixed amount of active candidates at each time step. First, this simple search is less adaptive as it also expands candidates whose scores are much worse than the current best. Secondly, it does not expand hypotheses if they are not within the best scoring candidates, even if their scores are close to the best one. The latter one can be avoided by increasing the beam size until no performance improvement can be observed. While you can reach better performance, this has the draw- back of a slower decoding speed. In this paper, we concentrate on speeding up the decoder by applying a more flexible beam search strategy whose candidate size may vary at each time step depending on the candidate scores. We speed up the original decoder by up to 43% for the two language pairs German-English and Chinese-English without losing any translation quality.

Key facts. Cited by 232 papers in the map (data through 7 Oct 2026). First posted on arXiv 6 Feb 2017.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 12; 2022: 16; 2023: 40; 2024: 72; 2025: 55; 2026: 37.

232 papers.

Sort:

By area:

  1. 2024Chronos: Learning the Language of Time Seriescited by 712
  2. 2023Mitigating Object Hallucinations in Large Vision-Language Models through Visual Contrastive Decodingcited by 671
  3. 2023LaMP: When Large Language Models Meet Personalizationcited by 425
  4. 2023Analyzing and Mitigating Object Hallucination in Large Vision-Language Modelscited by 314
  5. 2024Turning Up the Heat: Min-p Sampling for Creative and Coherent LLM Outputscited by 148
  6. 2024From Decoding to Meta-Generation: Inference-time Algorithms for Large Language Modelscited by 136
  7. 2024PLeak: Prompt Leaking Attacks against Large Language Model Applicationscited by 113
  8. 2024The Good, The Bad, and The Greedy: Evaluation of LLMs Should Not Ignore Non-Determinismcited by 113
  9. 2024A Thorough Examination of Decoding Methods in the Era of LLMscited by 112
  10. 2024Optimization Methods for Personalizing Large Language Models through Retrieval Augmentationcited by 98
  11. 2023Language Model Behavior: A Comprehensive Surveycited by 92
  12. 2024LongLaMP: A Benchmark for Personalized Long-form Text Generationcited by 91
38 more
  1. 2024Revolutionizing Finance with LLMs: An Overview of Applications and Insightscited by 88
  2. 2024A Systematic Survey and Critical Review on Evaluating Large Language Models: Challenges, Limitations, and Recommendationscited by 84
  3. 2023Bag of Tricks for Training Data Extraction from Language Modelscited by 67
  4. 2024GuardT2I: Defending Text-to-Image Models from Adversarial Promptscited by 61
  5. 2023Teach LLMs to Personalize -- An Approach inspired by Writing Educationcited by 48
  6. 2024Transfer Q Star: Principled Decoding for LLM Alignmentcited by 46
  7. 2024Bidirectional Decoding: Improving Action Chunking via Guided Test-Time Samplingcited by 46
  8. 2024Nullu: Mitigating Object Hallucinations in Large Vision-Language Models via HalluSpace Projectioncited by 46
  9. 2023Learning to Rewrite Prompts for Personalized Text Generationcited by 40
  10. 2023Hot or Cold? Adaptive Temperature Sampling for Code Generation with Large Language Modelscited by 37
  11. 2024MoAI: Mixture of All Intelligence for Large Language and Vision Modelscited by 36
  12. 2023ParroT: Translating during Chat using Large Language Models tuned with Human Translation and Feedbackcited by 34
  13. 2024PURPLE: Making a Large Language Model a Better SQL Writercited by 34
  14. 2022Why So Toxic? Measuring and Triggering Toxic Behavior in Open-Domain Chatbotscited by 31
  15. 2024Can Language Beat Numerical Regression? Language-Based Multimodal Trajectory Predictioncited by 31
  16. 2024Meteor: Mamba-based Traversal of Rationale for Large Language and Vision Modelscited by 30
  17. 2024LLMs + Persona-Plug = Personalized LLMscited by 29
  18. 2023The Benefits of Bad Advice: Autocontrastive Decoding across Model Layerscited by 28
  19. 2023Towards Possibilities & Impossibilities of AI-generated Text Detection: A Surveycited by 28
  20. 2024Compressible Dynamics in Deep Overparameterized Low-Rank Learning & Adaptationcited by 26
  21. 2024Decoding Decoded: Understanding Hyperparameter Effects in Open-Ended Text Generationcited by 26
  22. 2024Non-myopic Generation of Language Models for Reasoning and Planningcited by 25
  23. 2025Latent Thought Models with Variational Bayes Inference-Time Computationcited by 25
  24. 2025Genius: A Generalizable and Purely Unsupervised Self-Training Framework For Advanced Reasoningcited by 24
  25. 2025TokUR: Token-Level Uncertainty Estimation for Large Language Model Reasoningcited by 24
  26. 2023Reinforcement-Enhanced Autoregressive Feature Transformation: Gradient-steered Search in Continuous Space for Postfix Expressionscited by 23
  27. 2024Materials science in the era of large language models: a perspectivecited by 23
  28. 2023Complex Organ Mask Guided Radiology Report Generationcited by 22
  29. 2024OmniVid: A Generative Framework for Universal Video Understandingcited by 22
  30. 2025PropRAG: Guiding Retrieval with Beam Search over Proposition Pathscited by 22
  31. 2024In-Context Example Selection via Similarity Search Improves Low-Resource Machine Translationcited by 21
  32. 2024Reasoning Through Execution: Unifying Process and Outcome Rewards for Code Generationcited by 21
  33. 2025Transformer Copilot: Learning from The Mistake Log in LLM Fine-tuningcited by 21
  34. 2025Mitigating Hallucinations in Vision-Language Models through Image-Guided Head Suppressioncited by 21
  35. 2025Output Scaling: YingLong-Delayed Chain of Thought in a Large Pretrained Time Series Forecasting Modelcited by 21
  36. 2024Deep Generative Models for Offline Policy Learning: Tutorial, Survey, and Perspectives on Future Directionscited by 20
  37. 2024Comparing Retrieval-Augmentation and Parameter-Efficient Fine-Tuning for Privacy-Preserving Personalization of Large Language Modelscited by 20
  38. 2021MemSum: Extractive Summarization of Long Documents Using Multi-Step Episodic Markov Decision Processescited by 19

50 most cited of 232 All 232 (JSON)