BEAR: Towards Beam-Search-Aware Optimization for Recommendation with Large Language Models
Not on the map. Why?
Abstract (arXiv)
Recent years have seen a rapid surge in research leveraging Large Language Models (LLMs) for recommendation. These methods typically employ supervised fine-tuning (SFT) to adapt LLMs to recommendation scenarios, and utilize beam search during inference to efficiently retrieve B top-ranked recommended items. However, we identify a critical training-inference inconsistency: while SFT optimizes the overall probability of positive items, it does not guarantee that such items will be retrieved by beam search even if they possess high overall probabilities. Due to the greedy pruning mechanism, beam search can prematurely discard a positive item once its prefix probability is insufficient. To address this inconsistency, we propose BEAR (Beam-SEarch-Aware Regularization), a novel fine-tuning objective that explicitly accounts for beam search behavior during training. Rather than directly simulating beam search for each instance during training, which is computationally prohibitive, BEAR enforces a relaxed necessary condition: each token in a positive item must rank within the top-B candidate tokens at each decoding step. This objective effectively mitigates the risk of incorrect pruning while incurring negligible computational overhead compared to standard SFT. Extensive experiments across four real-world datasets demonstrate that BEAR significantly outperforms strong baselines. Code is available at https://github.com/Tiny-Snow/BEAR-SIGIR-2026 .
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 67 of its 90 references that are in the map. First posted on arXiv 30 Jan 2026.
Builds on
67 of 90 references.
References · 67
- 2017Attention Is All You Needcited by 60,361
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2023GPT-4 Technical Reportcited by 18,396
- 2022Training language models to follow instructions with human feedbackcited by 15,971
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
- 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 8,065
- 2016SQuAD: 100,000+ Questions for Machine Comprehension of Textcited by 4,148
- 2023Qwen Technical Reportcited by 3,344
- 2018Self-Attentive Sequential Recommendationcited by 1,184
- 2024Qwen2.5-Math Technical Report: Toward Mathematical Expert Model via Self-Improvementcited by 1,090
- 2019BERT4Rec: Sequential Recommendation with Bidirectional Encoder Representations from Transformercited by 964
38 more
- 2015Image-based Recommendations on Styles and Substitutescited by 706
- 2015Session-based Recommendations with Recurrent Neural Networkscited by 695
- 2016Ups and Downs: Modeling the Visual Evolution of Fashion Trends with One-Class Collaborative Filteringcited by 520
- 2018Personalized Top-N Sequential Recommendation via Convolutional Sequence Embeddingcited by 476
- 2022Recommendation as Language Processing (RLP): A Unified Pretrain, Personalized Prompt & Predict Paradigm (P5)cited by 402
- 2024Better & Faster Large Language Models via Multi-token Predictioncited by 360
- 2023TALLRec: An Effective and Efficient Tuning Framework to Align Large Language Model with Recommendationcited by 337
- 2024DeepSeek-Coder-V2: Breaking the Barrier of Closed-Source Models in Code Intelligencecited by 331
- 2023Large Language Models are Zero-Shot Rankers for Recommender Systemscited by 309
- 2023Chat-REC: Towards Interactive and Explainable LLMs-Augmented Recommender Systemcited by 242
- 2017Beam Search Strategies for Neural Machine Translationcited by 232
- 2023Is ChatGPT a Good Recommender? A Preliminary Studycited by 193
- 2023Recommendation as Instruction Following: A Large Language Model Empowered Recommendation Approachcited by 168
- 2023Uncovering ChatGPT's Capabilities in Recommender Systemscited by 161
- 2022M6-Rec: Generative Pretrained Language Models are Open-Ended Recommender Systemscited by 152
- 2021Sequential Recommendation with Graph Neural Networkscited by 89
- 2024From Matching to Generation: A Survey on Generative Information Retrievalcited by 89
- 2023A Bi-Step Grounding Paradigm for Large Language Models in Recommendation Systemscited by 73
- 2021AutoDebias: Learning to Debias for Recommendationcited by 68
- 2024On Softmax Direct Preference Optimization for Recommendationcited by 64
- 2023LLaRA: Large Language-Recommendation Assistantcited by 56
- 2022Bootstrap Latent Representations for Multi-modal Recommendationcited by 55
- 2023ONCE: Boosting Content-based Recommendation with Both Open- and Closed-source Large Language Modelscited by 54
- 2025Think Before Recommend: Unleashing the Latent Reasoning Power for Sequential Recommendationcited by 51
- 2024Large Language Models meet Collaborative Filtering: An Efficient All-round LLM-based Recommender Systemcited by 50
- 2025Reinforced Latent Reasoning for LLM-based Recommendationcited by 47
- 2023Multi-Modal Self-Supervised Learning for Recommendationcited by 45
- 2022On the Effectiveness of Sampled Softmax Loss for Item Recommendationcited by 39
- 2023Scalable and Effective Generative Information Retrievalcited by 39
- 2023TransAct: Transformer-based Realtime User Action Model for Recommendation at Pinterestcited by 35
- 2024Large Language Models Enhanced Collaborative Filteringcited by 27
- 2020Learning Optimal Tree Models Under Beam Searchcited by 26
- 2024Large Language Models are Learnable Planners for Long-Term Recommendationcited by 24
- 2020ADER: Adaptively Distilled Exemplar Replay Towards Continual Learning for Session-based Recommendationcited by 22
- 2024How Do Recommendation Models Amplify Popularity Bias? An Analysis from the Spectral Perspectivecited by 21
- 2024Planning Ahead in Generative Retrieval: Guiding Autoregressive Generation through Simultaneous Decodingcited by 19
- 2024SPRec: Self-Play to Debias LLM-based Recommendationcited by 18
- 2024Distributionally Robust Graph-based Recommendation Systemcited by 17
50 most cited of 67 All 67 (JSON)
Built on by
Citing papers per year: 2026: 1.
1 paper.