mlsanityData to 14 Oct 2026

BEAR: Towards Beam-Search-Aware Optimization for Recommendation with Large Language Models

arXiv 2601.22925 ↗First posted 30 Jan 2026cs.IR cs.AI cs.LGcited by 1

Not on the map. Why?

Abstract (arXiv)

Recent years have seen a rapid surge in research leveraging Large Language Models (LLMs) for recommendation. These methods typically employ supervised fine-tuning (SFT) to adapt LLMs to recommendation scenarios, and utilize beam search during inference to efficiently retrieve B top-ranked recommended items. However, we identify a critical training-inference inconsistency: while SFT optimizes the overall probability of positive items, it does not guarantee that such items will be retrieved by beam search even if they possess high overall probabilities. Due to the greedy pruning mechanism, beam search can prematurely discard a positive item once its prefix probability is insufficient. To address this inconsistency, we propose BEAR (Beam-SEarch-Aware Regularization), a novel fine-tuning objective that explicitly accounts for beam search behavior during training. Rather than directly simulating beam search for each instance during training, which is computationally prohibitive, BEAR enforces a relaxed necessary condition: each token in a positive item must rank within the top-B candidate tokens at each decoding step. This objective effectively mitigates the risk of incorrect pruning while incurring negligible computational overhead compared to standard SFT. Extensive experiments across four real-world datasets demonstrate that BEAR significantly outperforms strong baselines. Code is available at https://github.com/Tiny-Snow/BEAR-SIGIR-2026 .

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 67 of its 90 references that are in the map. First posted on arXiv 30 Jan 2026.

Builds on

67 of 90 references.

References · 67

  1. 2017Attention Is All You Needcited by 60,361
  2. 2020Language Models are Few-Shot Learnerscited by 32,419
  3. 2023GPT-4 Technical Reportcited by 18,396
  4. 2022Training language models to follow instructions with human feedbackcited by 15,971
  5. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  6. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
  7. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 8,065
  8. 2016SQuAD: 100,000+ Questions for Machine Comprehension of Textcited by 4,148
  9. 2023Qwen Technical Reportcited by 3,344
  10. 2018Self-Attentive Sequential Recommendationcited by 1,184
  11. 2024Qwen2.5-Math Technical Report: Toward Mathematical Expert Model via Self-Improvementcited by 1,090
  12. 2019BERT4Rec: Sequential Recommendation with Bidirectional Encoder Representations from Transformercited by 964
38 more
  1. 2015Image-based Recommendations on Styles and Substitutescited by 706
  2. 2015Session-based Recommendations with Recurrent Neural Networkscited by 695
  3. 2016Ups and Downs: Modeling the Visual Evolution of Fashion Trends with One-Class Collaborative Filteringcited by 520
  4. 2018Personalized Top-N Sequential Recommendation via Convolutional Sequence Embeddingcited by 476
  5. 2022Recommendation as Language Processing (RLP): A Unified Pretrain, Personalized Prompt & Predict Paradigm (P5)cited by 402
  6. 2024Better & Faster Large Language Models via Multi-token Predictioncited by 360
  7. 2023TALLRec: An Effective and Efficient Tuning Framework to Align Large Language Model with Recommendationcited by 337
  8. 2024DeepSeek-Coder-V2: Breaking the Barrier of Closed-Source Models in Code Intelligencecited by 331
  9. 2023Large Language Models are Zero-Shot Rankers for Recommender Systemscited by 309
  10. 2023Chat-REC: Towards Interactive and Explainable LLMs-Augmented Recommender Systemcited by 242
  11. 2017Beam Search Strategies for Neural Machine Translationcited by 232
  12. 2023Is ChatGPT a Good Recommender? A Preliminary Studycited by 193
  13. 2023Recommendation as Instruction Following: A Large Language Model Empowered Recommendation Approachcited by 168
  14. 2023Uncovering ChatGPT's Capabilities in Recommender Systemscited by 161
  15. 2022M6-Rec: Generative Pretrained Language Models are Open-Ended Recommender Systemscited by 152
  16. 2021Sequential Recommendation with Graph Neural Networkscited by 89
  17. 2024From Matching to Generation: A Survey on Generative Information Retrievalcited by 89
  18. 2023A Bi-Step Grounding Paradigm for Large Language Models in Recommendation Systemscited by 73
  19. 2021AutoDebias: Learning to Debias for Recommendationcited by 68
  20. 2024On Softmax Direct Preference Optimization for Recommendationcited by 64
  21. 2023LLaRA: Large Language-Recommendation Assistantcited by 56
  22. 2022Bootstrap Latent Representations for Multi-modal Recommendationcited by 55
  23. 2023ONCE: Boosting Content-based Recommendation with Both Open- and Closed-source Large Language Modelscited by 54
  24. 2025Think Before Recommend: Unleashing the Latent Reasoning Power for Sequential Recommendationcited by 51
  25. 2024Large Language Models meet Collaborative Filtering: An Efficient All-round LLM-based Recommender Systemcited by 50
  26. 2025Reinforced Latent Reasoning for LLM-based Recommendationcited by 47
  27. 2023Multi-Modal Self-Supervised Learning for Recommendationcited by 45
  28. 2022On the Effectiveness of Sampled Softmax Loss for Item Recommendationcited by 39
  29. 2023Scalable and Effective Generative Information Retrievalcited by 39
  30. 2023TransAct: Transformer-based Realtime User Action Model for Recommendation at Pinterestcited by 35
  31. 2024Large Language Models Enhanced Collaborative Filteringcited by 27
  32. 2020Learning Optimal Tree Models Under Beam Searchcited by 26
  33. 2024Large Language Models are Learnable Planners for Long-Term Recommendationcited by 24
  34. 2020ADER: Adaptively Distilled Exemplar Replay Towards Continual Learning for Session-based Recommendationcited by 22
  35. 2024How Do Recommendation Models Amplify Popularity Bias? An Analysis from the Spectral Perspectivecited by 21
  36. 2024Planning Ahead in Generative Retrieval: Guiding Autoregressive Generation through Simultaneous Decodingcited by 19
  37. 2024SPRec: Self-Play to Debias LLM-based Recommendationcited by 18
  38. 2024Distributionally Robust Graph-based Recommendation Systemcited by 17

50 most cited of 67 All 67 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.