LBR: Towards Mitigating Length Bias in Large Language Models for Recommendation
Not on the map. Why?
Abstract (arXiv)
Large language models (LLMs) have recently emerged as powerful backbones for recommender systems by reformulating recommendation as a token-level generation task. Despite their promise, we identify a pervasive yet underexplored issue: textitLength Bias. Because items are represented by textual descriptions of varying lengths, LLM-based recommenders can be systematically biased in two ways. On the input side, longer item descriptions occupy more tokens in the context and thus receive disproportionately large aggregate attention mass during user preference modeling. On the output side, decoding based on summed autoregressive log-likelihood score inherently disfavors long items. Worse still, conventional length normalization can introduce an additional bias and even degrade recommendation performance. To address this problem, we propose LBR (Length Bias Reduction), a lightweight and model-agnostic framework for mitigating length bias in LLM-based recommendation. LBR mitigates input-side bias via Length-Aware Attention Calibration, which incorporates a length-dependent offset into attention logits to neutralize attention skew. For the output side, LBR introduces Effective Information Length Normalization, replacing naive token count with an information-theoretic length surrogate derived from the branching structure of the prefix tree. Extensive experiments on three real-world Amazon datasets and two representative LLM-based recommenders demonstrate that LBR substantially alleviates length bias while consistently improving recommendation accuracy and fairness, with negligible additional training and inference overhead (with an average NDCG@5 gain of 16.82%). The code is available at https://github.com/Void-JackLee/LBR.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 41 of its 63 references that are in the map. First posted on arXiv 5 Jul 2026.
Builds on
41 of 63 references.
References · 41
- 2017Attention Is All You Needcited by 59,932
- 2024The Llama 3 Herd of Modelscited by 14,192
- 2016SQuAD: 100,000+ Questions for Machine Comprehension of Textcited by 4,115
- 2016Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translationcited by 1,471
- 2019Distributionally Robust Neural Networks for Group Shifts: On the Importance of Regularization for Worst-Case Generalizationcited by 1,232
- 2018Self-Attentive Sequential Recommendationcited by 1,169
- 2019BERT4Rec: Sequential Recommendation with Bidirectional Encoder Representations from Transformercited by 952
- 2015Session-based Recommendations with Recurrent Neural Networkscited by 685
- 2018Personalized Top-N Sequential Recommendation via Convolutional Sequence Embeddingcited by 473
- 2023A Survey on Large Language Models for Recommendationcited by 378
- 2023Large Language Models are Zero-Shot Rankers for Recommender Systemscited by 307
- 2017Lexically Constrained Decoding for Sequence Generation Using Grid Beam Searchcited by 234
29 more
- 2023Adapting Large Language Models by Integrating Collaborative Semantics for Recommendationcited by 171
- 2023AgentCF: Collaborative Learning with Autonomous Language Agents for Recommender Systemscited by 116
- 2019Neural Machine Translation: A Review and Surveycited by 99
- 2024Bias and Unfairness in Information Retrieval Systems: New Challenges in the LLM Eracited by 97
- 2022Intent Contrastive Learning for Sequential Recommendationcited by 90
- 2023ReLLa: Retrieval-enhanced Large Language Models for Lifelong Sequential Behavior Comprehension in Recommendationcited by 76
- 2023A Bi-Step Grounding Paradigm for Large Language Models in Recommendation Systemscited by 73
- 2023Large Language Models for Generative Recommendation: A Survey and Visionary Discussionscited by 72
- 2024On Softmax Direct Preference Optimization for Recommendationcited by 64
- 2023Collaborative Large Language Model for Recommender Systemscited by 63
- 2024IDGenRec: LLM-RecSys Alignment with Textual ID Learningcited by 50
- 2024Harnessing Large Language Models for Text-Rich Sequential Recommendationcited by 38
- 2023RecRanker: Instruction Tuning Large Language Model as Ranker for Top-k Recommendationcited by 36
- 2018Breaking the Beam Search Curse: A Study of (Re-)Scoring Methods and Stopping Criteria for Neural Machine Translationcited by 29
- 2024Large Language Models Enhanced Collaborative Filteringcited by 27
- 2024How Do Recommendation Models Amplify Popularity Bias? An Analysis from the Spectral Perspectivecited by 21
- 2024SPRec: Self-Play to Debias LLM-based Recommendationcited by 18
- 2025Evaluating Position Bias in Large Language Model Recommendationscited by 14
- 2023Large Language Models are Not Stable Recommender Systemscited by 13
- 2023FLIP: Fine-grained Alignment between ID-based Models and Pretrained Language Models for CTR Predictioncited by 11
- 2024LLM4DSR: Leveraging Large Language Model for Denoising Sequential Recommendationcited by 10
- 2025Process-Supervised LLM Recommenders via Flow-guided Tuningcited by 10
- 2025MSL: Not All Tokens Are What You Need for Tuning LLM as a Recommendercited by 10
- 2024STAR: A Simple Training-free Approach for Recommendations using Large Language Modelscited by 8
- 2024Causality-Enhanced Behavior Sequence Modeling in LLMs for Personalized Recommendationcited by 8
- 2025IGD: Token Decisiveness Modeling via Information Gain in LLMs for Personalized Recommendationcited by 5
- 2021Multi-Sentence Resampling: A Simple Approach to Alleviate Dataset Length Bias and Beam-Search Degradationcited by 4
- 2022The Implicit Length Bias of Label Smoothing on Beam Search Decodingcited by 2
- 2025Does LLM Focus on the Right Words? Mitigating Context Bias in LLM-based Recommenderscited by 2
Built on by
Not cited yet.