Length-Adaptive Interest Network for Balancing Long and Short Sequence Modeling in CTR Prediction
Not on the map. Why?
Abstract (arXiv)
User behavior sequences in modern recommendation systems exhibit significant length heterogeneity, ranging from sparse short-term interactions to rich long-term histories. While longer sequences provide more context, we observe that increasing the maximum input sequence length in existing CTR models paradoxically degrades performance for short-sequence users due to attention polarization and length imbalance in training data. To address this, we propose LAIN(Length-Adaptive Interest Network), a plug-and-play framework that explicitly incorporates sequence length as a conditioning signal to balance long- and short-sequence modeling. LAIN consists of three lightweight components: a Spectral Length Encoder that maps length into continuous representations, Length-Conditioned Prompting that injects global contextual cues into both long- and short-term behavior branches, and Length-Modulated Attention that adaptively adjusts attention sharpness based on sequence length. Extensive experiments on three real-world benchmarks across five strong CTR backbones show that LAIN consistently improves overall performance, achieving up to 1.15% AUC gain and 2.25% log loss reduction. Notably, our method significantly improves accuracy for short-sequence users without sacrificing longsequence effectiveness. Our work offers a general, efficient, and deployable solution to mitigate length-induced bias in sequential recommendation.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 14 of its 19 references that are in the map. First posted on arXiv 27 Jan 2026.
Builds on
14 of 19 references.
References · 14
- 2020Fourier Features Let Networks Learn High Frequency Functions in Low Dimensional Domainscited by 2,170
- 2017Deep Interest Network for Click-Through Rate Predictioncited by 541
- 2018Deep Interest Evolution Network for Click-Through Rate Predictioncited by 336
- 2020Search-based User Interest Modeling with Lifelong Sequential Behavior Data for Click-Through Rate Predictioncited by 176
- 2019MeLU: Meta-Learned User Preference Estimator for Cold-Start Recommendationcited by 119
- 2022BARS: Towards Open Benchmarking for Recommender Systemscited by 54
- 2023FinalMLP: An Enhanced Two-Stream MLP Model for CTR Predictioncited by 37
- 2024Perception Compressor: A Training-Free Prompt Compression Framework in Long Context Scenarioscited by 22
- 2025GMSA: Enhancing Context Compression via Group Merging and Layer Semantic Alignmentcited by 20
- 2024END4Rec: Efficient Noise-Decoupling for Multi-Behavior Sequential Recommendationcited by 19
- 2020Learning Transferrable Parameters for Long-tailed Sequential User Behavior Modelingcited by 12
- 2024Long-Sequence Recommendation Models Need Decoupled Embeddingscited by 7
Built on by
Citing papers per year: 2026: 2.
2 papers.