mlsanityData to 7 Oct 2026

Think Before Recommend: Unleashing the Latent Reasoning Power for Sequential Recommendation

arXiv 2503.22675 ↗First posted 28 Mar 2025cs.IR cs.AI cs.CLcited by 50

Not on the map. Why?

Cited by 33 in LLM reasoning, but placed by its own abstract, which didn’t fit.

Abstract (arXiv)

Sequential Recommendation (SeqRec) aims to predict the next item by capturing sequential patterns from users' historical interactions, playing a crucial role in many real-world recommender systems. However, existing approaches predominantly adopt a direct forward computation paradigm, where the final hidden state of the sequence encoder serves as the user representation. We argue that this inference paradigm, due to its limited computational depth, struggles to model the complex evolving nature of user preferences and lacks a nuanced understanding of long-tail items, leading to suboptimal performance. To address this issue, we propose ReaRec, the first inference-time computing framework for recommender systems, which enhances user representations through implicit multi-step reasoning. Specifically, ReaRec autoregressively feeds the sequence's last hidden state into the sequential recommender while incorporating special reasoning position embeddings to decouple the original item encoding space from the multi-step reasoning space. Moreover, we introduce two lightweight reasoning-based learning methods, Ensemble Reasoning Learning (ERL) and Progressive Reasoning Learning (PRL), to further effectively exploit ReaRec's reasoning potential. Extensive experiments on five public real-world datasets and different SeqRec architectures demonstrate the generality and effectiveness of our proposed ReaRec. Remarkably, post-hoc analyses reveal that ReaRec significantly elevates the performance ceiling of multiple sequential recommendation backbones by approximately 30%-50%. Thus, we believe this work can open a new and promising avenue for future research in inference-time computing for sequential recommendation.

Key facts. Cited by 50 papers in the map (data through 7 Oct 2026). Builds on 53 of its 79 references that are in the map. First posted on arXiv 28 Mar 2025.

Builds on

53 of 79 references.

References · 53

  1. 2017Attention Is All You Needcited by 59,932
  2. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  3. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  4. 2024The Llama 3 Herd of Modelscited by 14,192
  5. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
  6. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
  7. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
  8. 2023Let's Verify Step by Stepcited by 3,598
  9. 2024Scaling LLM Test-Time Compute Optimally can be More Effective than Scaling Model Parameterscited by 1,928
  10. 2020Linformer: Self-Attention with Linear Complexitycited by 1,462
  11. 2025Kimi k1.5: Scaling Reinforcement Learning with LLMscited by 1,193
  12. 2018Self-Attentive Sequential Recommendationcited by 1,169
38 more
  1. 2024DeepSeek-Coder: When the Large Language Model Meets Programming -- The Rise of Code Intelligencecited by 1,154
  2. 2019BERT4Rec: Sequential Recommendation with Bidirectional Encoder Representations from Transformercited by 952
  3. 2020What Makes for Good Views for Contrastive Learning?cited by 843
  4. 2024Training Large Language Models to Reason in a Continuous Latent Spacecited by 763
  5. 2015Session-based Recommendations with Recurrent Neural Networkscited by 685
  6. 2022ZeroQuant: Efficient and Affordable Post-Training Quantization for Large-Scale Transformerscited by 517
  7. 2018Personalized Top-N Sequential Recommendation via Convolutional Sequence Embeddingcited by 473
  8. 2024Improve Mathematical Reasoning in Language Models by Automated Process Supervisioncited by 426
  9. 2025Towards Reasoning Era: A Survey of Long Chain-of-Thought for Reasoning Large Language Modelscited by 381
  10. 2025Scaling up Test-Time Compute with Latent Reasoning: A Recurrent Depth Approachcited by 372
  11. 2019On Mutual Information Maximization for Representation Learningcited by 315
  12. 2023Towards Revealing the Mystery behind Chain of Thought: A Theoretical Perspectivecited by 293
  13. 2024Rewarding Progress: Scaling Automated Process Verifiers for LLM Reasoningcited by 267
  14. 2023Navigate through Enigmatic Labyrinth A Survey of Chain of Thought Reasoning: Advances, Frontiers and Futurecited by 184
  15. 2021Are Graph Augmentations Necessary? Simple Graph Contrastive Learning for Recommendationcited by 173
  16. 2016Fusing Similarity Models with Markov Chains for Sparse Sequential Recommendationcited by 152
  17. 2023Text Is All You Need: Learning Language Representations for Sequential Recommendationcited by 149
  18. 2025LLM Post-Training: A Deep Dive into Reasoning Large Language Modelscited by 129
  19. 2019Behavior Sequence Transformer for E-commerce Recommendation in Alibabacited by 128
  20. 2023Where to Go Next for Recommender Systems? ID- vs. Modality-based Recommender Models Revisitedcited by 124
  21. 2018A Simple Convolutional Generative Network for Next Item Recommendationcited by 120
  22. 2022Towards Universal Sequence Representation Learning for Recommender Systemscited by 120
  23. 2019Sequential Recommender Systems: Challenges, Progress and Prospectscited by 115
  24. 2022Learning Vector-Quantized Item Representation for Transferable Sequential Recommenderscited by 112
  25. 2025SoftCoT: Soft Chain-of-Thought for Efficient Reasoning with LLMscited by 110
  26. 2022Intent Contrastive Learning for Sequential Recommendationcited by 90
  27. 2025Efficient Reasoning with Hidden Thinkingcited by 72
  28. 2024Language Models are Hidden Reasoners: Unlocking Latent Reasoning Capabilities via Self-Rewardingcited by 53
  29. 2021Zero-Shot Recommender Systemscited by 45
  30. 2022Multi-Behavior Hypergraph-Enhanced Transformer for Sequential Recommendationcited by 42
  31. 2023Debiased Contrastive Learning for Sequential Recommendationcited by 38
  32. 2019CosRec: 2D Convolutional Neural Networks for Sequential Recommendationcited by 37
  33. 2021Sparse-Interest Network for Sequential Recommendationcited by 37
  34. 2023gSASRec: Reducing Overconfidence in Sequential Recommendation Trained with Negative Samplingcited by 29
  35. 2024Breaking the Length Barrier: LLM-Enhanced CTR Prediction in Long Textual User Behaviorscited by 23
  36. 2023Understanding Contrastive Learning via Distributionally Robust Optimizationcited by 21
  37. 2021Sequential Modeling with Multiple Attributes for Watchlist Recommendation in E-Commercecited by 7
  38. 2025RALLRec: Improving Retrieval Augmented Large Language Model Recommendation with Representation Learningcited by 5

50 most cited of 53 All 53 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 24; 2026: 26.

50 papers.

Sort:

By area:

  1. 2025Reasoning Beyond Language: A Comprehensive Survey on Latent Chain-of-Thought Reasoningcited by 72
  2. 2025OneRec-Think: In-Text Reasoning for Generative Recommendationcited by 47
  3. 2025Reinforced Latent Reasoning for LLM-based Recommendationcited by 46
  4. 2025Implicit Reasoning in Large Language Models: A Comprehensive Surveycited by 42
  5. 2025Think-While-Generating: On-the-Fly Reasoning for Personalized Long-Form Generationcited by 29
  6. 2025Retrieval Augmented Generation with Collaborative Filtering for Personalized Text Generationcited by 23
  7. 2025OnePiece: Bringing Context Engineering and Reasoning to Industrial Cascade Ranking Systemcited by 18
  8. 2025PRIME: Large Language Model Personalization with Cognitive Dual-Memory and Personalized Thought Processcited by 16
  9. 2026Reasoning over Semantic IDs Enhances Generative Recommendationcited by 12
  10. 2025Slow Thinking for Sequential Recommendationcited by 11
  11. 2025ThinkRec: Thinking-based recommendation via LLMcited by 11
  12. 2025Interactive Recommendation Agent with Active User Commandscited by 10
38 more
  1. 2026Toward Personalized LLM-Powered Agents: Foundations, Evaluation, and Future Directionscited by 10
  2. 2025MR.Rec: Synergizing Memory and Reasoning for Personalized Recommendation Assistant with LLMscited by 9
  3. 2025LLaDA-Rec: Discrete Diffusion for Parallel Semantic ID Generation in Generative Recommendationcited by 9
  4. 2026Why Thinking Hurts: Diagnosing and Rectifying Linguistic Inertia in Large Language Models for Recommendationcited by 9
  5. 2025RecGPT-V2 Technical Reportcited by 8
  6. 2025Efficient Post-Training Refinement of Latent Reasoning in Large Language Modelscited by 7
  7. 2025Generative Reasoning Recommendation via LLMscited by 5
  8. 2026S2GR: Stepwise Semantic-Guided Reasoning in Latent Space for Generative Recommendationcited by 5
  9. 2025Act-With-Think: Chunk Auto-Regressive Modeling for Generative Recommendationcited by 4
  10. 2026Think When Needed: Model-Aware Reasoning Routing for LLM-based Rankingcited by 4
  11. 2026Implicit Reasoning for Large Language Model-based Generative Recommendationcited by 4
  12. 2026Factorized Latent Reasoning for LLM-based Recommendationcited by 3
  13. 2025Navigating Through Paper Flood: Advancing LLM-based Paper Evaluation through Domain-Aware Retrieval and Latent Reasoningcited by 2
  14. 2025Let Multimodal Embedders Learn When to Augment Query via Adaptive Query Augmentationcited by 2
  15. 2025SCoTER: Structured Chain-of-Thought Transfer for Enhanced Recommendationcited by 2
  16. 2026Verifiable Reasoning for LLM-based Generative Recommendationcited by 2
  17. 2026SOLARIS: Speculative Offloading of Latent-bAsed Representation for Inference Scalingcited by 2
  18. 2026SAPO: Step-Aligned Policy Optimization for Reasoning-Based Generative Recommendationcited by 2
  19. 2026HoloRec: Holistic Encoding and Interleaved Reasoning for Generative Recommendationcited by 2
  20. 2025DeepRec: Towards a Deep Dive Into the Item Space with Large Language Model Based Recommendationcited by 1
  21. 2025MGFRec: Towards Reinforced Reasoning Recommendation with Multiple Groundings and Feedbackcited by 1
  22. 2025DTRec: Learning Dynamic Reasoning Trajectories for Sequential Recommendationcited by 1
  23. 2026SAGE: Sequence-level Adaptive Gradient Evolution for Generative Recommendationcited by 1
  24. 2026BEAR: Towards Beam-Search-Aware Optimization for Recommendation with Large Language Modelscited by 1
  25. 2026LASAR: Latent Adaptive Semantic Aligned Reasoning for Generative Recommendationcited by 1
  26. 2025ReaSeq: Unleashing World Knowledge via Reasoning for Sequential Modelingcited by 0
  27. 2026Reasoning While Recommending: Entropy-Guided Latent Reasoning in Generative Re-ranking Modelscited by 0
  28. 2026DisenReason: Behavior Disentanglement and Latent Reasoning for Shared-Account Sequential Recommendationcited by 0
  29. 2026AgenticRec: A Recommendation-Oriented Agentic Framework with Progressive Tool-Integrated Reasoning Optimizationcited by 0
  30. 2026ClusterRAG: Cluster-Based Collaborative Filtering for Personalized Retrieval-Augmented Generationcited by 0
  31. 2026Generative Spatiotemporal Intent Sequence Recommendation via Implicit Reasoning in Amapcited by 0
  32. 2026RecRec: Recursive Refinement for Sequential Recommendationcited by 0
  33. 2026LaRec: Unleashing LLM-based Latent Reasoning for Generative Recommendationcited by 0
  34. 2026The Disconnect Between Better Descriptive Reasoning Trace Quality and Recommendation Effectivenesscited by 0
  35. 2026Adaptive Item-based Collaborative Structures via Noise Rescheduling in Diffusion for Generative Recommendationcited by 0
  36. 2026TATK: Triple-Aware Top-K Learning with Knowledge-Grounded Verification for LLM-based Sequential Recommendationcited by 0
  37. 2026Learning Better Reasoning for Generative Recommendation with Semantic IDscited by 0
  38. 2026From Interests to Semantic IDs: Retrieval-Grounded Credit Assignment for Generative Recommendationcited by 0