Think Before Recommend: Unleashing the Latent Reasoning Power for Sequential Recommendation
Not on the map. Why?
Cited by 33 in LLM reasoning, but placed by its own abstract, which didn’t fit.
Abstract (arXiv)
Sequential Recommendation (SeqRec) aims to predict the next item by capturing sequential patterns from users' historical interactions, playing a crucial role in many real-world recommender systems. However, existing approaches predominantly adopt a direct forward computation paradigm, where the final hidden state of the sequence encoder serves as the user representation. We argue that this inference paradigm, due to its limited computational depth, struggles to model the complex evolving nature of user preferences and lacks a nuanced understanding of long-tail items, leading to suboptimal performance. To address this issue, we propose ReaRec, the first inference-time computing framework for recommender systems, which enhances user representations through implicit multi-step reasoning. Specifically, ReaRec autoregressively feeds the sequence's last hidden state into the sequential recommender while incorporating special reasoning position embeddings to decouple the original item encoding space from the multi-step reasoning space. Moreover, we introduce two lightweight reasoning-based learning methods, Ensemble Reasoning Learning (ERL) and Progressive Reasoning Learning (PRL), to further effectively exploit ReaRec's reasoning potential. Extensive experiments on five public real-world datasets and different SeqRec architectures demonstrate the generality and effectiveness of our proposed ReaRec. Remarkably, post-hoc analyses reveal that ReaRec significantly elevates the performance ceiling of multiple sequential recommendation backbones by approximately 30%-50%. Thus, we believe this work can open a new and promising avenue for future research in inference-time computing for sequential recommendation.
Key facts. Cited by 50 papers in the map (data through 7 Oct 2026). Builds on 53 of its 79 references that are in the map. First posted on arXiv 28 Mar 2025.
Builds on
53 of 79 references.
References · 53
- 2017Attention Is All You Needcited by 59,932
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2024The Llama 3 Herd of Modelscited by 14,192
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
- 2023Let's Verify Step by Stepcited by 3,598
- 2024Scaling LLM Test-Time Compute Optimally can be More Effective than Scaling Model Parameterscited by 1,928
- 2020Linformer: Self-Attention with Linear Complexitycited by 1,462
- 2025Kimi k1.5: Scaling Reinforcement Learning with LLMscited by 1,193
- 2018Self-Attentive Sequential Recommendationcited by 1,169
38 more
- 2024DeepSeek-Coder: When the Large Language Model Meets Programming -- The Rise of Code Intelligencecited by 1,154
- 2019BERT4Rec: Sequential Recommendation with Bidirectional Encoder Representations from Transformercited by 952
- 2020What Makes for Good Views for Contrastive Learning?cited by 843
- 2024Training Large Language Models to Reason in a Continuous Latent Spacecited by 763
- 2015Session-based Recommendations with Recurrent Neural Networkscited by 685
- 2022ZeroQuant: Efficient and Affordable Post-Training Quantization for Large-Scale Transformerscited by 517
- 2018Personalized Top-N Sequential Recommendation via Convolutional Sequence Embeddingcited by 473
- 2024Improve Mathematical Reasoning in Language Models by Automated Process Supervisioncited by 426
- 2025Towards Reasoning Era: A Survey of Long Chain-of-Thought for Reasoning Large Language Modelscited by 381
- 2025Scaling up Test-Time Compute with Latent Reasoning: A Recurrent Depth Approachcited by 372
- 2019On Mutual Information Maximization for Representation Learningcited by 315
- 2023Towards Revealing the Mystery behind Chain of Thought: A Theoretical Perspectivecited by 293
- 2024Rewarding Progress: Scaling Automated Process Verifiers for LLM Reasoningcited by 267
- 2023Navigate through Enigmatic Labyrinth A Survey of Chain of Thought Reasoning: Advances, Frontiers and Futurecited by 184
- 2021Are Graph Augmentations Necessary? Simple Graph Contrastive Learning for Recommendationcited by 173
- 2016Fusing Similarity Models with Markov Chains for Sparse Sequential Recommendationcited by 152
- 2023Text Is All You Need: Learning Language Representations for Sequential Recommendationcited by 149
- 2025LLM Post-Training: A Deep Dive into Reasoning Large Language Modelscited by 129
- 2019Behavior Sequence Transformer for E-commerce Recommendation in Alibabacited by 128
- 2023Where to Go Next for Recommender Systems? ID- vs. Modality-based Recommender Models Revisitedcited by 124
- 2018A Simple Convolutional Generative Network for Next Item Recommendationcited by 120
- 2022Towards Universal Sequence Representation Learning for Recommender Systemscited by 120
- 2019Sequential Recommender Systems: Challenges, Progress and Prospectscited by 115
- 2022Learning Vector-Quantized Item Representation for Transferable Sequential Recommenderscited by 112
- 2025SoftCoT: Soft Chain-of-Thought for Efficient Reasoning with LLMscited by 110
- 2022Intent Contrastive Learning for Sequential Recommendationcited by 90
- 2025Efficient Reasoning with Hidden Thinkingcited by 72
- 2024Language Models are Hidden Reasoners: Unlocking Latent Reasoning Capabilities via Self-Rewardingcited by 53
- 2021Zero-Shot Recommender Systemscited by 45
- 2022Multi-Behavior Hypergraph-Enhanced Transformer for Sequential Recommendationcited by 42
- 2023Debiased Contrastive Learning for Sequential Recommendationcited by 38
- 2019CosRec: 2D Convolutional Neural Networks for Sequential Recommendationcited by 37
- 2021Sparse-Interest Network for Sequential Recommendationcited by 37
- 2023gSASRec: Reducing Overconfidence in Sequential Recommendation Trained with Negative Samplingcited by 29
- 2024Breaking the Length Barrier: LLM-Enhanced CTR Prediction in Long Textual User Behaviorscited by 23
- 2023Understanding Contrastive Learning via Distributionally Robust Optimizationcited by 21
- 2021Sequential Modeling with Multiple Attributes for Watchlist Recommendation in E-Commercecited by 7
- 2025RALLRec: Improving Retrieval Augmented Large Language Model Recommendation with Representation Learningcited by 5
50 most cited of 53 All 53 (JSON)
Built on by
Citing papers per year: 2025: 24; 2026: 26.
50 papers.
Sort:
By area:
- 2025Reasoning Beyond Language: A Comprehensive Survey on Latent Chain-of-Thought Reasoningcited by 72
- 2025OneRec-Think: In-Text Reasoning for Generative Recommendationcited by 47
- 2025Reinforced Latent Reasoning for LLM-based Recommendationcited by 46
- 2025Implicit Reasoning in Large Language Models: A Comprehensive Surveycited by 42
- 2025Think-While-Generating: On-the-Fly Reasoning for Personalized Long-Form Generationcited by 29
- 2025Retrieval Augmented Generation with Collaborative Filtering for Personalized Text Generationcited by 23
- 2025OnePiece: Bringing Context Engineering and Reasoning to Industrial Cascade Ranking Systemcited by 18
- 2025PRIME: Large Language Model Personalization with Cognitive Dual-Memory and Personalized Thought Processcited by 16
- 2026Reasoning over Semantic IDs Enhances Generative Recommendationcited by 12
- 2025Slow Thinking for Sequential Recommendationcited by 11
- 2025ThinkRec: Thinking-based recommendation via LLMcited by 11
- 2025Interactive Recommendation Agent with Active User Commandscited by 10
38 more
- 2026Toward Personalized LLM-Powered Agents: Foundations, Evaluation, and Future Directionscited by 10
- 2025MR.Rec: Synergizing Memory and Reasoning for Personalized Recommendation Assistant with LLMscited by 9
- 2025LLaDA-Rec: Discrete Diffusion for Parallel Semantic ID Generation in Generative Recommendationcited by 9
- 2026Why Thinking Hurts: Diagnosing and Rectifying Linguistic Inertia in Large Language Models for Recommendationcited by 9
- 2025RecGPT-V2 Technical Reportcited by 8
- 2025Efficient Post-Training Refinement of Latent Reasoning in Large Language Modelscited by 7
- 2025Generative Reasoning Recommendation via LLMscited by 5
- 2026S2GR: Stepwise Semantic-Guided Reasoning in Latent Space for Generative Recommendationcited by 5
- 2025Act-With-Think: Chunk Auto-Regressive Modeling for Generative Recommendationcited by 4
- 2026Think When Needed: Model-Aware Reasoning Routing for LLM-based Rankingcited by 4
- 2026Implicit Reasoning for Large Language Model-based Generative Recommendationcited by 4
- 2026Factorized Latent Reasoning for LLM-based Recommendationcited by 3
- 2025Navigating Through Paper Flood: Advancing LLM-based Paper Evaluation through Domain-Aware Retrieval and Latent Reasoningcited by 2
- 2025Let Multimodal Embedders Learn When to Augment Query via Adaptive Query Augmentationcited by 2
- 2025SCoTER: Structured Chain-of-Thought Transfer for Enhanced Recommendationcited by 2
- 2026Verifiable Reasoning for LLM-based Generative Recommendationcited by 2
- 2026SOLARIS: Speculative Offloading of Latent-bAsed Representation for Inference Scalingcited by 2
- 2026SAPO: Step-Aligned Policy Optimization for Reasoning-Based Generative Recommendationcited by 2
- 2026HoloRec: Holistic Encoding and Interleaved Reasoning for Generative Recommendationcited by 2
- 2025DeepRec: Towards a Deep Dive Into the Item Space with Large Language Model Based Recommendationcited by 1
- 2025MGFRec: Towards Reinforced Reasoning Recommendation with Multiple Groundings and Feedbackcited by 1
- 2025DTRec: Learning Dynamic Reasoning Trajectories for Sequential Recommendationcited by 1
- 2026SAGE: Sequence-level Adaptive Gradient Evolution for Generative Recommendationcited by 1
- 2026BEAR: Towards Beam-Search-Aware Optimization for Recommendation with Large Language Modelscited by 1
- 2026LASAR: Latent Adaptive Semantic Aligned Reasoning for Generative Recommendationcited by 1
- 2025ReaSeq: Unleashing World Knowledge via Reasoning for Sequential Modelingcited by 0
- 2026Reasoning While Recommending: Entropy-Guided Latent Reasoning in Generative Re-ranking Modelscited by 0
- 2026DisenReason: Behavior Disentanglement and Latent Reasoning for Shared-Account Sequential Recommendationcited by 0
- 2026AgenticRec: A Recommendation-Oriented Agentic Framework with Progressive Tool-Integrated Reasoning Optimizationcited by 0
- 2026ClusterRAG: Cluster-Based Collaborative Filtering for Personalized Retrieval-Augmented Generationcited by 0
- 2026Generative Spatiotemporal Intent Sequence Recommendation via Implicit Reasoning in Amapcited by 0
- 2026RecRec: Recursive Refinement for Sequential Recommendationcited by 0
- 2026LaRec: Unleashing LLM-based Latent Reasoning for Generative Recommendationcited by 0
- 2026The Disconnect Between Better Descriptive Reasoning Trace Quality and Recommendation Effectivenesscited by 0
- 2026Adaptive Item-based Collaborative Structures via Noise Rescheduling in Diffusion for Generative Recommendationcited by 0
- 2026TATK: Triple-Aware Top-K Learning with Knowledge-Grounded Verification for LLM-based Sequential Recommendationcited by 0
- 2026Learning Better Reasoning for Generative Recommendation with Semantic IDscited by 0
- 2026From Interests to Semantic IDs: Retrieval-Grounded Credit Assignment for Generative Recommendationcited by 0
- 2026From Interests to Semantic IDs: Retrieval-Grounded Credit Assignment for Generative Recommendation24 Sep 2026
- 2026Learning Better Reasoning for Generative Recommendation with Semantic IDs24 Sep 2026
- 2026TATK: Triple-Aware Top-K Learning with Knowledge-Grounded Verification for LLM-based Sequential Recommendation13 Sep 2026
- 2026Adaptive Item-based Collaborative Structures via Noise Rescheduling in Diffusion for Generative Recommendation24 Aug 2026
- 2026The Disconnect Between Better Descriptive Reasoning Trace Quality and Recommendation Effectiveness24 Aug 2026
- 2026LaRec: Unleashing LLM-based Latent Reasoning for Generative Recommendation27 Jul 2026
- 2026RecRec: Recursive Refinement for Sequential Recommendation12 Jul 2026
- 2026HoloRec: Holistic Encoding and Interleaved Reasoning for Generative Recommendation13 Jun 2026
- 2026Implicit Reasoning for Large Language Model-based Generative Recommendation12 Jun 2026
- 2026Generative Spatiotemporal Intent Sequence Recommendation via Implicit Reasoning in Amap27 May 2026
- 2026SAPO: Step-Aligned Policy Optimization for Reasoning-Based Generative Recommendation17 May 2026
- 2026LASAR: Latent Adaptive Semantic Aligned Reasoning for Generative Recommendation11 May 2026
38 more
- 2026Factorized Latent Reasoning for LLM-based Recommendation29 Apr 2026
- 2026ClusterRAG: Cluster-Based Collaborative Filtering for Personalized Retrieval-Augmented Generation14 Apr 2026
- 2026SOLARIS: Speculative Offloading of Latent-bAsed Representation for Inference Scaling13 Apr 2026
- 2026Reasoning over Semantic IDs Enhances Generative Recommendation24 Mar 2026
- 2026AgenticRec: A Recommendation-Oriented Agentic Framework with Progressive Tool-Integrated Reasoning Optimization23 Mar 2026
- 2026Verifiable Reasoning for LLM-based Generative Recommendation8 Mar 2026
- 2026DisenReason: Behavior Disentanglement and Latent Reasoning for Shared-Account Sequential Recommendation4 Mar 2026
- 2026Toward Personalized LLM-Powered Agents: Foundations, Evaluation, and Future Directions26 Feb 2026
- 2026Why Thinking Hurts: Diagnosing and Rectifying Linguistic Inertia in Large Language Models for Recommendation18 Feb 2026
- 2026BEAR: Towards Beam-Search-Aware Optimization for Recommendation with Large Language Models30 Jan 2026
- 2026SAGE: Sequence-level Adaptive Gradient Evolution for Generative Recommendation29 Jan 2026
- 2026S2GR: Stepwise Semantic-Guided Reasoning in Latent Space for Generative Recommendation26 Jan 2026
- 2026Think When Needed: Model-Aware Reasoning Routing for LLM-based Ranking26 Jan 2026
- 2026Reasoning While Recommending: Entropy-Guided Latent Reasoning in Generative Re-ranking Models20 Jan 2026
- 2025ReaSeq: Unleashing World Knowledge via Reasoning for Sequential Modeling24 Dec 2025
- 2025RecGPT-V2 Technical Report16 Dec 2025
- 2025DTRec: Learning Dynamic Reasoning Trajectories for Sequential Recommendation16 Dec 2025
- 2025Think-While-Generating: On-the-Fly Reasoning for Personalized Long-Form Generation7 Dec 2025
- 2025SCoTER: Structured Chain-of-Thought Transfer for Enhanced Recommendation24 Nov 2025
- 2025LLaDA-Rec: Discrete Diffusion for Parallel Semantic ID Generation in Generative Recommendation9 Nov 2025
- 2025Let Multimodal Embedders Learn When to Augment Query via Adaptive Query Augmentation4 Nov 2025
- 2025MGFRec: Towards Reinforced Reasoning Recommendation with Multiple Groundings and Feedback27 Oct 2025
- 2025Generative Reasoning Recommendation via LLMs23 Oct 2025
- 2025MR.Rec: Synergizing Memory and Reasoning for Personalized Recommendation Assistant with LLMs16 Oct 2025
- 2025OneRec-Think: In-Text Reasoning for Generative Recommendation13 Oct 2025
- 2025Interactive Recommendation Agent with Active User Commands25 Sep 2025
- 2025OnePiece: Bringing Context Engineering and Reasoning to Industrial Cascade Ranking System22 Sep 2025
- 2025Implicit Reasoning in Large Language Models: A Comprehensive Survey2 Sep 2025
- 2025Navigating Through Paper Flood: Advancing LLM-based Paper Evaluation through Domain-Aware Retrieval and Latent Reasoning7 Aug 2025
- 2025PRIME: Large Language Model Personalization with Cognitive Dual-Memory and Personalized Thought Process7 Jul 2025
- 2025Act-With-Think: Chunk Auto-Regressive Modeling for Generative Recommendation30 Jun 2025
- 2025Efficient Post-Training Refinement of Latent Reasoning in Large Language Models10 Jun 2025
- 2025Reinforced Latent Reasoning for LLM-based Recommendation25 May 2025
- 2025DeepRec: Towards a Deep Dive Into the Item Space with Large Language Model Based Recommendation22 May 2025
- 2025Reasoning Beyond Language: A Comprehensive Survey on Latent Chain-of-Thought Reasoning22 May 2025
- 2025ThinkRec: Thinking-based recommendation via LLM21 May 2025
- 2025Slow Thinking for Sequential Recommendation13 Apr 2025
- 2025Retrieval Augmented Generation with Collaborative Filtering for Personalized Text Generation8 Apr 2025
- 2025Reasoning Beyond Language: A Comprehensive Survey on Latent Chain-of-Thought Reasoningcited by 72
- 2025OneRec-Think: In-Text Reasoning for Generative Recommendationcited by 47
- 2025Reinforced Latent Reasoning for LLM-based Recommendationcited by 46
- 2025Implicit Reasoning in Large Language Models: A Comprehensive Surveycited by 42
- 2025Think-While-Generating: On-the-Fly Reasoning for Personalized Long-Form Generationcited by 29
- 2025OnePiece: Bringing Context Engineering and Reasoning to Industrial Cascade Ranking Systemcited by 18
- 2025PRIME: Large Language Model Personalization with Cognitive Dual-Memory and Personalized Thought Processcited by 16
- 2026Reasoning over Semantic IDs Enhances Generative Recommendationcited by 12
- 2025Slow Thinking for Sequential Recommendationcited by 11
- 2025ThinkRec: Thinking-based recommendation via LLMcited by 11
- 2025MR.Rec: Synergizing Memory and Reasoning for Personalized Recommendation Assistant with LLMscited by 9
- 2026Why Thinking Hurts: Diagnosing and Rectifying Linguistic Inertia in Large Language Models for Recommendationcited by 9
12 most cited of 33 All 33 (JSON)
- 2026The Disconnect Between Better Descriptive Reasoning Trace Quality and Recommendation Effectiveness24 Aug 2026
- 2026LaRec: Unleashing LLM-based Latent Reasoning for Generative Recommendation27 Jul 2026
- 2026HoloRec: Holistic Encoding and Interleaved Reasoning for Generative Recommendation13 Jun 2026
- 2026Implicit Reasoning for Large Language Model-based Generative Recommendation12 Jun 2026
- 2026Generative Spatiotemporal Intent Sequence Recommendation via Implicit Reasoning in Amap27 May 2026
- 2026LASAR: Latent Adaptive Semantic Aligned Reasoning for Generative Recommendation11 May 2026
- 2026Factorized Latent Reasoning for LLM-based Recommendation29 Apr 2026
- 2026Reasoning over Semantic IDs Enhances Generative Recommendation24 Mar 2026
- 2026AgenticRec: A Recommendation-Oriented Agentic Framework with Progressive Tool-Integrated Reasoning Optimization23 Mar 2026
- 2026Verifiable Reasoning for LLM-based Generative Recommendation8 Mar 2026
- 2026Why Thinking Hurts: Diagnosing and Rectifying Linguistic Inertia in Large Language Models for Recommendation18 Feb 2026
- 2026S2GR: Stepwise Semantic-Guided Reasoning in Latent Space for Generative Recommendation26 Jan 2026
12 newest of 33 All 33 (JSON)
- 2025Interactive Recommendation Agent with Active User Commandscited by 10
- 2025RecGPT-V2 Technical Reportcited by 8
- 2025Let Multimodal Embedders Learn When to Augment Query via Adaptive Query Augmentationcited by 2
- 2026SOLARIS: Speculative Offloading of Latent-bAsed Representation for Inference Scalingcited by 2
- 2026SAPO: Step-Aligned Policy Optimization for Reasoning-Based Generative Recommendationcited by 2
- 2026BEAR: Towards Beam-Search-Aware Optimization for Recommendation with Large Language Modelscited by 1
- 2026DisenReason: Behavior Disentanglement and Latent Reasoning for Shared-Account Sequential Recommendationcited by 0
- 2026RecRec: Recursive Refinement for Sequential Recommendationcited by 0
- 2026TATK: Triple-Aware Top-K Learning with Knowledge-Grounded Verification for LLM-based Sequential Recommendationcited by 0
- 2026Learning Better Reasoning for Generative Recommendation with Semantic IDscited by 0
- 2026From Interests to Semantic IDs: Retrieval-Grounded Credit Assignment for Generative Recommendationcited by 0
- 2026From Interests to Semantic IDs: Retrieval-Grounded Credit Assignment for Generative Recommendation24 Sep 2026
- 2026Learning Better Reasoning for Generative Recommendation with Semantic IDs24 Sep 2026
- 2026TATK: Triple-Aware Top-K Learning with Knowledge-Grounded Verification for LLM-based Sequential Recommendation13 Sep 2026
- 2026RecRec: Recursive Refinement for Sequential Recommendation12 Jul 2026
- 2026SAPO: Step-Aligned Policy Optimization for Reasoning-Based Generative Recommendation17 May 2026
- 2026SOLARIS: Speculative Offloading of Latent-bAsed Representation for Inference Scaling13 Apr 2026
- 2026DisenReason: Behavior Disentanglement and Latent Reasoning for Shared-Account Sequential Recommendation4 Mar 2026
- 2026BEAR: Towards Beam-Search-Aware Optimization for Recommendation with Large Language Models30 Jan 2026
- 2025RecGPT-V2 Technical Report16 Dec 2025
- 2025Let Multimodal Embedders Learn When to Augment Query via Adaptive Query Augmentation4 Nov 2025
- 2025Interactive Recommendation Agent with Active User Commands25 Sep 2025