SelfDR: Self-Distillation from Reasoning for LLM-Based Recommendation
On the map: LLM reasoning → LLM reasoning for recommendation
Abstract (arXiv)
Large Language Models (LLMs) have recently emerged as powerful backbones for recommendation. To better elicit their capabilities, reasoning has been widely incorporated to help LLMs interpret rich textual signals and improve recommendation accuracy. However, explicitly generating intermediate reasoning traces often incurs substantial computational costs, which limits practical deployment in real-world recommender systems. To address this challenge, we propose SelfDR, a Self-Distillation from Reasoning framework for LLM-based Recommendation. SelfDR distills an LLM's own reasoning-enhanced predictions to produce recommendations directly, improving recommendation effectiveness while maintaining inference efficiency. All components in the framework are built on the same base LLM, without relying on any external models. Specifically, the teacher recommender is constructed by training a reasoner with downstream performance as the reward, enabling it to generate targeted rationales that are later incorporated into the teacher's input. A student recommender for direct recommendation, with the same underlying model, then learns from the teacher through self-distillation with a dynamic weighting strategy. Extensive experiments on three public datasets validate the effectiveness, rationality, and efficiency of SelfDR. Codes are available at https://github.com/JiangDeccc/SelfDistillation.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in LLM reasoning for recommendation, one of 17 directions in LLM reasoning. Builds on 17 of its 60 references that are in the map. First posted on arXiv 3 Sep 2026.
Builds on
17 of 60 references.
Closest ancestors · 2
Same direction, newest first
- 2025Slow Thinking for Sequential Recommendation13 Apr
- 2025Reason4Rec: Deliberative User Preference Alignment of Large Language Models for Recommendation4 Feb
Other references · 15
- 2015Distilling the Knowledge in a Neural Networkcited by 10,076
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
- 2014FitNets: Hints for Thin Deep Netscited by 1,619
- 2024M3-Embedding: Multi-Linguality, Multi-Functionality, Multi-Granularity Text Embeddings Through Self-Knowledge Distillationcited by 1,050
- 2019Be Your Own Teacher: Improve the Performance of Convolutional Neural Networks via Self Distillationcited by 491
- 2024A Survey on Knowledge Distillation of Large Language Modelscited by 276
- 2023Adapting Large Language Models by Integrating Collaborative Semantics for Recommendationcited by 171
- 2023LlamaRec: Two-Stage Recommendation using Large Language Models for Rankingcited by 52
- 2025Lyra: Generative 3D Scene Reconstruction via Video Diffusion Model Self-Distillationcited by 37
- 2025Rec-R1: Bridging Generative Large Language Models and User-Centric Recommendation Systems via Reinforcement Learningcited by 32
- 2024DotaMath: Decomposition of Thought with Code Assistance and Self-correction for Mathematical Reasoningcited by 19
- 2024A Comprehensive Review of Knowledge Distillation in Computer Visioncited by 10
3 more
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Reason-to-Recommend: Using Interaction-of-Thought Reasoning to Enhance LLM Recommendation
- 2024Can Small Language Models be Good Reasoners for Sequential Recommendation?
- 2024Leveraging LLM Reasoning Enhances Personalized Recommender Systems
- 2023Enhancing Recommender Systems with Large Language Model Reasoning Graphs
- 2024ReasoningRec: Bridging Personalized Recommendations and Human-Interpretable Explanations through LLM Reasoning
- 2024Distillation Matters: Empowering Sequential Recommenders to Match the Performance of Large Language Model
- 2025Selective LLM-Guided Regularization for Enhancing Recommendation Models
- 2026Reasoning to Rank: An End-to-End Solution for Exploiting Large Language Models for Recommendation