mlsanityData to 7 Oct 2026

SelfDR: Self-Distillation from Reasoning for LLM-Based Recommendation

arXiv 2609.03313 ↗First posted 3 Sep 2026cs.IRcited by 0

On the map: LLM reasoning → LLM reasoning for recommendation

Abstract (arXiv)

Large Language Models (LLMs) have recently emerged as powerful backbones for recommendation. To better elicit their capabilities, reasoning has been widely incorporated to help LLMs interpret rich textual signals and improve recommendation accuracy. However, explicitly generating intermediate reasoning traces often incurs substantial computational costs, which limits practical deployment in real-world recommender systems. To address this challenge, we propose SelfDR, a Self-Distillation from Reasoning framework for LLM-based Recommendation. SelfDR distills an LLM's own reasoning-enhanced predictions to produce recommendations directly, improving recommendation effectiveness while maintaining inference efficiency. All components in the framework are built on the same base LLM, without relying on any external models. Specifically, the teacher recommender is constructed by training a reasoner with downstream performance as the reward, enabling it to generate targeted rationales that are later incorporated into the teacher's input. A student recommender for direct recommendation, with the same underlying model, then learns from the teacher through self-distillation with a dynamic weighting strategy. Extensive experiments on three public datasets validate the effectiveness, rationality, and efficiency of SelfDR. Codes are available at https://github.com/JiangDeccc/SelfDistillation.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in LLM reasoning for recommendation, one of 17 directions in LLM reasoning. Builds on 17 of its 60 references that are in the map. First posted on arXiv 3 Sep 2026.

Builds on

17 of 60 references.

Closest ancestors · 2

Same direction, newest first

  1. 2025Slow Thinking for Sequential Recommendation13 Apr
  2. 2025Reason4Rec: Deliberative User Preference Alignment of Large Language Models for Recommendation4 Feb

Other references · 15

  1. 2015Distilling the Knowledge in a Neural Networkcited by 10,076
  2. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
  3. 2014FitNets: Hints for Thin Deep Netscited by 1,619
  4. 2024M3-Embedding: Multi-Linguality, Multi-Functionality, Multi-Granularity Text Embeddings Through Self-Knowledge Distillationcited by 1,050
  5. 2019Be Your Own Teacher: Improve the Performance of Convolutional Neural Networks via Self Distillationcited by 491
  6. 2024A Survey on Knowledge Distillation of Large Language Modelscited by 276
  7. 2023Adapting Large Language Models by Integrating Collaborative Semantics for Recommendationcited by 171
  8. 2023LlamaRec: Two-Stage Recommendation using Large Language Models for Rankingcited by 52
  9. 2025Lyra: Generative 3D Scene Reconstruction via Video Diffusion Model Self-Distillationcited by 37
  10. 2025Rec-R1: Bridging Generative Large Language Models and User-Centric Recommendation Systems via Reinforcement Learningcited by 32
  11. 2024DotaMath: Decomposition of Thought with Code Assistance and Self-correction for Mathematical Reasoningcited by 19
  12. 2024A Comprehensive Review of Knowledge Distillation in Computer Visioncited by 10
3 more
  1. 2025Bidirectional Knowledge Distillation for Enhancing Sequential Recommendation with Large Language Modelscited by 4
  2. 2025Bridging the Gap: Self-Optimized Fine-Tuning for LLM-based Recommender Systemscited by 2
  3. 2024Feature Interaction Fusion Self-Distillation Network For CTR Predictioncited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Reason-to-Recommend: Using Interaction-of-Thought Reasoning to Enhance LLM Recommendation
  2. 2024Can Small Language Models be Good Reasoners for Sequential Recommendation?
  3. 2024Leveraging LLM Reasoning Enhances Personalized Recommender Systems
  4. 2023Enhancing Recommender Systems with Large Language Model Reasoning Graphs
  5. 2024ReasoningRec: Bridging Personalized Recommendations and Human-Interpretable Explanations through LLM Reasoning
  6. 2024Distillation Matters: Empowering Sequential Recommenders to Match the Performance of Large Language Model
  7. 2025Selective LLM-Guided Regularization for Enhancing Recommendation Models
  8. 2026Reasoning to Rank: An End-to-End Solution for Exploiting Large Language Models for Recommendation