SAERec: Constructing Fine-grained Interpretable Intents Priors via Sparse Autoencoders for Recommendation
On the map: Mechanistic interpretability → SAE features and their applications
Abstract (arXiv)
Intent-based recommender systems have gained significant attention for improving accuracy and interpretability by modeling the underlying motivations behind user behaviors. Most existing models derive intents directly from user sequences via clustering or prototype learning. However, they are sensitive to sequence quality, require presetting the number of intents, and lack explicit semantic grounding. These issues lead to an incomplete and coarse intent set and limit the effectiveness of recommendation. In this paper, we propose the Sparse Autoencoder for intent-based recommendation (SAERec), a novel recommender that automatically constructs a fine-grained and interpretable intent space from a textual corpus to guide recommendation. Rather than treating texts as side signals, SAERec leverages them as high information density evidence for intent construction. Specifically, we first extract a comprehensive set of fine-grained interpretable intents from the latent space of large language models (LLMs) by using a sparse autoencoder (SAE) to disentangle and interpret text embeddings, which isolates intent-related semantics from textual noise. Then, for each user, we retrieve relevant intents from this set as priors to guide recommendation. It contains personal intents matching a user's current interests and public intents capturing general item patterns shared across users (e.g., quality, price). Finally, to integrate retrieved intents into sequence modeling, we propose a multi-branch attention mechanism that captures temporal dependencies and injects both personal and public intent signals, followed by an adaptive fusion layer to construct the final user representation for recommendation. Extensive experiments on public datasets demonstrate the superiority of SAERec, consistently outperforming state-of-the-art baselines while providing human-understandable explanations.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in SAE features and their applications, one of 13 directions in Mechanistic interpretability. Builds on 31 of its 48 references that are in the map. First posted on arXiv 17 Jun 2026.
Builds on
31 of 48 references.
Closest ancestors · 3
Same direction, newest first
- 2025Sparse Autoencoders for Sequential Recommendation Models: Interpretation and Flexible Control16 Jul
- 2025Interpreting and Steering LLMs with Mutual Information-based Explanations on Sparse Autoencoders21 Feb
- 2023Sparse Autoencoders Find Highly Interpretable Features in Language Models15 Sep
Other references · 28
- 2017Attention Is All You Needcited by 60,361
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2023Qwen Technical Reportcited by 3,344
- 2018Self-Attentive Sequential Recommendationcited by 1,184
- 2019BERT Rediscovers the Classical NLP Pipelinecited by 1,059
- 2019BERT4Rec: Sequential Recommendation with Bidirectional Encoder Representations from Transformercited by 964
- 2015Image-based Recommendations on Styles and Substitutescited by 706
- 2015Session-based Recommendations with Recurrent Neural Networkscited by 695
- 2018Personalized Top-N Sequential Recommendation via Convolutional Sequence Embeddingcited by 476
- 2022Recommendation as Language Processing (RLP): A Unified Pretrain, Personalized Prompt & Predict Paradigm (P5)cited by 402
- 2019Linguistic Knowledge and Transferability of Contextual Representationscited by 383
16 more
- 2020S^3-Rec: Self-Supervised Learning for Sequential Recommendation with Mutual Information Maximizationcited by 311
- 2016Linear Algebraic Structure of Word Senses, with Applications to Polysemycited by 165
- 2023Where to Go Next for Recommender Systems? ID- vs. Modality-based Recommender Models Revisitedcited by 124
- 2021Contrastive Learning for Representation Degeneration Problem in Sequential Recommendationcited by 121
- 2021Learning Intents behind Interactions with Knowledge Graph for Recommendationcited by 94
- 2022Intent Contrastive Learning for Sequential Recommendationcited by 91
- 2022Polysemanticity and Capacity in Neural Networkscited by 77
- 2021Contrastive Self-supervised Sequential Recommendation with Robust Augmentationcited by 56
- 2021Sparse-Interest Network for Sequential Recommendationcited by 38
- 2022Efficiently Leveraging Multi-level User Intent for Session-based Recommendation via Atten-Mixer Networkcited by 38
- 2024Evaluating Open-Source Sparse Autoencoders on Disentangling Factual Knowledge in GPT-2 Smallcited by 34
- 2023Large Language Models for Intent-Driven Session Recommendationscited by 30
- 2020Explainable Recommender Systems via Resolving Learning Representationscited by 11
- 2025AlphaFuse: Learn ID Embeddings for Sequential Recommendation in Null Space of Language Embeddingscited by 10
- 2023Intent Contrastive Learning with Cross Subsequences for Sequential Recommendationcited by 9
- 2024Unleash LLMs Potential for Sequential Recommendation by Coordinating Dual Dynamic Index Mechanismcited by 8
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Tuning-Free LLM Can Build A Strong Recommender Under Sparse Connectivity And Knowledge Gap Via Extracting Intent
- 2025LLMDiRec: LLM-Enhanced Intent Diffusion for Sequential Recommendation ↗
- 2025Extracting Interaction-Aware Monosemantic Concepts in Recommender Systems
- 2025Intent-Guided Reasoning for Sequential Recommendation ↗
- 2025Improving LLM Interpretability and Performance via Guided Embedding Refinement for Sequential Recommendation
- 2026R3-REC: Reasoning-Driven Recommendation via Retrieval-Augmented LLMs over Multi-Granular Interest Signals
- 2024Multi-view Intent Learning and Alignment with Large Language Models for Session-based Recommendation
- 2026Give Users the Wheel: Towards Promptable Recommendation Paradigm