Breaking Determinism: Fuzzy Modeling of Sequential Recommendation Using Discrete State Space Diffusion Model
Not on the map. Why?
Abstract (arXiv)
Sequential recommendation (SR) aims to predict items that users may be interested in based on their historical behavior sequences. We revisit SR from a novel information-theoretic perspective and find that conventional sequential modeling methods fail to adequately capture the randomness and unpredictability of user behavior. Inspired by fuzzy information processing theory, this paper introduces the DDSR model, which uses fuzzy sets of interaction sequences to overcome the limitations and better capture the evolution of users' real interests. Formally based on diffusion transition processes in discrete state spaces, which is unlike common diffusion models such as DDPM that operate in continuous domains. It is better suited for discrete data, using structured transitions instead of arbitrary noise introduction to avoid information loss. Additionally, to address the inefficiency of matrix transformations due to the vast discrete space, we use semantic labels derived from quantization or RQ-VAE to replace item IDs, enhancing efficiency and improving cold start issues. Testing on three public benchmark datasets shows that DDSR outperforms existing state-of-the-art methods in various settings, demonstrating its potential and effectiveness in handling SR tasks.
Key facts. Cited by 11 papers in the map (data through 7 Oct 2026). Builds on 43 of its 56 references that are in the map. First posted on arXiv 31 Oct 2024.
Builds on
43 of 56 references.
References · 43
- 2017Attention Is All You Needcited by 59,932
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
- 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
- 2017Neural Discrete Representation Learningcited by 4,650
- 2022Imagen Video: High Definition Video Generation with Diffusion Modelscited by 1,765
- 2021Structured Denoising Diffusion Models in Discrete State-Spacescited by 1,665
- 2017Quantization and Training of Neural Networks for Efficient Integer-Arithmetic-Only Inferencecited by 1,548
- 2018Self-Attentive Sequential Recommendationcited by 1,169
- 2019BERT4Rec: Sequential Recommendation with Bidirectional Encoder Representations from Transformercited by 952
- 2021Vector Quantized Diffusion Model for Text-to-Image Synthesiscited by 773
31 more
- 2022Autoregressive Image Generation using Residual Quantizationcited by 706
- 2015Session-based Recommendations with Recurrent Neural Networkscited by 685
- 2021Argmax Flows and Multinomial Diffusion: Learning Categorical Distributionscited by 566
- 2018Personalized Top-N Sequential Recommendation via Convolutional Sequence Embeddingcited by 473
- 2023A Survey on Large Language Models for Recommendationcited by 378
- 2021Autoregressive Denoising Diffusion Models for Multivariate Probabilistic Time Series Forecastingcited by 332
- 2020S^3-Rec: Self-Supervised Learning for Sequential Recommendation with Mutual Information Maximizationcited by 311
- 2023Recommender Systems with Generative Retrievalcited by 191
- 2016Fusing Similarity Models with Markov Chains for Sparse Sequential Recommendationcited by 152
- 2023Text Is All You Need: Learning Language Representations for Sequential Recommendationcited by 149
- 2022Towards Universal Sequence Representation Learning for Recommender Systemscited by 120
- 2022Learning Vector-Quantized Item Representation for Transferable Sequential Recommenderscited by 112
- 2017Fast Matrix Factorization for Online Recommendation with Implicit Feedbackcited by 100
- 2020Controllable Multi-Interest Framework for Recommendationcited by 92
- 2023DiffuRec: A Diffusion Model for Sequential Recommendationcited by 91
- 2022Intent Contrastive Learning for Sequential Recommendationcited by 90
- 2023Leveraging Large Language Models for Sequential Recommendationcited by 78
- 2023Generate What You Prefer: Reshaping Sequential Recommendation via Guided Diffusioncited by 72
- 2024Entropy Law: The Story Behind Data Compression and LLM Performancecited by 42
- 2019MCNE: An End-to-End Framework for Learning Multiple Conditional Network Representations of Social Networkcited by 31
- 2021Adversarial and Contrastive Variational Autoencoder for Sequential Recommendationcited by 28
- 2024END4Rec: Efficient Noise-Decoupling for Multi-Behavior Sequential Recommendationcited by 19
- 2024Dataset Regeneration for Sequential Recommendationcited by 19
- 2019Sequence-Aware Factorization Machines for Temporal Predictive Analyticscited by 17
- 2020Reconciling emergences: An information-theoretic approach to identify causal emergence in multivariate datacited by 16
- 2021Memory Augmented Multi-Instance Contrastive Predictive Coding for Sequential Recommendationcited by 16
- 2023APGL4SR: A Generic Framework with Adaptive and Personalized Global Collaborative Information in Sequential Recommendationcited by 10
- 2024Bridging User Dynamics: Transforming Sequential Recommendations with Schr"odinger Bridge and Diffusion Modelscited by 5
- 2024A Unified Framework for Adaptive Representation Enhancement and Inversed Learning in Cross-Domain Recommendationcited by 3
- 2024Denoising Pre-Training and Customized Prompt Learning for Efficient Multi-Behavior Sequential Recommendationcited by 3
- 2024MDAP: A Multi-view Disentangled and Adaptive Preference Learning Framework for Cross-Domain Recommendationcited by 1
Built on by
Citing papers per year: 2025: 8; 2026: 3.
11 papers.
- 2025TD3: Tucker Decomposition Based Dataset Distillation Method for Sequential Recommendationcited by 13
- 2025Masked Diffusion for Generative Recommendationcited by 5
- 2025FlowRec: Prior-Informed Flow Matching for Efficient Sequential Recommendation Generationcited by 4
- 2025Diffusion Models in Recommendation Systems: A Surveycited by 3
- 2025Fading to Grow: Growing Preference Ratios via Preference Fading Discrete Diffusion for Recommendationcited by 3
- 2025Revisiting scalable sequential recommendation with Multi-Embedding Approach and Mixture-of-Expertscited by 3
- 2025Continuous-time Discrete-space Diffusion Model for Recommendationcited by 3
- 2026Efficient Personalized Reranking with Semi-Autoregressive Generation and Online Knowledge Distillationcited by 3
- 2025Align-for-Fusion: Harmonizing Triple Preferences via Dual-oriented Diffusion for Cross-domain Sequential Recommendationcited by 1
- 2026Diffusion Language Model for Recommendationcited by 0
- 2026Eval4DiRec: A Unified and Systematic Evaluation Framework for Diffusion-based Recommender Systemscited by 0
- 2026Eval4DiRec: A Unified and Systematic Evaluation Framework for Diffusion-based Recommender Systems28 Sep 2026
- 2026Diffusion Language Model for Recommendation23 Jul 2026
- 2026Efficient Personalized Reranking with Semi-Autoregressive Generation and Online Knowledge Distillation7 Mar 2026
- 2025Masked Diffusion for Generative Recommendation28 Nov 2025
- 2025Continuous-time Discrete-space Diffusion Model for Recommendation15 Nov 2025
- 2025Revisiting scalable sequential recommendation with Multi-Embedding Approach and Mixture-of-Experts29 Oct 2025
- 2025Fading to Grow: Growing Preference Ratios via Preference Fading Discrete Diffusion for Recommendation30 Sep 2025
- 2025FlowRec: Prior-Informed Flow Matching for Efficient Sequential Recommendation Generation25 Aug 2025
- 2025Align-for-Fusion: Harmonizing Triple Preferences via Dual-oriented Diffusion for Cross-domain Sequential Recommendation7 Aug 2025
- 2025TD3: Tucker Decomposition Based Dataset Distillation Method for Sequential Recommendation5 Feb 2025
- 2025Diffusion Models in Recommendation Systems: A Survey17 Jan 2025
Similar, not cited
Close in wording, no citation either way
- 2026From Agnostic to Specific: Latent Preference Diffusion for Multi-Behavior Sequential Recommendation
- 2023Diffusion Augmentation for Sequential Recommendation
- 2024EchoMamba4Rec: Harmonizing Bidirectional State Space Models with Spectral Filtering for Advanced Sequential Recommendation
- 2025Distinguished Quantized Guidance for Diffusion-based Sequence Recommendation
- 2024Dual Conditional Diffusion Models for Sequential Recommendation
- 2024The Elephant in the Room: Rethinking the Usage of Pre-trained Language Model in Sequential Recommendation
- 2024A Survey on Diffusion Models for Recommender Systems
- 2023Discrete Conditional Diffusion for Reranking in Recommendation