mlsanityData to 7 Oct 2026

Breaking Determinism: Fuzzy Modeling of Sequential Recommendation Using Discrete State Space Diffusion Model

arXiv 2410.23994 ↗First posted 31 Oct 2024cs.LGcited by 11

Not on the map. Why?

Abstract (arXiv)

Sequential recommendation (SR) aims to predict items that users may be interested in based on their historical behavior sequences. We revisit SR from a novel information-theoretic perspective and find that conventional sequential modeling methods fail to adequately capture the randomness and unpredictability of user behavior. Inspired by fuzzy information processing theory, this paper introduces the DDSR model, which uses fuzzy sets of interaction sequences to overcome the limitations and better capture the evolution of users' real interests. Formally based on diffusion transition processes in discrete state spaces, which is unlike common diffusion models such as DDPM that operate in continuous domains. It is better suited for discrete data, using structured transitions instead of arbitrary noise introduction to avoid information loss. Additionally, to address the inefficiency of matrix transformations due to the vast discrete space, we use semantic labels derived from quantization or RQ-VAE to replace item IDs, enhancing efficiency and improving cold start issues. Testing on three public benchmark datasets shows that DDSR outperforms existing state-of-the-art methods in various settings, demonstrating its potential and effectiveness in handling SR tasks.

Key facts. Cited by 11 papers in the map (data through 7 Oct 2026). Builds on 43 of its 56 references that are in the map. First posted on arXiv 31 Oct 2024.

Builds on

43 of 56 references.

References · 43

  1. 2017Attention Is All You Needcited by 59,932
  2. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  3. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
  4. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
  5. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
  6. 2017Neural Discrete Representation Learningcited by 4,650
  7. 2022Imagen Video: High Definition Video Generation with Diffusion Modelscited by 1,765
  8. 2021Structured Denoising Diffusion Models in Discrete State-Spacescited by 1,665
  9. 2017Quantization and Training of Neural Networks for Efficient Integer-Arithmetic-Only Inferencecited by 1,548
  10. 2018Self-Attentive Sequential Recommendationcited by 1,169
  11. 2019BERT4Rec: Sequential Recommendation with Bidirectional Encoder Representations from Transformercited by 952
  12. 2021Vector Quantized Diffusion Model for Text-to-Image Synthesiscited by 773
31 more
  1. 2022Autoregressive Image Generation using Residual Quantizationcited by 706
  2. 2015Session-based Recommendations with Recurrent Neural Networkscited by 685
  3. 2021Argmax Flows and Multinomial Diffusion: Learning Categorical Distributionscited by 566
  4. 2018Personalized Top-N Sequential Recommendation via Convolutional Sequence Embeddingcited by 473
  5. 2023A Survey on Large Language Models for Recommendationcited by 378
  6. 2021Autoregressive Denoising Diffusion Models for Multivariate Probabilistic Time Series Forecastingcited by 332
  7. 2020S^3-Rec: Self-Supervised Learning for Sequential Recommendation with Mutual Information Maximizationcited by 311
  8. 2023Recommender Systems with Generative Retrievalcited by 191
  9. 2016Fusing Similarity Models with Markov Chains for Sparse Sequential Recommendationcited by 152
  10. 2023Text Is All You Need: Learning Language Representations for Sequential Recommendationcited by 149
  11. 2022Towards Universal Sequence Representation Learning for Recommender Systemscited by 120
  12. 2022Learning Vector-Quantized Item Representation for Transferable Sequential Recommenderscited by 112
  13. 2017Fast Matrix Factorization for Online Recommendation with Implicit Feedbackcited by 100
  14. 2020Controllable Multi-Interest Framework for Recommendationcited by 92
  15. 2023DiffuRec: A Diffusion Model for Sequential Recommendationcited by 91
  16. 2022Intent Contrastive Learning for Sequential Recommendationcited by 90
  17. 2023Leveraging Large Language Models for Sequential Recommendationcited by 78
  18. 2023Generate What You Prefer: Reshaping Sequential Recommendation via Guided Diffusioncited by 72
  19. 2024Entropy Law: The Story Behind Data Compression and LLM Performancecited by 42
  20. 2019MCNE: An End-to-End Framework for Learning Multiple Conditional Network Representations of Social Networkcited by 31
  21. 2021Adversarial and Contrastive Variational Autoencoder for Sequential Recommendationcited by 28
  22. 2024END4Rec: Efficient Noise-Decoupling for Multi-Behavior Sequential Recommendationcited by 19
  23. 2024Dataset Regeneration for Sequential Recommendationcited by 19
  24. 2019Sequence-Aware Factorization Machines for Temporal Predictive Analyticscited by 17
  25. 2020Reconciling emergences: An information-theoretic approach to identify causal emergence in multivariate datacited by 16
  26. 2021Memory Augmented Multi-Instance Contrastive Predictive Coding for Sequential Recommendationcited by 16
  27. 2023APGL4SR: A Generic Framework with Adaptive and Personalized Global Collaborative Information in Sequential Recommendationcited by 10
  28. 2024Bridging User Dynamics: Transforming Sequential Recommendations with Schr"odinger Bridge and Diffusion Modelscited by 5
  29. 2024A Unified Framework for Adaptive Representation Enhancement and Inversed Learning in Cross-Domain Recommendationcited by 3
  30. 2024Denoising Pre-Training and Customized Prompt Learning for Efficient Multi-Behavior Sequential Recommendationcited by 3
  31. 2024MDAP: A Multi-view Disentangled and Adaptive Preference Learning Framework for Cross-Domain Recommendationcited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 8; 2026: 3.

11 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026From Agnostic to Specific: Latent Preference Diffusion for Multi-Behavior Sequential Recommendation
  2. 2023Diffusion Augmentation for Sequential Recommendation
  3. 2024EchoMamba4Rec: Harmonizing Bidirectional State Space Models with Spectral Filtering for Advanced Sequential Recommendation
  4. 2025Distinguished Quantized Guidance for Diffusion-based Sequence Recommendation
  5. 2024Dual Conditional Diffusion Models for Sequential Recommendation
  6. 2024The Elephant in the Room: Rethinking the Usage of Pre-trained Language Model in Sequential Recommendation
  7. 2024A Survey on Diffusion Models for Recommender Systems
  8. 2023Discrete Conditional Diffusion for Reranking in Recommendation