mlsanityData to 7 Oct 2026

Fading to Grow: Growing Preference Ratios via Preference Fading Discrete Diffusion for Recommendation

arXiv 2509.26063 ↗First posted 30 Sep 2025cs.IRcited by 3

On the map: Diffusion models → Diffusion recommenders

Abstract (arXiv)

Recommenders aim to rank items from a discrete item corpus in line with user interests, yet suffer from extremely sparse user preference data. Recent advances in diffusion models have inspired diffusion-based recommenders, which alleviate sparsity by injecting noise during a forward process to prevent the collapse of perturbed preference distributions. However, current diffusion-based recommenders predominantly rely on continuous Gaussian noise, which is intrinsically mismatched with the discrete nature of user preference data in recommendation. In this paper, building upon recent advances in discrete diffusion, we propose PreferGrow, a discrete diffusion-based recommender system that models preference ratios by fading and growing user preferences over the discrete item corpus. PreferGrow differs from existing diffusion-based recommenders in three core aspects: (1) Discrete modeling of preference ratios: PreferGrow models relative preference ratios between item pairs, rather than operating in the item representation or raw score simplex. This formulation aligns naturally with the discrete and ranking-oriented nature of recommendation tasks. (2) Perturbing via preference fading: Instead of injecting continuous noise, PreferGrow fades user preferences by replacing the preferred item with alternatives -- physically akin to negative sampling -- thereby eliminating the need for any prior noise assumption. (3) Preference reconstruction via growing: PreferGrow reconstructs user preferences by iteratively growing the preference signals from the estimated ratios. PreferGrow offers a well-defined matrix-based formulation with theoretical guarantees on Markovianity and reversibility, and it demonstrates consistent performance gains over state-of-the-art diffusion-based recommenders across five benchmark datasets, highlighting both its theoretical soundness and empirical effectiveness.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Placed in Diffusion recommenders, one of 14 directions in Diffusion models. Builds on 65 of its 75 references that are in the map. First posted on arXiv 30 Sep 2025.

Builds on

65 of 75 references.

Closest ancestors · 21

Same direction, newest first

  1. 2025Addressing Missing Data Issue for Diffusion-based Recommendation18 May
  2. 2025Diffusion-augmented Graph Contrastive Learning for Collaborative Filter20 Mar
  3. 2025Distinguished Quantized Guidance for Diffusion-based Sequence Recommendation29 Jan
  4. 2025Distributionally Robust Graph Out-of-Distribution Recommendation via Diffusion Model26 Jan
  5. 2025Exploring Preference-Guided Diffusion Model for Cross-Domain Recommendation20 Jan
  6. 2024S-Diff: An Anisotropic Diffusion Model for Collaborative Filtering in Spectral Domain31 Dec
  7. 2024Generative Diffusion Models for Sequential Recommendations25 Oct
  8. 2024Generate and Instantiate What You Prefer: Text-Guided Diffusion for Sequential Recommendation17 Oct
  9. 2024DimeRec: A Unified Framework for Enhanced Sequential Recommendation via Generative Diffusion Models22 Aug
  10. 2024DiffMM: Multi-Modal Diffusion Model for Recommendation17 Jun
  11. 2024Collaborative Filtering Based on Diffusion Models: Unveiling the Potential of High-Order Connectivity22 Apr
  12. 2024A Directional Diffusion Graph Transformer for Recommendation4 Apr
9 more
  1. 2024Denoising Diffusion Recommender Model13 Jan
  2. 2024Plug-in Diffusion Model for Sequential Recommendation5 Jan
  3. 2023Generate What You Prefer: Reshaping Sequential Recommendation via Guided Diffusion31 Oct
  4. 2023LD4MRec: Simplifying and Powering Diffusion Model for Multimedia Recommendation27 Sep
  5. 2023Diffusion Augmentation for Sequential Recommendation22 Sep
  6. 2023RecFusion: A Binomial Diffusion Process for 1D Data for Recommendation15 Jun
  7. 2023Conditional Denoising Diffusion for Sequential Recommendation22 Apr
  8. 2023Sequential Recommendation with Diffusion Models10 Apr
  9. 2023DiffuRec: A Diffusion Model for Sequential Recommendation3 Apr

Other references · 44

  1. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  2. 2020Denoising Diffusion Implicit Modelscited by 9,655
  3. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
  4. 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
  5. 2022Classifier-Free Diffusion Guidancecited by 5,717
  6. 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,581
  7. 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,067
  8. 2022Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedbackcited by 3,634
  9. 2021Structured Denoising Diffusion Models in Discrete State-Spacescited by 1,665
  10. 2018Self-Attentive Sequential Recommendationcited by 1,169
  11. 2020LightGCN: Simplifying and Powering Graph Convolution Network for Recommendationcited by 1,134
  12. 2019BERT4Rec: Sequential Recommendation with Bidirectional Encoder Representations from Transformercited by 952
32 more
  1. 2023Discrete Diffusion Modeling by Estimating the Ratios of the Data Distributioncited by 712
  2. 2015Image-based Recommendations on Styles and Substitutescited by 702
  3. 2015Session-based Recommendations with Recurrent Neural Networkscited by 685
  4. 2024Simplified and Generalized Masked Diffusion for Discrete Datacited by 606
  5. 2018Personalized Top-N Sequential Recommendation via Convolutional Sequence Embeddingcited by 473
  6. 2022A Continuous Time Framework for Discrete Denoising Modelscited by 437
  7. 2024Your Absorbing Discrete Diffusion Secretly Models the Conditional Distributions of Clean Datacited by 371
  8. 2023Iterative Preference Learning from Human Feedback: Bridging Theory and Practice for RLHF under KL-Constraintcited by 346
  9. 2022Understanding Diffusion Models: A Unified Perspectivecited by 337
  10. 2020Self-supervised Graph Learning for Recommendationcited by 305
  11. 2024Generative Flows on Discrete State-Spaces: Enabling Multimodal Flows with Applications to Protein Co-Designcited by 294
  12. 2024RLHF Workflow: From Reward Modeling to Online RLHFcited by 265
  13. 2024Masked Diffusion Models are Secretly Time-Agnostic Masked Models and Exploit Inaccurate Categorical Samplingcited by 204
  14. 2023Recommender Systems with Generative Retrievalcited by 191
  15. 2022Score-based Continuous-time Discrete Diffusion Modelscited by 167
  16. 2023Representation Learning with Large Language Models for Recommendationcited by 155
  17. 2023Text Is All You Need: Learning Language Representations for Sequential Recommendationcited by 149
  18. 2022Concrete Score Matching: Generalized Score Matching for Discrete Datacited by 144
  19. 2024β-DPO: Direct Preference Optimization with Dynamic βcited by 89
  20. 2023Diffusion Recommender Modelcited by 87
  21. 2024On Softmax Direct Preference Optimization for Recommendationcited by 64
  22. 2020A Critical Study on Data Leakage in Recommender System Offline Evaluationcited by 38
  23. 2020Overcoming Data Sparsity in Group Recommendationcited by 22
  24. 2025ActionPiece: Contextually Tokenizing Action Sequences for Generative Recommendationcited by 18
  25. 2022Exploiting Data Sparsity in Secure Cross-Platform Social Recommendationcited by 17
  26. 2025Generating with Fairness: A Modality-Diffused Counterfactual Framework for Incomplete Multimodal Recommendationscited by 12
  27. 2024Breaking Determinism: Fuzzy Modeling of Sequential Recommendation Using Discrete State Space Diffusion Modelcited by 11
  28. 2024Preference Diffusion for Recommendationcited by 8
  29. 2024Controlling Diversity at Inference: Guiding Diffusion Recommender Models with Targeted Category Preferencescited by 4
  30. 2024Diffusion Cross-domain Recommendationcited by 3
  31. 2024EDGE-Rec: Efficient and Data-Guided Edge Diffusion For Recommender Systems Graphscited by 2
  32. 2024DifFaiRec: Generative Fair Recommender with Conditional Diffusion Modelcited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 3.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2024A Survey on Diffusion Models for Recommender Systems
  2. 2025Towards A Tri-View Diffusion Framework for Recommendation
  3. 2025Continuous-time Discrete-space Diffusion Model for Recommendation
  4. 2023Discrete Conditional Diffusion for Reranking in Recommendation
  5. 2025Diffusion Recommender Models and the Illusion of Progress: A Concerning Study of Reproducibility and a Conceptual Mismatch
  6. 2025Diffusion Models in Recommendation Systems: A Survey
  7. 2026Eval4DiRec: A Unified and Systematic Evaluation Framework for Diffusion-based Recommender Systems
  8. 2025Beyond Negative Transfer: Disentangled Preference-Guided Diffusion for Cross-Domain Sequential Recommendation