On Efficiency-Effectiveness Trade-off of Diffusion-based Recommenders
On the map: Diffusion models → Diffusion recommenders
Abstract (arXiv)
Diffusion models have emerged as a powerful paradigm for generative sequential recommendation, which typically generate next items to recommend guided by user interaction histories with a multi-step denoising process. However, the multi-step process relies on discrete approximations, introducing discretization error that creates a trade-off between computational efficiency and recommendation effectiveness. To address this trade-off, we propose TA-Rec, a two-stage framework that achieves one-step generation by smoothing the denoising function during pretraining while alleviating trajectory deviation by aligning with user preferences during fine-tuning. Specifically, to improve the efficiency without sacrificing the recommendation performance, TA-Rec pretrains the denoising model with Temporal Consistency Regularization (TCR), enforcing the consistency between the denoising results across adjacent steps. Thus, we can smooth the denoising function to map the noise as oracle items in one step with bounded error. To further enhance effectiveness, TA-Rec introduces Adaptive Preference Alignment (APA) that aligns the denoising process with user preference adaptively based on preference pair similarity and timesteps. Extensive experiments prove that TA-Rec's two-stage objective effectively mitigates the discretization errors-induced trade-off, enhancing both efficiency and effectiveness of diffusion-based recommenders.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Placed in Diffusion recommenders, one of 14 directions in Diffusion models. Builds on 59 of its 68 references that are in the map. First posted on arXiv 20 Oct 2025.
Builds on
59 of 68 references.
Closest ancestors · 10
Same direction, newest first
- 2025Addressing Missing Data Issue for Diffusion-based Recommendation18 May
- 2025Distinguished Quantized Guidance for Diffusion-based Sequence Recommendation29 Jan
- 2024Generate and Instantiate What You Prefer: Text-Guided Diffusion for Sequential Recommendation17 Oct
- 2024DimeRec: A Unified Framework for Enhanced Sequential Recommendation via Generative Diffusion Models22 Aug
- 2024RecDiff: Diffusion Model for Social Recommendation1 Jun
- 2024Denoising Diffusion Recommender Model13 Jan
- 2024Plug-in Diffusion Model for Sequential Recommendation5 Jan
- 2023Generate What You Prefer: Reshaping Sequential Recommendation via Guided Diffusion31 Oct
- 2023Diffusion Augmentation for Sequential Recommendation22 Sep
- 2023DiffuRec: A Diffusion Model for Sequential Recommendation3 Apr
Other references · 49
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2020Denoising Diffusion Implicit Modelscited by 9,781
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
- 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 8,065
- 2022Scalable Diffusion Models with Transformerscited by 6,054
- 2022Classifier-Free Diffusion Guidancecited by 5,847
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
- 2022Elucidating the Design Space of Diffusion-Based Generative Modelscited by 3,045
- 2022DPM-Solver: A Fast ODE Solver for Diffusion Probabilistic Model Sampling in Around 10 Stepscited by 1,979
- 2023Consistency Modelscited by 1,822
- 2018Self-Attentive Sequential Recommendationcited by 1,184
- 2019BERT4Rec: Sequential Recommendation with Bidirectional Encoder Representations from Transformercited by 964
37 more
- 2024SimPO: Simple Preference Optimization with a Reference-Free Rewardcited by 963
- 2022DPM-Solver++: Fast Solver for Guided Sampling of Diffusion Probabilistic Modelscited by 938
- 2023Diffusion Model Alignment Using Direct Preference Optimizationcited by 790
- 2015Session-based Recommendations with Recurrent Neural Networkscited by 695
- 2021Maximum Likelihood Training of Score-Based Diffusion Modelscited by 672
- 2018Personalized Top-N Sequential Recommendation via Convolutional Sequence Embeddingcited by 476
- 2023Consistency Trajectory Models: Learning Probability Flow ODE Trajectory of Diffusioncited by 459
- 2023InstaFlow: One Step is Enough for High-Quality Diffusion-Based Text-to-Image Generationcited by 395
- 2022KuaiRec: A Fully-observed Dataset and Insights for Evaluating Recommender Systemscited by 96
- 2024β-DPO: Direct Preference Optimization with Dynamic βcited by 90
- 2023Diffusion Recommender Modelcited by 88
- 2023Aligning Optimization Trajectories with Diffusion Models for Constrained Design Generationcited by 52
- 2024How Discrete and Continuous Diffusion Meet: Comprehensive Analysis of Discrete Diffusion Models via a Stochastic Integral Frameworkcited by 48
- 2024Accelerating Diffusion Models with Parallel Sampling: Inference at Sub-Linear Time Complexitycited by 42
- 2024Motion Consistency Model: Accelerating Video Diffusion with Disentangled Motion-Appearance Distillationcited by 39
- 2021Stability and Convergence of Stochastic Gradient Clipping: Beyond Lipschitz Continuity and Smoothnesscited by 37
- 2024Simple and Fast Distillation of Diffusion Modelscited by 32
- 2023On Error Propagation of Diffusion Modelscited by 31
- 2024BELM: Bidirectional Explicit Linear Multi-step Sampler for Exact Inversion in Diffusion Modelscited by 29
- 2024AlphaDPO: Adaptive Reward Margin for Direct Preference Optimizationcited by 29
- 2025Diffusion-NPO: Negative Preference Optimization for Better Preference Aligned Generation of Diffusion Modelscited by 23
- 2024Reverse Transition Kernel: A Flexible Framework to Accelerate Diffusion Inferencecited by 22
- 2024MILP-StuDio: MILP Instance Generation via Block Structure Decompositioncited by 17
- 2024Accelerating PDE Data Generation via Differential Operator Action in Solution Spacecited by 15
- 2024SCott: Accelerating Diffusion Models with Stochastic Consistency Distillationcited by 14
- 2025Distilling Parallel Gradients for Fast ODE Solvers of Diffusion Modelscited by 13
- 2023Promoting Generalization for Exact Solvers via Adversarial Instance Augmentationcited by 12
- 2025AlphaFuse: Learn ID Embeddings for Sequential Recommendation in Null Space of Language Embeddingscited by 10
- 2024Preference Diffusion for Recommendationcited by 9
- 2024Deep Symbolic Optimization for Combinatorial Optimization: Accelerating Node Selection by Discovering Potential Heuristicscited by 8
- 2024Machine Learning Insides OptVerse AI Solver: Design Principles and Applicationscited by 7
- 2024AdjointDEIS: Efficient Gradients for Diffusion Modelscited by 7
- 2021A Large-Scale Rich Context Query and Recommendation Dataset in Online Knowledge-Sharingcited by 6
- 2024Reinforced Prompt Personalization for Recommendation with Large Language Modelscited by 6
- 2025RePO: Understanding Preference Learning Through ReLU-Based Optimizationcited by 4
- 2024Invariant Graph Learning Meets Information Bottleneck for Out-of-Distribution Generalizationcited by 2
- 2025Denoising Neural Reranker for Recommender Systemscited by 1
Built on by
Citing papers per year: 2026: 3.
3 papers.
- 2026Escaping the Euclidean Void: Manifold-Informed Flow Matching for Sequential Recommendationcited by 1
- 2026Generative Retrieval via Diffusion Transformer with Metric-Ordered Sequence Training and Hybrid-Policy Preference Optimizationcited by 0
- 2026OT-FlowRec: Optimal Transport-Guided Multi-Bridge Flow for Multimodal Sequential Recommendationcited by 0
- 2026OT-FlowRec: Optimal Transport-Guided Multi-Bridge Flow for Multimodal Sequential Recommendation12 Oct 2026
- 2026Escaping the Euclidean Void: Manifold-Informed Flow Matching for Sequential Recommendation26 Jul 2026
- 2026Generative Retrieval via Diffusion Transformer with Metric-Ordered Sequence Training and Hybrid-Policy Preference Optimization25 Jun 2026
Similar, not cited
Close in wording, no citation either way
- 2026Adaptive Item-based Collaborative Structures via Noise Rescheduling in Diffusion for Generative Recommendation
- 2025Unlocking the Power of Diffusion Models in Sequential Recommendation: A Simple and Effective Approach
- 2025Beyond Negative Transfer: Disentangled Preference-Guided Diffusion for Cross-Domain Sequential Recommendation
- 2025Towards A Tri-View Diffusion Framework for Recommendation
- 2025Fading to Grow: Growing Preference Ratios via Preference Fading Discrete Diffusion for Recommendation
- 2024A Survey on Diffusion Models for Recommender Systems
- 2025Diffusion Recommender Models and the Illusion of Progress: A Concerning Study of Reproducibility and a Conceptual Mismatch
- 2025Collaborative Diffusion Model for Recommender System