Refining Generative Process with Discriminator Guidance in Score-based Diffusion Models
On the map: Diffusion models → Diffusion foundations and sampling
Abstract (arXiv)
The proposed method, Discriminator Guidance, aims to improve sample generation of pre-trained diffusion models. The approach introduces a discriminator that gives explicit supervision to a denoising sample path whether it is realistic or not. Unlike GANs, our approach does not require joint training of score and discriminator networks. Instead, we train the discriminator after score training, making discriminator training stable and fast to converge. In sample generation, we add an auxiliary term to the pre-trained score to deceive the discriminator. This term corrects the model score to the data score at the optimal discriminator, which implies that the discriminator helps better score estimation in a complementary way. Using our algorithm, we achive state-of-the-art results on ImageNet 256x256 with FID 1.83 and recall 0.64, similar to the validation data's FID (1.68) and recall (0.66). We release the code at https://github.com/alsdudrla10/DG.
Key facts. Cited by 100 papers in the map (data through 14 Oct 2026). Placed in Diffusion foundations and sampling, one of 14 directions in Diffusion models. Builds on 47 of its 78 references that are in the map. First posted on arXiv 28 Nov 2022.
Builds on
47 of 78 references.
Closest ancestors · 19
Same direction, newest first
- 2022Soft Diffusion: Score Matching for General Corruptions12 Sep
- 2022Convergence of denoising diffusion models under the manifold hypothesis10 Aug
- 2022Entropy-driven Sampling and Training Scheme for Conditional Diffusion Generation23 Jun
- 2022Elucidating the Design Space of Diffusion-Based Generative Models1 Jun
- 2022Maximum Likelihood Training of Implicit Nonlinear Diffusion Models27 May
- 2022Accelerating Diffusion Models via Early Stop of the Diffusion Process25 May
- 2021High-Resolution Image Synthesis with Latent Diffusion Models20 Dec
- 2021Tackling the Generative Learning Trilemma with Denoising Diffusion GANs15 Dec
- 2021Score-Based Generative Modeling with Critically-Damped Langevin Diffusion14 Dec
- 2021Variational Diffusion Models1 Jul
- 2021Score-based Generative Modeling in Latent Space10 Jun
- 2021Soft Truncation: A Universal Training Technique of Score-based Diffusion Model for High Precision Score Estimation10 Jun
7 more
- 2021Cascaded Diffusion Models for High Fidelity Image Generation30 May
- 2021Diffusion Models Beat GANs on Image Synthesis11 May
- 2021Improved Denoising Diffusion Probabilistic Models18 Feb
- 2021Maximum Likelihood Training of Score-Based Diffusion Models22 Jan
- 2020Score-Based Generative Modeling through Stochastic Differential Equations26 Nov
- 2020Denoising Diffusion Implicit Models6 Oct
- 2020Denoising Diffusion Probabilistic Models19 Jun
Other references · 28
- 2014ImageNet Large Scale Visual Recognition Challengecited by 8,498
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,585
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
- 2022Generative Adversarial Networkscited by 5,627
- 2015Rethinking the Inception Architecture for Computer Visioncited by 5,475
- 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,101
- 2013Auto-Encoding Variational Bayescited by 4,053
- 2014Deep Learning Face Attributes in the Wildcited by 3,693
- 2022Video Diffusion Modelscited by 2,305
- 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,937
- 2022Make-A-Video: Text-to-Video Generation without Text-Video Datacited by 1,742
16 more
- 2022Denoising Diffusion Restoration Modelscited by 963
- 2016f-GAN: Training Generative Neural Samplers using Variational Divergence Minimizationcited by 506
- 2022MCVD: Masked Conditional Video Diffusion for Prediction, Generation, and Interpolationcited by 309
- 2021Generating Images with Sparse Representationscited by 266
- 2022Dual Diffusion Implicit Bridges for Image-to-Image Translationcited by 213
- 2022Diffusion-GAN: Training GANs with Diffusioncited by 205
- 2020Telescoping Density-Ratio Estimationcited by 108
- 2014On the relation between optimal transport and Schr"odinger bridges: A stochastic control viewpointcited by 99
- 2020Adversarial score matching and improved sampling for image generationcited by 96
- 2020Your GAN is Secretly an Energy-based Model and You Should use Discriminator Driven Latent Samplingcited by 71
- 2020A Contrastive Learning Approach for Training Variational Autoencoder Priorscited by 66
- 2018Resampled Priors for Variational Autoencoderscited by 57
- 2018Discriminator Rejection Samplingcited by 49
- 2022Denoising Likelihood Score Matching for Conditional Score-based Data Generationcited by 46
- 2020Non-Negative Bregman Divergence Minimization for Deep Direct Density Ratio Estimationcited by 45
- 2018Metropolis-Hastings Generative Adversarial Networkscited by 41
Built on by
Citing papers per year: 2023: 30; 2024: 28; 2025: 24; 2026: 18.
100 papers.
Sort:
By area:
- 2023Consistency Trajectory Models: Learning Probability Flow ODE Trajectory of Diffusioncited by 459
- 2023Improved Techniques for Training Consistency Modelscited by 439
- 2024Guiding a Diffusion Model with a Bad Version of Itselfcited by 299
- 2023CADS: Unleashing the Diversity of Diffusion Models through Condition-Annealed Samplingcited by 129
- 2023One-Step Diffusion Distillation via Deep Equilibrium Modelscited by 61
- 2023A Comprehensive Survey on Knowledge Distillation of Diffusion Modelscited by 45
- 2023Exact Diffusion Inversion via Bi-directional Integration Approximationcited by 44
- 2023GSURE-Based Diffusion Model Training with Corrupted Datacited by 40
- 2024Adversarial Robustness Limits via Scaling-Law and Human-Alignment Studiescited by 38
- 2023Don't Play Favorites: Minority Guidance for Diffusion Modelscited by 37
- 2024Self-Improving Diffusion Models with Synthetic Datacited by 35
- 2023Blackout Diffusion: Generative Diffusion Models in Discrete-State Spacescited by 30
38 more
- 2023Characteristic Guidance: Non-linear Correction for Diffusion Model at Large Guidance Scalecited by 26
- 2024Training Unbiased Diffusion Models From Biased Datasetcited by 25
- 2024MMDisCo: Multi-Modal Discriminator-Guided Cooperative Diffusion for Joint Audio and Video Generationcited by 23
- 2025Direct Discriminative Optimization: Your Likelihood-Based Visual Generative Model is Secretly a GAN Discriminatorcited by 23
- 2023Diffusion Model with Perceptual Losscited by 21
- 2025Training-Free Safe Denoisers for Safe Use of Diffusion Modelscited by 21
- 2023Spiking Denoising Diffusion Probabilistic Modelscited by 19
- 2023DiffEnc: Variational Diffusion with a Learned Encodercited by 17
- 2025Visual Generation Without Guidancecited by 17
- 2024Label-Noise Robust Diffusion Modelscited by 16
- 2024An Analysis of Recent Advances in Deepfake Image Detection in an Evolving Threat Landscapecited by 16
- 2023Correcting Diffusion Generation through Resamplingcited by 15
- 2025MixerMDM: Learnable Composition of Human Motion Diffusion Modelscited by 13
- 2025Dynamic Classifier-Free Diffusion Guidance via Online Feedbackcited by 13
- 2023Censored Sampling of Diffusion Models Using 3 Minutes of Human Feedbackcited by 12
- 2025Adversarial Flow Modelscited by 12
- 2024Structure-Guided Adversarial Training of Diffusion Modelscited by 11
- 2024Diffusion Rejection Samplingcited by 11
- 2023On the Equivalence of Consistency-Type Models: Consistency Models, Consistent Diffusion Models, and Fokker-Planck Regularizationcited by 10
- 2025Solving Linear-Gaussian Bayesian Inverse Problems with Decoupled Diffusion Sequential Monte Carlocited by 10
- 2023Precision-Recall Divergence Optimization for Generative Modeling with GANs and Normalizing Flowscited by 9
- 2024Stable Consistency Tuning: Understanding and Improving Consistency Modelscited by 9
- 2025Preference Optimization by Estimating the Ratio of the Data Distributioncited by 9
- 2023On Accelerating Diffusion-Based Sampling Process via Improved Integration Approximationcited by 8
- 2024Localize, Understand, Collaborate: Semantic-Aware Dragging via Intention Reasonercited by 8
- 2024DLCR: A Generative Data Expansion Framework via Diffusion for Clothes-Changing Person Re-IDcited by 8
- 2025Diffusion Adaptive Text Embedding for Text-to-Image Diffusion Modelscited by 8
- 2023Revisiting the Evaluation of Image Synthesis with GANscited by 7
- 2023Raising the Bar for Certified Adversarial Robustness with Diffusion Modelscited by 7
- 2023Score Mismatching for Generative Modelingcited by 7
- 2024GeoGuide: Geometric guidance of diffusion modelscited by 7
- 2024AutoLoRA: AutoGuidance Meets Low-Rank Adaptation for Diffusion Modelscited by 7
- 2023Don't be so negative! Score-based Generative Modeling with Oracle-assisted Guidancecited by 6
- 2023Assessing Robustness via Score-Based Adversarial Image Generationcited by 6
- 2023Unsupervised Discovery of Interpretable Directions in h-space of Pre-trained Diffusion Modelscited by 6
- 2024Simple Drop-in LoRA Conditioning on Attention Layers Will Improve Your Diffusion Modelcited by 6
- 2024Diffusion Bridge AutoEncoders for Unsupervised Representation Learningcited by 6
- 2024GenFormer -- Generated Images are All You Need to Improve Robustness of Transformers on Small Datasetscited by 6
50 most cited of 100 All 100 (JSON)
- 2026Radial Tail Repair: Post-Training Correction for Diffusion and Flow Models12 Oct 2026
- 2026Best-of-N Guidance for Test-time Diffusion Alignment4 Oct 2026
- 2026Improving Generative Model Self-Training with Geometrically Modified Outputs28 Sep 2026
- 2026Sobolev Regularized Score Difference Estimation in Diffusion Models18 Aug 2026
- 2026Adversarial Learning of Classifier-Free Guidance Schedules14 Aug 2026
- 2026Spectral Prior for Reducing Exposure Bias in Diffusion Models24 Jul 2026
- 2026Signed Rectified Flow: Negativity-Controlled Generation20 Jul 2026
- 2026Exposure Bias Can Alleviate Itself via Directional and Frequency Rectification in Flow Matching26 Jun 2026
- 2026Mitigating the Contractivity Trap in Diffusion ODEs via Stein Stabilization5 Jun 2026
- 2026Missing Pattern Recognized Diffusion Imputation Model for Missing Not At Random25 May 2026
- 2026Elucidating the SNR-t Bias of Diffusion Probabilistic Models17 Apr 2026
- 2026Self-Adversarial One Step Generation via Condition Shifting14 Apr 2026
38 more
- 2026Continuous Adversarial Flow Models13 Apr 2026
- 2026Bias mitigation in graph diffusion models2 Apr 2026
- 2026Seasoning Generative Models for a Generalization Aftertaste19 Mar 2026
- 2026Learning To Sample From Diffusion Models Via Inverse Reinforcement Learning9 Feb 2026
- 2026Equalized Generative Treatment: Matching f-divergences for Fairness in Generative Models9 Feb 2026
- 2026Lookahead Sample Reward Guidance for Test-Time Scaling of Diffusion Models3 Feb 2026
- 2025Adversarial Flow Models27 Nov 2025
- 2025Controllable protein design with particle-based Feynman-Kac steering12 Nov 2025
- 2025Generative AI Meets 6G and Beyond: Diffusion Models for Semantic Communications11 Nov 2025
- 2025Diffusion Adaptive Text Embedding for Text-to-Image Diffusion Models28 Oct 2025
- 2025Neon: Negative Extrapolation From Self-Training Improves Image Generation4 Oct 2025
- 2025DistillKac: Few-Step Image Generation via Damped Wave Equations25 Sep 2025
- 2025Dynamic Classifier-Free Diffusion Guidance via Online Feedback19 Sep 2025
- 2025Guiding Noisy Label Conditional Diffusion Models with Score-based Discriminator Correction27 Aug 2025
- 2025ProSpero: Active Learning for Robust Protein Design Beyond Wild-Type Neighborhoods28 May 2025
- 2025Preference Optimization by Estimating the Ratio of the Data Distribution26 May 2025
- 2025Modular Diffusion Policy Training: Decoupling and Recombining Guidance and Diffusion for Offline RL19 May 2025
- 2025Improving Compositional Generation with Diffusion Models Using Lift Scores19 May 2025
- 2025Unsupervised Detection of Distribution Shift in Inverse Problems using Diffusion Models16 May 2025
- 2025Generating time-consistent dynamics with discriminator-guided image diffusion models14 May 2025
- 2025Integration Flow Models28 Apr 2025
- 2025MixerMDM: Learnable Composition of Human Motion Diffusion Models1 Apr 2025
- 2025High Quality Diffusion Distillation on a Single GPU with Relative and Absolute Position Matching26 Mar 2025
- 2025Improving Discriminator Guidance in Diffusion Models20 Mar 2025
- 2025Studying Classifier(-Free) Guidance From a Classifier-Centric Perspective13 Mar 2025
- 2025Direct Discriminative Optimization: Your Likelihood-Based Visual Generative Model is Secretly a GAN Discriminator3 Mar 2025
- 2025Training-Free Safe Denoisers for Safe Use of Diffusion Models11 Feb 2025
- 2025Solving Linear-Gaussian Bayesian Inverse Problems with Decoupled Diffusion Sequential Monte Carlo10 Feb 2025
- 2025Efficient Weighted Sampling via Score-based Generative Models7 Feb 2025
- 2025Visual Generation Without Guidance26 Jan 2025
- 2024DLCR: A Generative Data Expansion Framework via Diffusion for Clothes-Changing Person Re-ID11 Nov 2024
- 2024Diffusion Sampling Correction via Approximately 10 Parameters10 Nov 2024
- 2024Stable Consistency Tuning: Understanding and Improving Consistency Models24 Oct 2024
- 2024AutoLoRA: AutoGuidance Meets Low-Rank Adaptation for Diffusion Models4 Oct 2024
- 2024Spiking Diffusion Models29 Aug 2024
- 2024Self-Improving Diffusion Models with Synthetic Data29 Aug 2024
- 2024GenFormer -- Generated Images are All You Need to Improve Robustness of Transformers on Small Datasets26 Aug 2024
- 2024GeoGuide: Geometric guidance of diffusion models17 Jul 2024
50 newest of 100 All 100 (JSON)
- 2023Consistency Trajectory Models: Learning Probability Flow ODE Trajectory of Diffusioncited by 459
- 2023Improved Techniques for Training Consistency Modelscited by 439
- 2024Guiding a Diffusion Model with a Bad Version of Itselfcited by 299
- 2023CADS: Unleashing the Diversity of Diffusion Models through Condition-Annealed Samplingcited by 129
- 2023One-Step Diffusion Distillation via Deep Equilibrium Modelscited by 61
- 2023A Comprehensive Survey on Knowledge Distillation of Diffusion Modelscited by 45
- 2023Exact Diffusion Inversion via Bi-directional Integration Approximationcited by 44
- 2023GSURE-Based Diffusion Model Training with Corrupted Datacited by 40
- 2023Don't Play Favorites: Minority Guidance for Diffusion Modelscited by 37
- 2024Self-Improving Diffusion Models with Synthetic Datacited by 35
- 2023Blackout Diffusion: Generative Diffusion Models in Discrete-State Spacescited by 30
- 2023Characteristic Guidance: Non-linear Correction for Diffusion Model at Large Guidance Scalecited by 26
12 most cited of 76 All 76 (JSON)
- 2026Radial Tail Repair: Post-Training Correction for Diffusion and Flow Models12 Oct 2026
- 2026Best-of-N Guidance for Test-time Diffusion Alignment4 Oct 2026
- 2026Sobolev Regularized Score Difference Estimation in Diffusion Models18 Aug 2026
- 2026Adversarial Learning of Classifier-Free Guidance Schedules14 Aug 2026
- 2026Spectral Prior for Reducing Exposure Bias in Diffusion Models24 Jul 2026
- 2026Signed Rectified Flow: Negativity-Controlled Generation20 Jul 2026
- 2026Exposure Bias Can Alleviate Itself via Directional and Frequency Rectification in Flow Matching26 Jun 2026
- 2026Mitigating the Contractivity Trap in Diffusion ODEs via Stein Stabilization5 Jun 2026
- 2026Elucidating the SNR-t Bias of Diffusion Probabilistic Models17 Apr 2026
- 2026Continuous Adversarial Flow Models13 Apr 2026
- 2026Bias mitigation in graph diffusion models2 Apr 2026
- 2026Learning To Sample From Diffusion Models Via Inverse Reinforcement Learning9 Feb 2026
12 newest of 76 All 76 (JSON)
- 2024Adversarial Robustness Limits via Scaling-Law and Human-Alignment Studiescited by 38
- 2025Direct Discriminative Optimization: Your Likelihood-Based Visual Generative Model is Secretly a GAN Discriminatorcited by 23
- 2025Visual Generation Without Guidancecited by 17
- 2024An Analysis of Recent Advances in Deepfake Image Detection in an Evolving Threat Landscapecited by 16
- 2025Adversarial Flow Modelscited by 12
- 2023Precision-Recall Divergence Optimization for Generative Modeling with GANs and Normalizing Flowscited by 9
- 2024Localize, Understand, Collaborate: Semantic-Aware Dragging via Intention Reasonercited by 8
- 2023Revisiting the Evaluation of Image Synthesis with GANscited by 7
- 2023Assessing Robustness via Score-Based Adversarial Image Generationcited by 6
- 2024Diffusion Bridge AutoEncoders for Unsupervised Representation Learningcited by 6
- 2024GenFormer -- Generated Images are All You Need to Improve Robustness of Transformers on Small Datasetscited by 6
- 2023Optimal Budgeted Rejection Sampling for Generative Modelscited by 5
12 most cited of 22 All 22 (JSON)
- 2026Improving Generative Model Self-Training with Geometrically Modified Outputs28 Sep 2026
- 2026Missing Pattern Recognized Diffusion Imputation Model for Missing Not At Random25 May 2026
- 2026Self-Adversarial One Step Generation via Condition Shifting14 Apr 2026
- 2026Seasoning Generative Models for a Generalization Aftertaste19 Mar 2026
- 2026Equalized Generative Treatment: Matching f-divergences for Fairness in Generative Models9 Feb 2026
- 2025Adversarial Flow Models27 Nov 2025
- 2025Neon: Negative Extrapolation From Self-Training Improves Image Generation4 Oct 2025
- 2025DistillKac: Few-Step Image Generation via Damped Wave Equations25 Sep 2025
- 2025ProSpero: Active Learning for Robust Protein Design Beyond Wild-Type Neighborhoods28 May 2025
- 2025Direct Discriminative Optimization: Your Likelihood-Based Visual Generative Model is Secretly a GAN Discriminator3 Mar 2025
- 2025Visual Generation Without Guidance26 Jan 2025
- 2024GenFormer -- Generated Images are All You Need to Improve Robustness of Transformers on Small Datasets26 Aug 2024
12 newest of 22 All 22 (JSON)
Similar, not cited
Close in wording, no citation either way
- 2023DiffFlow: A Unified SDE Framework for Score-Based Diffusion Models and Generative Adversarial Networks
- 2024A Score-Based Density Formula, with Applications in Diffusion Generative Models
- 2025Revisiting Diffusion Models: From Generative Pre-training to One-Step Generation
- 2026Where the Score Lives: A Wavelet View of Diffusion
- 2022Progressive Distillation for Fast Sampling of Diffusion Models
- 2023Diffusion Models Beat GANs on Image Classification
- 2026From Score Learning to Discretized Sampling: An End-to-End Generalization Analysis of Diffusion Models
- 2025ADT: Tuning Diffusion Models with Adversarial Supervision