Adversarial score matching and improved sampling for image generation
Not on the map. Why?
Cited by 74 in Diffusion models, but placed by its own abstract, which didn’t fit.
Abstract (arXiv)
Denoising Score Matching with Annealed Langevin Sampling (DSM-ALS) has recently found success in generative modeling. The approach works by first training a neural network to estimate the score of a distribution, and then using Langevin dynamics to sample from the data distribution assumed by the score network. Despite the convincing visual quality of samples, this method appears to perform worse than Generative Adversarial Networks (GANs) under the Fr'echet Inception Distance, a standard metric for generative models. We show that this apparent gap vanishes when denoising the final Langevin samples using the score network. In addition, we propose two improvements to DSM-ALS: 1) Consistent Annealed Sampling as a more stable alternative to Annealed Langevin Sampling, and 2) a hybrid training formulation, composed of both Denoising Score Matching and adversarial objectives. By combining these two techniques and exploring different network architectures, we elevate score matching methods and obtain results competitive with state-of-the-art image generation on CIFAR-10.
Key facts. Cited by 95 papers in the map (data through 7 Oct 2026). First posted on arXiv 11 Sep 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2020: 2; 2021: 20; 2022: 25; 2023: 24; 2024: 17; 2025: 6; 2026: 1.
95 papers.
Sort:
By area:
- 2020Denoising Diffusion Implicit Modelscited by 9,655
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
- 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,736
- 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,903
- 2021Cascaded Diffusion Models for High Fidelity Image Generationcited by 1,155
- 2022Diffusion Models: A Comprehensive Survey of Methods and Applicationscited by 1,107
- 2022Diffusion Models in Vision: A Surveycited by 1,008
- 2023Adversarial Diffusion Distillationcited by 741
- 2021DiffusionCLIP: Text-Guided Diffusion Models for Robust Image Manipulationcited by 640
- 2021Score-based Generative Modeling in Latent Spacecited by 634
- 2021Diffusion Schr"odinger Bridge with Applications to Score-Based Generative Modelingcited by 594
- 2021Tackling the Generative Learning Trilemma with Denoising Diffusion GANscited by 515
38 more
- 2023Open-Vocabulary Panoptic Segmentation with Text-to-Image Diffusion Modelscited by 371
- 2022MCVD: Masked Conditional Video Diffusion for Prediction, Generation, and Interpolationcited by 307
- 2022Cold Diffusion: Inverting Arbitrary Image Transforms Without Noisecited by 275
- 2022Convergence of denoising diffusion models under the manifold hypothesiscited by 237
- 2021Score-Based Generative Modeling with Critically-Damped Langevin Diffusioncited by 230
- 2021Gotta Go Fast When Generating Data with Score-Based Modelscited by 218
- 2022Riemannian Score-Based Generative Modellingcited by 216
- 2022GENIE: Higher-Order Denoising Diffusion Solverscited by 127
- 2023State of the Art on Diffusion Models for Visual Computingcited by 126
- 2022Score-Based Generative Models Detect Manifoldscited by 121
- 2023Diffusion Models for Image Restoration and Enhancement: A Comprehensive Surveycited by 108
- 2022Refining Generative Process with Discriminator Guidance in Score-based Diffusion Modelscited by 98
- 2023Towards Faster Non-Asymptotic Convergence for Diffusion-Based Generative Modelscited by 84
- 2023Reflected Diffusion Modelscited by 81
- 2021Diffusion Normalizing Flowcited by 77
- 2022Universal Speech Enhancement with Score-based Diffusioncited by 75
- 2023Generate What You Prefer: Reshaping Sequential Recommendation via Guided Diffusioncited by 72
- 2024A Sharp Convergence Theory for The Probability Flow ODEs of Diffusion Modelscited by 64
- 2021Score-based Generative Neural Networks for Large-Scale Optimal Transportcited by 59
- 2022SinFusion: Training Diffusion Models on a Single Image or Videocited by 58
- 2021Diffusion-Based Representation Learningcited by 57
- 2021Adversarial Text-to-Image Synthesis: A Reviewcited by 52
- 2021Multimodal Image Synthesis and Editing: The Generative AI Eracited by 52
- 2021NU-Wave: A Diffusion Probabilistic Model for Neural Audio Upsamplingcited by 50
- 2023Class-Balancing Diffusion Modelscited by 47
- 2022Truncated Diffusion Probabilistic Models and Diffusion-based Adversarial Auto-Encoderscited by 42
- 2022Maximum Likelihood Training of Implicit Nonlinear Diffusion Modelscited by 42
- 2022Diffusion-based Generative Speech Source Separationcited by 41
- 2025An Introduction to Flow Matching and Diffusion Modelscited by 33
- 2022Full-band General Audio Synthesis with Score-based Diffusioncited by 32
- 2022DATID-3D: Diversity-Preserved Domain Adaptation Using Text-to-Image Diffusion for 3D Generative Modelcited by 32
- 2022Draw Your Art Dream: Diverse Digital Art Synthesis with Multimodal Guided Diffusioncited by 30
- 2023DisDiff: Unsupervised Disentanglement of Diffusion Probabilistic Modelscited by 30
- 2022SOS: Score-based Oversampling for Tabular Datacited by 29
- 2020Diffusion models for Handwriting Generationcited by 25
- 2023Region-Aware Diffusion for Zero-shot Text-driven Image Editingcited by 25
- 2023Unifying GANs and Score-Based Diffusion as Generative Particle Modelscited by 21
- 2024Deep Generative Models for Offline Policy Learning: Tutorial, Survey, and Perspectives on Future Directionscited by 20
50 most cited of 95 All 95 (JSON)
- 2026The Reward Was in Your Data All Along: Correcting Flow Matching with Discriminator-Guided RL17 Jun 2026
- 2025Group-Equivariant Diffusion Models for Lattice Field Theory30 Oct 2025
- 2025Generative AI in Depth: A Survey of Recent Advances, Model Variants, and Real-World Applications23 Oct 2025
- 2025An Introduction to Flow Matching and Diffusion Models2 Jun 2025
- 2025Understanding Generalization in Diffusion Distillation via Probability Flow Distance26 May 2025
- 2025Diffusion Models for Hyperspectral Image Analysis: A Comprehensive Review16 May 2025
- 2025Gaussian Mixture Flow Matching Models7 Apr 2025
- 2024Self-Corrected Flow Distillation for Consistent One-Step and Few-Step Text-to-Image Generation22 Dec 2024
- 2024Past, Present, and Future of Sensor-Based Human Activity Recognition Using Wearables: A Surveying Tutorial on a Still Challenging Task11 Nov 2024
- 2024Implicit Dynamical Flow Fusion (IDFF) for Generative Modeling22 Sep 2024
- 2024Accelerated Image-Aware Generative Diffusion Modeling15 Aug 2024
- 2024A Sharp Convergence Theory for The Probability Flow ODEs of Diffusion Models5 Aug 2024
38 more
- 2024Exploring Phrase-Level Grounding with Text-to-Image Diffusion Model7 Jul 2024
- 2024Stability and Generalizability in SDE Diffusion Models with Measure-Preserving Dynamics19 Jun 2024
- 2024Latent Denoising Diffusion GAN: Faster sampling, Higher image quality17 Jun 2024
- 2024Fast Samplers for Inverse Problems in Iterative Refinement Models27 May 2024
- 2024Score-based Generative Models with Adaptive Momentum22 May 2024
- 2024Improving Adversarial Energy-Based Model via Diffusion Process4 Mar 2024
- 2024Structure-Guided Adversarial Training of Diffusion Models27 Feb 2024
- 2024Deep Generative Models for Offline Policy Learning: Tutorial, Survey, and Perspectives on Future Directions21 Feb 2024
- 2024Towards Fast Stochastic Sampling in Diffusion Generative Models11 Feb 2024
- 2024CrossDiff: Exploring Self-Supervised Representation of Pansharpening via Cross-Predictive Diffusion Model10 Jan 2024
- 2024Bring Metric Functions into Diffusion Models4 Jan 2024
- 2024S2-DMs:Skip-Step Diffusion Models3 Jan 2024
- 2023Adversarial Diffusion Distillation28 Nov 2023
- 2023Generate What You Prefer: Reshaping Sequential Recommendation via Guided Diffusion31 Oct 2023
- 2023Efficient Integrators for Diffusion Generative Models11 Oct 2023
- 2023State of the Art on Diffusion Models for Visual Computing11 Oct 2023
- 2023Generalization Bound for Diffusion Models using Random Features6 Oct 2023
- 2023Score Mismatching for Generative Modeling20 Sep 2023
- 2023Generative Hyperelasticity with Physics-Informed Probabilistic Diffusion Fields11 Sep 2023
- 2023Adversarial Score-Based Generative Models for MMSE-achieving AmBC Channel Estimation11 Sep 2023
- 2023Diffusion Variational Autoencoder for Tackling Stochasticity in Multi-Step Regression Stock Price Prediction18 Aug 2023
- 2023Diffusion Models for Image Restoration and Enhancement: A Comprehensive Survey18 Aug 2023
- 2023FEDD -- Fair, Efficient, and Diverse Diffusion-based Lesion Segmentation and Malignancy Classification21 Jul 2023
- 2023Semi-Implicit Denoising Diffusion Models (SIDDMs)21 Jun 2023
- 2023Towards Faster Non-Asymptotic Convergence for Diffusion-Based Generative Models15 Jun 2023
- 2023Unsupervised Statistical Feature-Guided Diffusion Model for Sensor-based Human Activity Recognition30 May 2023
- 2023Unifying GANs and Score-Based Diffusion as Generative Particle Models25 May 2023
- 2023Moment Matching Denoising Gibbs Sampling19 May 2023
- 2023Class-Balancing Diffusion Models30 Apr 2023
- 2023Reflected Diffusion Models10 Apr 2023
- 2023PODIA-3D: Domain Adaptation of 3D Generative Model Across Large Domain Gap Using Pose-Preserved Text-to-Image Diffusion4 Apr 2023
- 2023CoopInit: Initializing Generative Adversarial Networks via Cooperative Learning21 Mar 2023
- 2023Open-Vocabulary Panoptic Segmentation with Text-to-Image Diffusion Models8 Mar 2023
- 2023A Complete Recipe for Diffusion Generative Models3 Mar 2023
- 2023Region-Aware Diffusion for Zero-shot Text-driven Image Editing23 Feb 2023
- 2023DisDiff: Unsupervised Disentanglement of Diffusion Probabilistic Models31 Jan 2023
- 2022DATID-3D: Diversity-Preserved Domain Adaptation Using Text-to-Image Diffusion for 3D Generative Model29 Nov 2022
- 2022Refining Generative Process with Discriminator Guidance in Score-based Diffusion Models28 Nov 2022
50 newest of 95 All 95 (JSON)
- 2020Denoising Diffusion Implicit Modelscited by 9,655
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
- 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,736
- 2021Cascaded Diffusion Models for High Fidelity Image Generationcited by 1,155
- 2022Diffusion Models: A Comprehensive Survey of Methods and Applicationscited by 1,107
- 2022Diffusion Models in Vision: A Surveycited by 1,008
- 2023Adversarial Diffusion Distillationcited by 741
- 2021DiffusionCLIP: Text-Guided Diffusion Models for Robust Image Manipulationcited by 640
- 2021Score-based Generative Modeling in Latent Spacecited by 634
- 2021Diffusion Schr"odinger Bridge with Applications to Score-Based Generative Modelingcited by 594
- 2021Tackling the Generative Learning Trilemma with Denoising Diffusion GANscited by 515
- 2023Open-Vocabulary Panoptic Segmentation with Text-to-Image Diffusion Modelscited by 371
12 most cited of 74 All 74 (JSON)
- 2026The Reward Was in Your Data All Along: Correcting Flow Matching with Discriminator-Guided RL17 Jun 2026
- 2025Group-Equivariant Diffusion Models for Lattice Field Theory30 Oct 2025
- 2025Generative AI in Depth: A Survey of Recent Advances, Model Variants, and Real-World Applications23 Oct 2025
- 2025An Introduction to Flow Matching and Diffusion Models2 Jun 2025
- 2025Understanding Generalization in Diffusion Distillation via Probability Flow Distance26 May 2025
- 2025Diffusion Models for Hyperspectral Image Analysis: A Comprehensive Review16 May 2025
- 2025Gaussian Mixture Flow Matching Models7 Apr 2025
- 2024Self-Corrected Flow Distillation for Consistent One-Step and Few-Step Text-to-Image Generation22 Dec 2024
- 2024Implicit Dynamical Flow Fusion (IDFF) for Generative Modeling22 Sep 2024
- 2024Accelerated Image-Aware Generative Diffusion Modeling15 Aug 2024
- 2024A Sharp Convergence Theory for The Probability Flow ODEs of Diffusion Models5 Aug 2024
- 2024Exploring Phrase-Level Grounding with Text-to-Image Diffusion Model7 Jul 2024
12 newest of 74 All 74 (JSON)
- 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,903
- 2022Universal Speech Enhancement with Score-based Diffusioncited by 75
- 2021Score-based Generative Neural Networks for Large-Scale Optimal Transportcited by 59
- 2021Diffusion-Based Representation Learningcited by 57
- 2021Adversarial Text-to-Image Synthesis: A Reviewcited by 52
- 2021Multimodal Image Synthesis and Editing: The Generative AI Eracited by 52
- 2022Full-band General Audio Synthesis with Score-based Diffusioncited by 32
- 2022Astronomia ex machina: a history, primer, and outlook on neural networks in astronomycited by 17
- 2024Past, Present, and Future of Sensor-Based Human Activity Recognition Using Wearables: A Surveying Tutorial on a Still Challenging Taskcited by 14
- 2022Towards Healing the Blindness of Score Matchingcited by 13
- 20223inGAN: Learning a 3D Generative Model from Images of a Self-similar Scenecited by 9
- 2021Dual Training of Energy-Based Models with Overparametrized Shallow Neural Networkscited by 8
12 most cited of 20 All 20 (JSON)
- 2024Past, Present, and Future of Sensor-Based Human Activity Recognition Using Wearables: A Surveying Tutorial on a Still Challenging Task11 Nov 2024
- 2024Improving Adversarial Energy-Based Model via Diffusion Process4 Mar 2024
- 2023Generative Hyperelasticity with Physics-Informed Probabilistic Diffusion Fields11 Sep 2023
- 2023FEDD -- Fair, Efficient, and Diverse Diffusion-based Lesion Segmentation and Malignancy Classification21 Jul 2023
- 2023Moment Matching Denoising Gibbs Sampling19 May 2023
- 2023CoopInit: Initializing Generative Adversarial Networks via Cooperative Learning21 Mar 2023
- 20223inGAN: Learning a 3D Generative Model from Images of a Self-similar Scene27 Nov 2022
- 2022Astronomia ex machina: a history, primer, and outlook on neural networks in astronomy7 Nov 2022
- 2022Full-band General Audio Synthesis with Score-based Diffusion26 Oct 2022
- 2022Towards Healing the Blindness of Score Matching15 Sep 2022
- 2022Universal Speech Enhancement with Score-based Diffusion7 Jun 2022
- 2022Signature and Log-signature for the Study of Empirical Distributions Generated with GANs7 Mar 2022
12 newest of 20 All 20 (JSON)