WaveGrad: Estimating Gradients for Waveform Generation
Not on the map. Why?
Cited by 458 in Diffusion models, but placed by its own abstract, which didn’t fit.
Abstract (arXiv)
This paper introduces WaveGrad, a conditional model for waveform generation which estimates gradients of the data density. The model is built on prior work on score matching and diffusion probabilistic models. It starts from a Gaussian white noise signal and iteratively refines the signal via a gradient-based sampler conditioned on the mel-spectrogram. WaveGrad offers a natural way to trade inference speed for sample quality by adjusting the number of refinement steps, and bridges the gap between non-autoregressive and autoregressive models in terms of audio quality. We find that it can generate high fidelity audio samples using as few as six iterations. Experiments reveal WaveGrad to generate high fidelity audio, outperforming adversarial non-autoregressive baselines and matching a strong likelihood-based autoregressive baseline using fewer sequential operations. Audio samples are available at https://wavegrad.github.io/.
Key facts. Cited by 620 papers in the map (data through 7 Oct 2026). First posted on arXiv 2 Sep 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2020: 3; 2021: 66; 2022: 114; 2023: 179; 2024: 142; 2025: 87; 2026: 29.
620 papers.
Sort:
By area:
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2020Denoising Diffusion Implicit Modelscited by 9,655
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
- 2022Classifier-Free Diffusion Guidancecited by 5,717
- 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,736
- 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,006
- 2022Video Diffusion Modelscited by 2,280
- 2022DPM-Solver: A Fast ODE Solver for Diffusion Probabilistic Model Sampling in Around 10 Stepscited by 1,961
- 2023Consistency Modelscited by 1,778
- 2022Imagen Video: High Definition Video Generation with Diffusion Modelscited by 1,765
- 2021Structured Denoising Diffusion Models in Discrete State-Spacescited by 1,665
- 2021Image Super-Resolution via Iterative Refinementcited by 1,506
38 more
- 2023Zero-1-to-3: Zero-shot One Image to 3D Objectcited by 1,483
- 2020DiffWave: A Versatile Diffusion Model for Audio Synthesiscited by 1,339
- 2021Palette: Image-to-Image Diffusion Modelscited by 1,296
- 2021Cascaded Diffusion Models for High Fidelity Image Generationcited by 1,155
- 2021Variational Diffusion Modelscited by 1,145
- 2022Diffusion Models: A Comprehensive Survey of Methods and Applicationscited by 1,107
- 2022Planning with Diffusion for Flexible Behavior Synthesiscited by 1,023
- 2022Diffusion-LM Improves Controllable Text Generationcited by 1,006
- 2023One-step Diffusion with Distribution Matching Distillationcited by 978
- 2022DPM-Solver++: Fast Solver for Guided Sampling of Diffusion Probabilistic Modelscited by 924
- 2022Pseudo Numerical Methods for Diffusion Models on Manifoldscited by 695
- 2021Maximum Likelihood Training of Score-Based Diffusion Modelscited by 670
- 2021Score-based Generative Modeling in Latent Spacecited by 634
- 2021ILVR: Conditioning Method for Denoising Diffusion Probabilistic Modelscited by 634
- 2022Compositional Visual Generation with Composable Diffusion Modelscited by 619
- 2022AudioLM: a Language Modeling Approach to Audio Generationcited by 611
- 2024Simplified and Generalized Masked Diffusion for Discrete Datacited by 606
- 2021Diffusion Schr"odinger Bridge with Applications to Score-Based Generative Modelingcited by 594
- 2023AudioLDM: Text-to-Audio Generation with Latent Diffusion Modelscited by 592
- 2021CSDI: Conditional Score-based Diffusion Models for Probabilistic Time Series Imputationcited by 577
- 2022LION: Latent Point Diffusion Models for 3D Shape Generationcited by 552
- 2022All are Worth Words: A ViT Backbone for Diffusion Modelscited by 498
- 2021Diffusion Autoencoders: Toward a Meaningful and Decodable Representationcited by 447
- 2021Grad-TTS: A Diffusion Probabilistic Model for Text-to-Speechcited by 445
- 2023UniPC: A Unified Predictor-Corrector Framework for Fast Sampling of Diffusion Modelscited by 441
- 2022DiffuSeq: Sequence to Sequence Text Generation with Diffusion Modelscited by 439
- 2021SRDiff: Single Image Super-Resolution with Diffusion Probabilistic Modelscited by 415
- 2023Simple diffusion: End-to-end diffusion for high resolution imagescited by 413
- 2022TabDDPM: Modelling Tabular Data with Diffusion Modelscited by 373
- 2023ResShift: Efficient Diffusion Model for Image Super-resolution by Residual Shiftingcited by 360
- 2023DeepCache: Accelerating Diffusion Models for Freecited by 346
- 2023AudioLDM 2: Learning Holistic Audio Generation with Self-supervised Pretrainingcited by 343
- 2021Autoregressive Denoising Diffusion Models for Multivariate Probabilistic Time Series Forecastingcited by 332
- 2022Analytic-DPM: an Analytic Estimate of the Optimal Reverse Variance in Diffusion Probabilistic Modelscited by 331
- 2023Synthetic Data from Diffusion Models Improves ImageNet Classificationcited by 326
- 2021Come-Closer-Diffuse-Faster: Accelerating Conditional Diffusion Models for Inverse Problems through Stochastic Contractioncited by 306
- 2022Novel View Synthesis with Diffusion Modelscited by 299
- 2023Understanding Diffusion Objectives as the ELBO with Simple Data Augmentationcited by 293
50 most cited of 620 All 620 (JSON)
- 2026Spectral Amplitude Purification in Distribution Matching for Diffusion Distillation24 Sep 2026
- 2026SwiftExplorer: Training-free Diffusion Model Alignment with Swift Diversity Exploration6 Sep 2026
- 2026EmoTra-TTS: Smooth Intra-Utterance Emotion Transitions for Speech Synthesis24 Aug 2026
- 2026SwiftAudio: Data-Efficient Caption-Only Distillation for One-Step Text-to-Audio Diffusion-based Generation30 Jun 2026
- 2026Class-frequency Guided Noise Schedule for Diffusion Models26 Jun 2026
- 2026TooBad: Backdoor Diffusion Models with Ultra-Low Poison Rate and Imperceptible Trigger22 Jun 2026
- 2026Repurposing a Speech Classifier for Guided Diffusion-Based Speech Generation18 Jun 2026
- 2026Optimality of FSQ Tokens for Continuous Diffusion for Categorical Data with Application to Text-to-Speech8 Jun 2026
- 2026BareWave: Waveform-Native Flow-Matching Text-to-Speech8 Jun 2026
- 2026Score Based Error Correcting Code Decoder27 May 2026
- 2026WaveNeXt 2: ConvNeXt-Based Fast Neural Vocoders With Residual Denoising and Sub-Modeling for GAN and Diffusion Models25 May 2026
- 2026WavFlow: Audio Generation in Waveform Space18 May 2026
38 more
- 2026Covariance-aware sampling for Diffusion Models13 May 2026
- 2026Local-Time Riemannian Score Matching on the Quantum Pure-State Manifold5 May 2026
- 2026Elucidating the SNR-t Bias of Diffusion Probabilistic Models17 Apr 2026
- 2026SynHAT: A Two-stage Coarse-to-Fine Diffusion Framework for Synthesizing Human Activity Traces16 Apr 2026
- 2026DynFOA: Generating First-Order Ambisonics with Conditional Diffusion for Dynamic and Acoustically Complex 360-Degree Videos3 Apr 2026
- 2026Why Gaussian Diffusion Models Fail on Discrete Data and How to Prevent It?2 Apr 2026
- 2026Toward Complex-Valued Neural Networks for Waveform Generation12 Mar 2026
- 2026RBF-Solver: A Multistep Sampler for Diffusion Probabilistic Models via Radial Basis Functions5 Mar 2026
- 2026SyncTrack: Rhythmic Stability and Synchronization in Multi-Track Music Generation1 Mar 2026
- 2026Selective Denoising Diffusion Model for Time Series Anomaly Detection27 Feb 2026
- 2026DEGMC: Denoising Diffusion Models Based on Riemannian Equivariant Group Morphological Convolutions10 Feb 2026
- 2026DynFOA: Generating First-Order Ambisonics with Conditional Diffusion for Dynamic and Acoustically Complex 360-Degree Videos6 Feb 2026
- 2026Dynamical Regimes of Multimodal Diffusion Models4 Feb 2026
- 2026A Decomposable Forward Process in Diffusion Models for Time-Series Forecasting29 Jan 2026
- 2026Understanding Diffusion Models via Ratio-Based Function Approximation with SignReLU Networks29 Jan 2026
- 2026Quartet of Diffusions: Structure-Aware Point Cloud Generation through Part and Symmetry Guidance28 Jan 2026
- 2026VocalBridge: Latent Diffusion-Bridge Purification for Defeating Perturbation-Based Voiceprint Defenses5 Jan 2026
- 2025Flow2GAN: Hybrid Flow Matching and GAN with Multi-Resolution Network for Few-step High-Fidelity Audio Generation29 Dec 2025
- 2025Smark: A Watermark for Text-to-Speech Diffusion Models via Discrete Wavelet Transform21 Dec 2025
- 2025Plasticine: A Traceable Diffusion Model for Medical Image Translation20 Dec 2025
- 2025Pseudo-Cepstrum: Pitch Modification for Mel-Based Neural Vocoders18 Dec 2025
- 2025TreeQ: Pushing the Quantization Boundary of Diffusion Transformer via Tree-Structured Mixed-Precision Search6 Dec 2025
- 2025Non-Asymptotic Convergence of Discrete Diffusion Models: Masked and Random Walk dynamics29 Nov 2025
- 2025GLA-Grad++: An Improved Griffin-Lim Guided Diffusion Model for Speech Synthesis27 Nov 2025
- 2025Demystifying Diffusion Objectives: Reweighted Losses are Better Variational Bounds24 Nov 2025
- 2025CDLM: Consistency Diffusion Language Models For Faster Sampling24 Nov 2025
- 2025H-LDM: Hierarchical Latent Diffusion Models for Controllable and Interpretable PCG Synthesis from Clinical Metadata18 Nov 2025
- 2025Multi-modal Deepfake Detection and Localization with FPN-Transformer11 Nov 2025
- 2025Conditional Diffusion as Latent Constraints for Controllable Symbolic Music Generation10 Nov 2025
- 2025Information-Theoretic Discrete Diffusion28 Oct 2025
- 2025SCORENF: Score-based Normalizing Flows for Sampling Unnormalized distributions24 Oct 2025
- 2025Latent-Augmented Discrete Diffusion Models20 Oct 2025
- 2025Audio Palette: A Diffusion Transformer with Multi-Signal Conditioning for Controllable Foley Synthesis14 Oct 2025
- 2025Coherent Load Profile Synthesis with Conditional Diffusion for LV Distribution Network Scenario Generation13 Oct 2025
- 2025ProGress: Structured Music Generation via Graph Diffusion and Hierarchical Music Analysis11 Oct 2025
- 2025Pitch-Conditioned Instrument Sound Synthesis From an Interactive Timbre Latent Space5 Oct 2025
- 2025Beyond Next-Token Prediction: A Performance Characterization of Diffusion versus Autoregressive Language Models5 Oct 2025
- 2025SingMOS-Pro: An Comprehensive Benchmark for Singing Quality Assessment2 Oct 2025
50 newest of 620 All 620 (JSON)
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2020Denoising Diffusion Implicit Modelscited by 9,655
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
- 2022Classifier-Free Diffusion Guidancecited by 5,717
- 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,736
- 2022Video Diffusion Modelscited by 2,280
- 2022DPM-Solver: A Fast ODE Solver for Diffusion Probabilistic Model Sampling in Around 10 Stepscited by 1,961
- 2023Consistency Modelscited by 1,778
- 2022Imagen Video: High Definition Video Generation with Diffusion Modelscited by 1,765
- 2023Zero-1-to-3: Zero-shot One Image to 3D Objectcited by 1,483
- 2020DiffWave: A Versatile Diffusion Model for Audio Synthesiscited by 1,339
- 2021Palette: Image-to-Image Diffusion Modelscited by 1,296
12 most cited of 454 All 454 (JSON)
- 2026Spectral Amplitude Purification in Distribution Matching for Diffusion Distillation24 Sep 2026
- 2026SwiftExplorer: Training-free Diffusion Model Alignment with Swift Diversity Exploration6 Sep 2026
- 2026SwiftAudio: Data-Efficient Caption-Only Distillation for One-Step Text-to-Audio Diffusion-based Generation30 Jun 2026
- 2026Class-frequency Guided Noise Schedule for Diffusion Models26 Jun 2026
- 2026TooBad: Backdoor Diffusion Models with Ultra-Low Poison Rate and Imperceptible Trigger22 Jun 2026
- 2026Repurposing a Speech Classifier for Guided Diffusion-Based Speech Generation18 Jun 2026
- 2026Optimality of FSQ Tokens for Continuous Diffusion for Categorical Data with Application to Text-to-Speech8 Jun 2026
- 2026BareWave: Waveform-Native Flow-Matching Text-to-Speech8 Jun 2026
- 2026WaveNeXt 2: ConvNeXt-Based Fast Neural Vocoders With Residual Denoising and Sub-Modeling for GAN and Diffusion Models25 May 2026
- 2026Covariance-aware sampling for Diffusion Models13 May 2026
- 2026Elucidating the SNR-t Bias of Diffusion Probabilistic Models17 Apr 2026
- 2026DynFOA: Generating First-Order Ambisonics with Conditional Diffusion for Dynamic and Acoustically Complex 360-Degree Videos3 Apr 2026
12 newest of 454 All 454 (JSON)
- 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,006
- 2021Structured Denoising Diffusion Models in Discrete State-Spacescited by 1,665
- 2022DreamFusion: Text-to-3D using 2D Diffusion29 Sep 2022
- 2021Structured Denoising Diffusion Models in Discrete State-Spaces7 Jul 2021
- 2021Image Super-Resolution via Iterative Refinementcited by 1,506
- 2022Planning with Diffusion for Flexible Behavior Synthesiscited by 1,023
- 2022Diffusion-LM Improves Controllable Text Generationcited by 1,006
- 2022AudioLM: a Language Modeling Approach to Audio Generationcited by 611
- 2021How to Train Your Energy-Based Modelscited by 271
- 2022BigVGAN: A Universal Neural Vocoder with Large-Scale Trainingcited by 245
- 2022Diffusion-based Time Series Imputation and Forecasting with Structured State Space Modelscited by 195
- 2022Stochastic Trajectory Prediction via Motion Indeterminacy Diffusioncited by 184
- 2021A Survey on Neural Speech Synthesiscited by 182
- 2022It's Raw! Audio Generation with State-Space Modelscited by 171
- 2022Generative Modelling With Inverse Heat Dissipationcited by 164
- 2021DiffSinger: Singing Voice Synthesis via Shallow Diffusion Mechanismcited by 154
12 most cited of 161 All 161 (JSON)
- 2026EmoTra-TTS: Smooth Intra-Utterance Emotion Transitions for Speech Synthesis24 Aug 2026
- 2026Score Based Error Correcting Code Decoder27 May 2026
- 2026WavFlow: Audio Generation in Waveform Space18 May 2026
- 2026Local-Time Riemannian Score Matching on the Quantum Pure-State Manifold5 May 2026
- 2026SynHAT: A Two-stage Coarse-to-Fine Diffusion Framework for Synthesizing Human Activity Traces16 Apr 2026
- 2026Toward Complex-Valued Neural Networks for Waveform Generation12 Mar 2026
- 2026SyncTrack: Rhythmic Stability and Synchronization in Multi-Track Music Generation1 Mar 2026
- 2026Quartet of Diffusions: Structure-Aware Point Cloud Generation through Part and Symmetry Guidance28 Jan 2026
- 2025Pseudo-Cepstrum: Pitch Modification for Mel-Based Neural Vocoders18 Dec 2025
- 2025SCORENF: Score-based Normalizing Flows for Sampling Unnormalized distributions24 Oct 2025
- 2025Coherent Load Profile Synthesis with Conditional Diffusion for LV Distribution Network Scenario Generation13 Oct 2025
- 2025Pitch-Conditioned Instrument Sound Synthesis From an Interactive Timbre Latent Space5 Oct 2025
12 newest of 161 All 161 (JSON)
Similar, not cited
Close in wording, no citation either way
- 2025Audio Generation Through Score-Based Generative Modeling: Design Principles and Implementation
- 2025LatentVoiceGrad: Nonparallel Voice Conversion with Latent Diffusion/Flow-Matching Models
- 2026FastWave: Optimized Diffusion Model for Audio Super-Resolution
- 2026Fast Text-to-Audio Generation with One-Step Sampling via Energy-Scoring and Auxiliary Contextual Representation Distillation ↗
- 2025WaveFM: A High-Fidelity and Efficient Vocoder Based on Flow Matching
- 2023EDMSound: Spectrogram Based Diffusion Models for Efficient and High-Quality Audio Synthesis
- 2023Controllable Music Production with Diffusion Models and Guidance Gradients
- 2024PTQ4ADM: Post-Training Quantization for Efficient Text Conditional Audio Diffusion Models