mlsanityData to 14 Oct 2026

Full-band General Audio Synthesis with Score-based Diffusion

arXiv 2210.14661 ↗First posted 26 Oct 2022cs.SD cs.LG eess.AScited by 32

Not on the map. Why?

Abstract (arXiv)

Recent works have shown the capability of deep generative models to tackle general audio synthesis from a single label, producing a variety of impulsive, tonal, and environmental sounds. Such models operate on band-limited signals and, as a result of an autoregressive approach, they are typically conformed by pre-trained latent encoders and/or several cascaded modules. In this work, we propose a diffusion-based generative model for general audio synthesis, named DAG, which deals with full-band signals end-to-end in the waveform domain. Results show the superiority of DAG over existing label-conditioned generators in terms of both quality and diversity. More specifically, when compared to the state of the art, the band-limited and full-band versions of DAG achieve relative improvements that go up to 40 and 65%, respectively. We believe DAG is flexible enough to accommodate different conditioning schemas while providing good quality synthesis.

Key facts. Cited by 32 papers in the map (data through 14 Oct 2026). Builds on 22 of its 29 references that are in the map. First posted on arXiv 26 Oct 2022.

Builds on

22 of 29 references.

References · 22

  1. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
  2. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
  3. 2022Classifier-Free Diffusion Guidancecited by 5,847
  4. 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,101
  5. 2019Generating Diverse High-Fidelity Images with VQ-VAE-2cited by 1,387
  6. 2020DiffWave: A Versatile Diffusion Model for Audio Synthesiscited by 1,354
  7. 2020HiFi-GAN: Generative Adversarial Networks for Efficient and High Fidelity Speech Synthesiscited by 1,154
  8. 2020WaveGrad: Estimating Gradients for Waveform Generationcited by 622
  9. 2020Jukebox: A Generative Model for Musiccited by 542
  10. 2020Reliable Fidelity and Diversity Metrics for Generative Modelscited by 434
  11. 2022AudioGen: Textually Guided Audio Generationcited by 295
  12. 2022Diffsound: Discrete Diffusion Model for Text-to-sound Generationcited by 257
10 more
  1. 2018A Note on the Inception Scorecited by 226
  2. 2017PixelSNAIL: An Improved Autoregressive Generative Modelcited by 137
  3. 2020Adversarial score matching and improved sampling for image generationcited by 96
  4. 2022Universal Speech Enhancement with Score-based Diffusioncited by 75
  5. 2021CRASH: Raw Audio Score-based Generative Modeling for Controllable High-resolution Drum Sound Synthesiscited by 37
  6. 2020DrumGAN: Synthesis of Drum Sounds With Timbral Feature Conditioning Using Generative Adversarial Networkscited by 35
  7. 2021Conditional Sound Generation Using Neural Discrete Time-Frequency Representation Learningcited by 24
  8. 2021Generating Diverse Realistic Laughter for Interactive Artcited by 5
  9. 2021On tuning consistent annealed sampling for denoising score matchingcited by 4
  10. 2021Neural Synthesis of Footsteps Sound Effects with Generative Adversarial Networkscited by 4

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2023: 16; 2024: 10; 2025: 3; 2026: 3.

32 papers.

Sort:

By area:

  1. 2023AudioLDM: Text-to-Audio Generation with Latent Diffusion Modelscited by 599
  2. 2024Fast Timing-Conditioned Latent Audio Diffusioncited by 181
  3. 2024Long-form music generation with latent diffusioncited by 89
  4. 2023A Complete Survey on Generative AI (AIGC): Is ChatGPT from GPT-4 to GPT-5 All You Need?cited by 84
  5. 2023A Survey on Audio Diffusion Models: Text To Speech Synthesis and Enhancement in Generative AIcited by 68
  6. 2023Multi-Source Diffusion Models for Simultaneous Music Generation and Separationcited by 63
  7. 2024Scaling Transformers for Low-Bitrate High-Quality Speech Codingcited by 49
  8. 2024Masked Generative Video-to-Audio Transformers with Enhanced Synchronicitycited by 28
  9. 2023SyncFusion: Multimodal Onset-synchronized Video-to-Audio Foley Synthesiscited by 24
  10. 2023From Discrete Tokens to High-Fidelity Audio Using Multi-Band Diffusioncited by 22
  11. 2023Blind Audio Bandwidth Extension: A Diffusion-Based Zero-Shot Approachcited by 21
  12. 2023CLIPSonic: Text-to-Audio Synthesis with Unlabeled Videos and Pretrained Language-Vision Modelscited by 20
20 more
  1. 2024T-FOLEY: A Controllable Waveform-Domain Diffusion Model for Temporal-Event-Guided Foley Sound Synthesiscited by 19
  2. 2023Audio Generation with Multiple Conditional Diffusion Modelcited by 18
  3. 2023EDMSound: Spectrogram Based Diffusion Models for Efficient and High-Quality Audio Synthesiscited by 15
  4. 2023Image Synthesis under Limited Data: A Survey and Taxonomycited by 9
  5. 2023Generative De-Quantization for Neural Speech Codec via Latent Diffusioncited by 9
  6. 2024Naturalistic Music Decoding from EEG Data via Latent Diffusion Modelscited by 8
  7. 2023A Unified Framework for Generative Data Augmentation: A Comprehensive Surveycited by 4
  8. 2026Woosh: A Sound Effects Foundation Modelcited by 4
  9. 2023Towards Flexible, Scalable, and Adaptive Multi-Modal Conditioned Face Synthesiscited by 3
  10. 2024Enhancing Emotional Text-to-Speech Controllability with Natural Language Guidance through Contrastive Learning and Diffusion Modelscited by 3
  11. 2024MambaFoley: Foley Sound Generation using Selective State-Space Modelscited by 3
  12. 2024AUTODIFF: Autoregressive Diffusion Modeling for Structure-based Drug Designcited by 2
  13. 2025SCORENF: Score-based Normalizing Flows for Sampling Unnormalized distributionscited by 2
  14. 2023Distribution Preserving Source Separation With Time Frequency Predictive Modelscited by 1
  15. 2023Energy-Based Models For Speech Synthesiscited by 1
  16. 2024Audio Decoding by Inverse Problem Solvingcited by 1
  17. 2025Predictive posterior sampling from non-stationnary Gaussian process priors via Diffusion models with application to climate datacited by 1
  18. 2025Poisson Flow Consistency Trainingcited by 0
  19. 2026Seasoning Generative Models for a Generalization Aftertastecited by 0
  20. 2026Exploring Efficient Waveform Diffusion Models for Foley Sound Generationcited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2025Audio Generation Through Score-Based Generative Modeling: Design Principles and Implementation
  2. 2022Multi-instrument Music Synthesis with Spectrogram Diffusion
  3. 2024A Survey of Deep Learning Audio Generation Methods
  4. 2025Score Distillation Sampling for Audio: Source Separation, Synthesis, and Beyond
  5. 2026AudioX-Turbo: A Unified Framework for Efficient Anything-to-Audio Generation
  6. 2025Audio Palette: A Diffusion Transformer with Multi-Signal Conditioning for Controllable Foley Synthesis
  7. 2024MDSGen: Fast and Efficient Masked Diffusion Temporal-Aware Transformers for Open-Domain Sound Generation
  8. 2026DDSynth-RL: Audio Synthesizer Inversion via Discrete Diffusion with Reinforcement Learning