mlsanityData to 7 Oct 2026

GANSynth: Adversarial Neural Audio Synthesis

arXiv 1902.08710 ↗First posted 23 Feb 2019cs.SD cs.LG eess.AScited by 114

Not on the map. Why?

Abstract (arXiv)

Efficient audio synthesis is an inherently difficult machine learning task, as human perception is sensitive to both global structure and fine-scale waveform coherence. Autoregressive models, such as WaveNet, model local structure at the expense of global latent structure and slow iterative sampling, while Generative Adversarial Networks (GANs), have global latent conditioning and efficient parallel sampling, but struggle to generate locally-coherent audio waveforms. Herein, we demonstrate that GANs can in fact generate high-fidelity and locally-coherent audio by modeling log magnitudes and instantaneous frequencies with sufficient frequency resolution in the spectral domain. Through extensive empirical investigations on the NSynth dataset, we demonstrate that GANs are able to outperform strong WaveNet baselines on automated and human evaluation metrics, and efficiently generate audio several orders of magnitude faster than their autoregressive counterparts.

Key facts. Cited by 114 papers in the map (data through 7 Oct 2026). First posted on arXiv 23 Feb 2019.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2020: 1; 2021: 34; 2022: 21; 2023: 17; 2024: 18; 2025: 22; 2026: 1.

114 papers.

Sort:

By area:

  1. 2020DiffWave: A Versatile Diffusion Model for Audio Synthesiscited by 1,339
  2. 2021Symbolic Music Generation with Diffusion Modelscited by 152
  3. 2023Vocos: Closing the gap between time-domain and Fourier-based neural vocoders for high-quality audio synthesiscited by 150
  4. 2021WaveGrad 2: Iterative Refinement for Text-to-Speech Synthesiscited by 65
  5. 2022Learning Neural Acoustic Fieldscited by 65
  6. 2024Humanoid Locomotion as Next Token Predictioncited by 63
  7. 2021PSA-GAN: Progressive Self Attention GANs for Synthetic Time Seriescited by 58
  8. 2023SingSong: Generating musical accompaniments from singingcited by 54
  9. 2022Multi-instrument Music Synthesis with Spectrogram Diffusioncited by 42
  10. 2021CRASH: Raw Audio Score-based Generative Modeling for Controllable High-resolution Drum Sound Synthesiscited by 37
  11. 2021FAST-RIR: Fast neural diffuse room impulse response generatorcited by 35
  12. 2021Image2Reverb: Cross-Modal Reverb Impulse Response Synthesiscited by 34
38 more
  1. 2021MIDI-DDSP: Detailed Control of Musical Performance via Hierarchical Modelingcited by 31
  2. 2021Copyright in Generative Deep Learningcited by 29
  3. 2022Musika! Fast Infinite Waveform Music Generationcited by 24
  4. 2021Geometry-Aware Multi-Task Learning for Binaural Audio Generation from Videocited by 22
  5. 2021Creativity and Machine Learning: A Surveycited by 21
  6. 2021FoleyGAN: Visually Guided Generative Adversarial Network-Based Synchronous Sound Generation in Silent Videoscited by 20
  7. 2022Evaluating generative audio systems and their metricscited by 16
  8. 2024Bass Accompaniment Generation via Latent Diffusioncited by 16
  9. 2021Catch-A-Waveform: Learning to Generate Audio from a Single Short Examplecited by 15
  10. 2021A review of Generative Adversarial Networks (GANs) and its applications in a wide variety of disciplines -- From Medical to Remote Sensingcited by 13
  11. 2022DDX7: Differentiable FM Synthesis of Musical Instrument Soundscited by 13
  12. 2022DiffRoll: Diffusion-based Generative Music Transcription with Unsupervised Pretraining Capabilitycited by 13
  13. 2021Energy Consumption of Deep Generative Audio Modelscited by 12
  14. 2021Neural Waveshaping Synthesiscited by 12
  15. 2022Deep Performer: Score-to-Audio Music Performance Synthesiscited by 12
  16. 2022JukeDrummer: Conditional Beat-aware Audio-domain Drum Accompaniment Generation via Transformer VQ-VAEcited by 11
  17. 2022A Review of Intelligent Music Generation Systemscited by 11
  18. 2024FreGrad: Lightweight and Fast Frequency-aware Diffusion Vocodercited by 11
  19. 2022The Chamber Ensemble Generator: Limitless High-Quality MIR Data via Generative Modelingcited by 10
  20. 2024The Music Maestro or The Musically Challenged, A Massive Music Evaluation Benchmark for Large Language Modelscited by 10
  21. 2025Survey on the Evaluation of Generative Models in Musiccited by 10
  22. 2022Audio representations for deep learning in sound synthesis: A reviewcited by 9
  23. 2022GANStrument: Adversarial Instrument Sound Synthesis with Pitch-invariant Instance Conditioningcited by 9
  24. 2023An Overview on Generative AI at Scale with Edge-Cloud Computingcited by 9
  25. 2023A Survey of AI Music Generation Tools and Modelscited by 9
  26. 2023Deep Integrated Explanationscited by 9
  27. 2022Music Separation Enhancement with Generative Modelingcited by 8
  28. 2023Time-series Generation by Contrastive Imitationcited by 8
  29. 2024DiffMoog: a Differentiable Modular Synthesizer for Sound Matchingcited by 7
  30. 2025MusGO: A Community-Driven Framework For Assessing Openness in Music-Generative AIcited by 7
  31. 2021Collaborative Learning to Generate Audio-Video Jointlycited by 6
  32. 2021Soundify: Matching Sound Effects to Videocited by 6
  33. 2023Msanii: High Fidelity Music Synthesis on a Shoestring Budgetcited by 6
  34. 2024An Order-Complexity Aesthetic Assessment Model for Aesthetic-aware Music Recommendationcited by 6
  35. 2021GANmapper: geographical data translationcited by 5
  36. 2021Generating Diverse Realistic Laughter for Interactive Artcited by 5
  37. 2024Expressive Acoustic Guitar Sound Synthesis with an Instrument-Specific Input Representation and Diffusion Outpaintingcited by 5
  38. 2025TokenSynth: A Token-based Neural Synthesizer for Instrument Cloning and Text-to-Instrumentcited by 5

50 most cited of 114 All 114 (JSON)