Progressive distillation diffusion for raw music generation
Not on the map. Why?
Abstract (arXiv)
This paper aims to apply a new deep learning approach to the task of generating raw audio files. It is based on diffusion models, a recent type of deep generative model. This new type of method has recently shown outstanding results with image generation. A lot of focus has been given to those models by the computer vision community. On the other hand, really few have been given for other types of applications such as music generation in waveform domain. In this paper the model for unconditional generating applied to music is implemented: Progressive distillation diffusion with 1D U-Net. Then, a comparison of different parameters of diffusion and their value in a full result is presented. One big advantage of the methods implemented through this work is the fact that the model is able to deal with progressing audio processing and generating , using transformation from 1-channel 128 x 384 to 3-channel 128 x 128 mel-spectrograms and looped generation. The empirical comparisons are realized across different self-collected datasets.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 18 of its 23 references that are in the map. First posted on arXiv 20 Jul 2023.
Builds on
18 of 23 references.
References · 18
- 2016Improved Techniques for Training GANscited by 2,938
- 2016WaveNet: A Generative Model for Raw Audiocited by 1,710
- 2020DiffWave: A Versatile Diffusion Model for Audio Synthesiscited by 1,339
- 2018Demystifying MMD GANscited by 1,268
- 2020WaveGrad: Estimating Gradients for Waveform Generationcited by 620
- 2023AudioLDM: Text-to-Audio Generation with Latent Diffusion Modelscited by 592
- 2018A Note on the Inception Scorecited by 225
- 2023Noise2Music: Text-conditioned Music Generation with Diffusion Modelscited by 173
- 2019GANSynth: Adversarial Neural Audio Synthesiscited by 114
- 2016SampleRNN: An Unconditional End-to-End Neural Audio Generation Modelcited by 110
- 2022BinauralGrad: A Two-Stage Conditional Diffusion Probabilistic Model for Binaural Audio Synthesiscited by 44
- 2019The Zero Resource Speech Challenge 2019: TTS without Tcited by 38
6 more
- 2022NU-Wave 2: A General Neural Audio Upsampling Model for Various Sampling Ratescited by 36
- 2022Musika! Fast Infinite Waveform Music Generationcited by 24
- 2019'Zhores' -- Petaflops supercomputer for data-driven modeling, machine learning and artificial intelligence installed in Skolkovo Institute of Science and Technologycited by 23
- 2023ArchiSound: Audio Generation with Diffusioncited by 20
- 2020Unconditional Audio Generation with Generative Adversarial Networks and Cycle Regularizationcited by 12
- 2019Closed-form Expressions for Maximum Mean Discrepancy with Applications to Wasserstein Auto-Encoderscited by 11
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2024Presto! Distilling Steps and Layers for Accelerating Music Generation
- 2026Diff-VS: Efficient Audio-Aware Diffusion U-Net for Vocals Separation
- 2024Network Bending of Diffusion Models for Audio-Visual Generation
- 2023EDMSound: Spectrogram Based Diffusion Models for Efficient and High-Quality Audio Synthesis
- 2023Timbre transfer using image-to-image denoising diffusion implicit models
- 2023DiffuseRoll: Multi-track multi-category music generation based on diffusion model
- 2024Diffusion Models for Audio Restoration
- 2024Long-form music generation with latent diffusion