mlsanityData to 14 Oct 2026

SampleRNN: An Unconditional End-to-End Neural Audio Generation Model

arXiv 1612.07837 ↗First posted 22 Dec 2016cs.SD cs.AIcited by 110

Not on the map. Why?

Cited by 21 in Diffusion models, but placed by its own abstract, which didn’t fit.

Abstract (arXiv)

In this paper we propose a novel model for unconditional audio generation based on generating one audio sample at a time. We show that our model, which profits from combining memory-less modules, namely autoregressive multilayer perceptrons, and stateful recurrent neural networks in a hierarchical structure is able to capture underlying sources of variations in the temporal sequences over very long time spans, on three datasets of different nature. Human evaluation on the generated samples indicate that our model is preferred over competing models. We also show how each component of the model contributes to the exhibited performance.

Key facts. Cited by 110 papers in the map (data through 14 Oct 2026). First posted on arXiv 22 Dec 2016.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2020: 1; 2021: 29; 2022: 29; 2023: 14; 2024: 24; 2025: 10; 2026: 3.

110 papers.

Sort:

By area:

  1. 2020DiffWave: A Versatile Diffusion Model for Audio Synthesiscited by 1,354
  2. 2021SoundStream: An End-to-End Neural Audio Codeccited by 771
  3. 2023High-Fidelity Audio Compression with Improved RVQGANcited by 431
  4. 2021Deep Generative Modelling: A Comparative Review of VAEs, GANs, Normalizing Flows, Energy-Based and Autoregressive Modelscited by 252
  5. 2022BigVGAN: A Universal Neural Vocoder with Large-Scale Trainingcited by 251
  6. 2024Deep Time Series Models: A Comprehensive Survey and Benchmarkcited by 197
  7. 2021A Survey on Neural Speech Synthesiscited by 184
  8. 2022It's Raw! Audio Generation with State-Space Modelscited by 171
  9. 2023Vocos: Closing the gap between time-domain and Fourier-based neural vocoders for high-quality audio synthesiscited by 153
  10. 2021Taming Visually Guided Sound Generationcited by 136
  11. 2023Return of Unconditional Generation: A Self-supervised Representation Generation Methodcited by 98
  12. 2024Long-form music generation with latent diffusioncited by 89
38 more
  1. 2021WaveFake: A Data Set to Facilitate Audio Deepfake Detectioncited by 78
  2. 2022HEAR: Holistic Evaluation of Audio Representationscited by 78
  3. 2021RAVE: A variational autoencoder for fast and high-quality neural audio synthesiscited by 73
  4. 2022Synthetic Data -- what, why and how?cited by 67
  5. 2021Codified audio language modeling learns useful representations for music information retrievalcited by 64
  6. 2022General-purpose, long-context autoregressive modeling with Perceiver ARcited by 60
  7. 2023SingSong: Generating musical accompaniments from singingcited by 55
  8. 2022Long Document Summarization with Top-down and Bottom-up Inferencecited by 42
  9. 2022Multi-instrument Music Synthesis with Spectrogram Diffusioncited by 42
  10. 2025Kling-Foley: Multimodal Diffusion Transformer for High-Quality Video-to-Audio Generationcited by 40
  11. 2021CRASH: Raw Audio Score-based Generative Modeling for Controllable High-resolution Drum Sound Synthesiscited by 37
  12. 2022SpecGrad: Diffusion Probabilistic Model based Neural Vocoder with Adaptive Noise Spectral Shapingcited by 37
  13. 2024Foundation Models for Music: A Surveycited by 37
  14. 2024Tell What You Hear From What You See -- Video to Audio Generation Through Textcited by 34
  15. 2021Property Inference Attacks Against GANscited by 33
  16. 2024Diff-A-Riff: Musical Accompaniment Co-creation via Latent Diffusion Modelscited by 33
  17. 2022InferGrad: Improving Diffusion Models for Vocoder by Considering Inference in Trainingcited by 28
  18. 2024Masked Generative Video-to-Audio Transformers with Enhanced Synchronicitycited by 28
  19. 2023AI-Generated Content (AIGC) for Various Data Modalities: A Surveycited by 25
  20. 2021Conditional Sound Generation Using Neural Discrete Time-Frequency Representation Learningcited by 24
  21. 2022Musika! Fast Infinite Waveform Music Generationcited by 24
  22. 2024From Vision to Audio and Beyond: A Unified Model for Audio-Visual Representation and Generationcited by 23
  23. 2022ResGrad: Residual Denoising Diffusion Probabilistic Models for Text to Speechcited by 21
  24. 2022WaveFit: An Iterative and Non-autoregressive Neural Vocoder based on Fixed-Point Iterationcited by 20
  25. 2021Parallel and Flexible Sampling from Autoregressive Models via Langevin Dynamicscited by 19
  26. 2024Bass Accompaniment Generation via Latent Diffusioncited by 16
  27. 2024VinTAGe: Joint Video and Text Conditioning for Holistic Audio Generationcited by 16
  28. 2021Catch-A-Waveform: Learning to Generate Audio from a Single Short Examplecited by 15
  29. 2023ERNIE-Music: Text-to-Waveform Music Generation with Diffusion Modelscited by 15
  30. 2023EDMSound: Spectrogram Based Diffusion Models for Efficient and High-Quality Audio Synthesiscited by 15
  31. 2022Symbolic music generation conditioned on continuous-valued emotionscited by 13
  32. 2022DDX7: Differentiable FM Synthesis of Musical Instrument Soundscited by 13
  33. 2024Simultaneous Music Separation and Generation Using Multi-Track Latent Diffusion Modelscited by 13
  34. 2025Discovering and Steering Interpretable Concepts in Large Generative Music Modelscited by 13
  35. 2021Hierarchical Recurrent Neural Networks for Conditional Melody Generation with Long-term Structurecited by 12
  36. 2021Energy Consumption of Deep Generative Audio Modelscited by 12
  37. 2021Neural Waveshaping Synthesiscited by 12
  38. 2022HyperSound: Generating Implicit Neural Representations of Audio Signals with Hypernetworkscited by 12

50 most cited of 110 All 110 (JSON)