mlsanityData to 14 Oct 2026

A Survey of AI Music Generation Tools and Models

arXiv 2308.12982 ↗First posted 24 Aug 2023cs.SD cs.AI cs.HCcited by 9

Not on the map. Why?

Abstract (arXiv)

In this work, we provide a comprehensive survey of AI music generation tools, including both research projects and commercialized applications. To conduct our analysis, we classified music generation approaches into three categories: parameter-based, text-based, and visual-based classes. Our survey highlights the diverse possibilities and functional features of these tools, which cater to a wide range of users, from regular listeners to professional musicians. We observed that each tool has its own set of advantages and limitations. As a result, we have compiled a comprehensive list of these factors that should be considered during the tool selection process. Moreover, our survey offers critical insights into the underlying mechanisms and challenges of AI music generation.

Key facts. Cited by 9 papers in the map (data through 14 Oct 2026). Builds on 42 of its 101 references that are in the map. First posted on arXiv 24 Aug 2023.

Builds on

42 of 101 references.

References · 42

  1. 2017Attention Is All You Needcited by 60,361
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  3. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
  4. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
  5. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,058
  6. 2017mixup: Beyond Empirical Risk Minimizationcited by 5,183
  7. 2017Neural Discrete Representation Learningcited by 4,712
  8. 2016WaveNet: A Generative Model for Raw Audiocited by 1,722
  9. 2019Generating Long Sequences with Sparse Transformerscited by 1,546
  10. 2019Generating Diverse High-Fidelity Images with VQ-VAE-2cited by 1,387
  11. 2021SoundStream: An End-to-End Neural Audio Codeccited by 771
  12. 2022Large-scale Contrastive Language-Audio Pretraining with Feature Fusion and Keyword-to-Caption Augmentationcited by 719
30 more
  1. 2020Jukebox: A Generative Model for Musiccited by 542
  2. 2019Release Strategies and the Social Impacts of Language Modelscited by 513
  3. 2023Simple and Controllable Music Generationcited by 488
  4. 2021Diffusion Autoencoders: Toward a Meaningful and Decodable Representationcited by 449
  5. 2023MusicLM: Generating Music From Textcited by 448
  6. 2018Fundamentals of Recurrent Neural Network (RNN) and Long Short-Term Memory (LSTM) Networkcited by 420
  7. 2021W2v-BERT: Combining Contrastive Learning and Masked Language Modeling for Self-Supervised Speech Pre-Trainingcited by 347
  8. 2023Make-An-Audio: Text-To-Audio Generation with Prompt-Enhanced Diffusion Modelscited by 324
  9. 2017Neural Audio Synthesis of Musical Notes with WaveNet Autoencoderscited by 225
  10. 2018Fr'echet Audio Distance: A Metric for Evaluating Music Enhancement Algorithmscited by 225
  11. 2023Noise2Music: Text-conditioned Music Generation with Diffusion Modelscited by 173
  12. 2017MuseGAN: Multi-track Sequential Generative Adversarial Networks for Symbolic Music Generation and Accompanimentcited by 151
  13. 2017Learning to Generate Reviews and Discovering Sentimentcited by 148
  14. 2018A Hierarchical Latent Vector Model for Learning Long-Term Structure in Musiccited by 131
  15. 2019GANSynth: Adversarial Neural Audio Synthesiscited by 116
  16. 2021Compound Word Transformer: Learning to Compose Full-Song Music over Dynamic Directed Hypergraphscited by 110
  17. 2022MuLan: A Joint Embedding of Music Audio and Natural Languagecited by 87
  18. 2020Foley Music: Learning to Generate Music from Videoscited by 83
  19. 2021Video Background Music Generation with Controllable Music Transformercited by 56
  20. 2020Audeo: Audio Generation for a Silent Performance Videocited by 47
  21. 2022Quantized GAN for Complex Music Generation from Dance Videoscited by 37
  22. 2019Learning to Groove with Inverse Sequence Transformationscited by 34
  23. 2021Learning to Generate Music With Sentimentcited by 29
  24. 2022Video Background Music Generation: Dataset, Method and Evaluationcited by 29
  25. 2016Multiplicative LSTM for sequence modellingcited by 27
  26. 2017Music Generation by Deep Learning - Challenges and Directionscited by 24
  27. 2022It's Time for Artistic Correspondence in Music and Videocited by 18
  28. 2021Music Composition with Deep Learning: A Reviewcited by 12
  29. 2022SDMuse: Stochastic Differential Music Editing and Generation via Hybrid Representationcited by 11
  30. 2022A Review of Intelligent Music Generation Systemscited by 11

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 3; 2025: 5; 2026: 1.

9 papers.

  1. 2024Foundation Models for Music: A Surveycited by 37
  2. 2024Natural Language Processing Methods for Symbolic Music Generation and Information Retrieval: a Surveycited by 10
  3. 2025Towards Enhanced Immersion and Agency for LLM-based Interactive Dramacited by 9
  4. 2024Music Consistency Modelscited by 7
  5. 2025Vision-to-Music Generation: A Surveycited by 4
  6. 2025MusFlow: Multimodal Music Generation via Conditional Flow Matchingcited by 4
  7. 2025Auto-Regressive vs Flow-Matching: a Comparative Study of Modeling Paradigms for Text-to-Music Generationcited by 2
  8. 2026CoLyricist: Enhancing Lyric Writing with AI through Workflow-Aligned Supportcited by 1
  9. 2025Go witheFlow: Real-time Emotion Driven Audio Effects Modulationcited by 0