A Functional Taxonomy of Music Generation Systems
Not on the map. Why?
Abstract (arXiv)
Digital advances have transformed the face of automatic music generation since its beginnings at the dawn of computing. Despite the many breakthroughs, issues such as the musical tasks targeted by different machines and the degree to which they succeed remain open questions. We present a functional taxonomy for music generation systems with reference to existing systems. The taxonomy organizes systems according to the purposes for which they were designed. It also reveals the inter-relatedness amongst the systems. This design-centered approach contrasts with predominant methods-based surveys and facilitates the identification of grand challenges to set the stage for new breakthroughs.
Key facts. Cited by 31 papers in the map (data through 7 Oct 2026). First posted on arXiv 11 Dec 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 5; 2022: 3; 2023: 9; 2024: 7; 2025: 6; 2026: 1.
31 papers.
Sort:
By area:
- 2023Mustango: Toward Controllable Text-to-Music Generationcited by 100
- 2023Video2Music: Suitable Music Generation from Videos using an Affective Multimodal Transformer modelcited by 37
- 2024MidiCaps: A large-scale MIDI dataset with text captionscited by 19
- 2024Text2midi: Generating Symbolic Music from Captionscited by 18
- 2021Generating Lead Sheets with Affect: A Novel Conditional seq2seq Frameworkcited by 17
- 2022A Domain-Knowledge-Inspired Music Embedding Space and a Novel Attention Mechanism for Symbolic Music Modelingcited by 17
- 2021Hierarchical Recurrent Neural Networks for Conditional Melody Generation with Long-term Structurecited by 12
- 2023Storyfier: Exploring Vocabulary Learning Support with Text Generation Modelscited by 12
- 2021Structure-Enhanced Pop Music Generation via Harmony-Aware Learningcited by 11
- 2022A Review of Intelligent Music Generation Systemscited by 11
- 2024Natural Language Processing Methods for Symbolic Music Generation and Information Retrieval: a Surveycited by 10
- 2025Survey on the Evaluation of Generative Models in Musiccited by 10
19 more
- 2023AI-Based Affective Music Generation Systems: A Review of Methods, and Challengescited by 9
- 2023Exploring XAI for the Arts: Explaining Latent Space in Generative Musiccited by 8
- 2022Conditional Drums Generation using Compound Word Representationscited by 7
- 2023Exploring Variational Auto-Encoder Architectures, Configurations, and Datasets for Generative Music Explainable AIcited by 4
- 2025A Comprehensive Survey on Generative AI for Video-to-Music Generationcited by 4
- 2023jazznet: A Dataset of Fundamental Piano Patterns for Music Audio Machine Learning Researchcited by 3
- 2023An Comparative Analysis of Different Pitch and Metrical Grid Encoding Methods in the Task of Sequential Music Generationcited by 2
- 2024BandCondiNet: Parallel Transformers-based Conditional Popular Music Generation with Multi-View Featurescited by 2
- 2024Text Conditioned Symbolic Drumbeat Generation using Latent Diffusion Modelscited by 2
- 2024Applications and Advances of Artificial Intelligence in Music Generation:A Reviewcited by 2
- 2021Musical Speech: A Transformer-based Composition Toolcited by 1
- 2023AffectMachine-Classical: A novel system for generating affective classical musiccited by 1
- 2024Prevailing Research Areas for Music AI in the Era of Foundation Modelscited by 1
- 2021aiSTROM -- A roadmap for developing a successful AI strategycited by 0
- 2025ComposeOn Academy: Transforming Melodic Ideas into Complete Compositions Integrating Music Learningcited by 0
- 2025Apollo: An Interactive Environment for Generating Symbolic Musical Phrases using Corpus-based Style Imitationcited by 0
- 2025Aligning Generative Music AI with Human Preferences: Methods and Challengescited by 0
- 2025Perception of AI-Generated Music -- The Role of Composer Identity, Personality Traits, Music Preferences, and Perceived Humannesscited by 0
- 2026Advanced Scientific Methodology Plays Rossinicited by 0
- 2026Advanced Scientific Methodology Plays Rossini12 May 2026
- 2025Perception of AI-Generated Music -- The Role of Composer Identity, Personality Traits, Music Preferences, and Perceived Humanness2 Dec 2025
- 2025Aligning Generative Music AI with Human Preferences: Methods and Challenges19 Nov 2025
- 2025Survey on the Evaluation of Generative Models in Music5 Jun 2025
- 2025Apollo: An Interactive Environment for Generating Symbolic Musical Phrases using Corpus-based Style Imitation18 Apr 2025
- 2025ComposeOn Academy: Transforming Melodic Ideas into Complete Compositions Integrating Music Learning21 Feb 2025
- 2025A Comprehensive Survey on Generative AI for Video-to-Music Generation18 Feb 2025
- 2024Text2midi: Generating Symbolic Music from Captions21 Dec 2024
- 2024Prevailing Research Areas for Music AI in the Era of Foundation Models14 Sep 2024
- 2024Applications and Advances of Artificial Intelligence in Music Generation:A Review3 Sep 2024
- 2024Text Conditioned Symbolic Drumbeat Generation using Latent Diffusion Models5 Aug 2024
- 2024BandCondiNet: Parallel Transformers-based Conditional Popular Music Generation with Multi-View Features15 Jul 2024
19 more
- 2024MidiCaps: A large-scale MIDI dataset with text captions4 Jun 2024
- 2024Natural Language Processing Methods for Symbolic Music Generation and Information Retrieval: a Survey27 Feb 2024
- 2023Mustango: Toward Controllable Text-to-Music Generation14 Nov 2023
- 2023Exploring Variational Auto-Encoder Architectures, Configurations, and Datasets for Generative Music Explainable AI14 Nov 2023
- 2023Video2Music: Suitable Music Generation from Videos using an Affective Multimodal Transformer model2 Nov 2023
- 2023Exploring XAI for the Arts: Explaining Latent Space in Generative Music10 Aug 2023
- 2023Storyfier: Exploring Vocabulary Learning Support with Text Generation Models7 Aug 2023
- 2023AffectMachine-Classical: A novel system for generating affective classical music11 Apr 2023
- 2023jazznet: A Dataset of Fundamental Piano Patterns for Music Audio Machine Learning Research17 Feb 2023
- 2023An Comparative Analysis of Different Pitch and Metrical Grid Encoding Methods in the Task of Sequential Music Generation31 Jan 2023
- 2023AI-Based Affective Music Generation Systems: A Review of Methods, and Challenges10 Jan 2023
- 2022A Domain-Knowledge-Inspired Music Embedding Space and a Novel Attention Mechanism for Symbolic Music Modeling2 Dec 2022
- 2022A Review of Intelligent Music Generation Systems16 Nov 2022
- 2022Conditional Drums Generation using Compound Word Representations9 Feb 2022
- 2021Structure-Enhanced Pop Music Generation via Harmony-Aware Learning14 Sep 2021
- 2021Musical Speech: A Transformer-based Composition Tool2 Aug 2021
- 2021aiSTROM -- A roadmap for developing a successful AI strategy25 Jun 2021
- 2021Generating Lead Sheets with Affect: A Novel Conditional seq2seq Framework27 Apr 2021
- 2021Hierarchical Recurrent Neural Networks for Conditional Melody Generation with Long-term Structure19 Feb 2021
- 2023Video2Music: Suitable Music Generation from Videos using an Affective Multimodal Transformer modelcited by 37
- 2024MidiCaps: A large-scale MIDI dataset with text captionscited by 19
- 2024Text2midi: Generating Symbolic Music from Captionscited by 18
- 2021Generating Lead Sheets with Affect: A Novel Conditional seq2seq Frameworkcited by 17
- 2022A Domain-Knowledge-Inspired Music Embedding Space and a Novel Attention Mechanism for Symbolic Music Modelingcited by 17
- 2021Hierarchical Recurrent Neural Networks for Conditional Melody Generation with Long-term Structurecited by 12
- 2023Storyfier: Exploring Vocabulary Learning Support with Text Generation Modelscited by 12
- 2021Structure-Enhanced Pop Music Generation via Harmony-Aware Learningcited by 11
- 2022A Review of Intelligent Music Generation Systemscited by 11
- 2024Natural Language Processing Methods for Symbolic Music Generation and Information Retrieval: a Surveycited by 10
- 2025Survey on the Evaluation of Generative Models in Musiccited by 10
- 2023AI-Based Affective Music Generation Systems: A Review of Methods, and Challengescited by 9
12 most cited of 28 All 28 (JSON)
- 2026Advanced Scientific Methodology Plays Rossini12 May 2026
- 2025Perception of AI-Generated Music -- The Role of Composer Identity, Personality Traits, Music Preferences, and Perceived Humanness2 Dec 2025
- 2025Survey on the Evaluation of Generative Models in Music5 Jun 2025
- 2025Apollo: An Interactive Environment for Generating Symbolic Musical Phrases using Corpus-based Style Imitation18 Apr 2025
- 2025ComposeOn Academy: Transforming Melodic Ideas into Complete Compositions Integrating Music Learning21 Feb 2025
- 2025A Comprehensive Survey on Generative AI for Video-to-Music Generation18 Feb 2025
- 2024Text2midi: Generating Symbolic Music from Captions21 Dec 2024
- 2024Prevailing Research Areas for Music AI in the Era of Foundation Models14 Sep 2024
- 2024Applications and Advances of Artificial Intelligence in Music Generation:A Review3 Sep 2024
- 2024BandCondiNet: Parallel Transformers-based Conditional Popular Music Generation with Multi-View Features15 Jul 2024
- 2024MidiCaps: A large-scale MIDI dataset with text captions4 Jun 2024
- 2024Natural Language Processing Methods for Symbolic Music Generation and Information Retrieval: a Survey27 Feb 2024
12 newest of 28 All 28 (JSON)