A Survey of Music Generation in the Context of Interaction
Not on the map. Why?
Abstract (arXiv)
In recent years, machine learning, and in particular generative adversarial neural networks (GANs) and attention-based neural networks (transformers), have been successfully used to compose and generate music, both melodies and polyphonic pieces. Current research focuses foremost on style replication (eg. generating a Bach-style chorale) or style transfer (eg. classical to jazz) based on large amounts of recorded or transcribed music, which in turn also allows for fairly straight-forward "performance" evaluation. However, most of these models are not suitable for human-machine co-creation through live interaction, neither is clear, how such models and resulting creations would be evaluated. This article presents a thorough review of music representation, feature analysis, heuristic algorithms, statistical and parametric modelling, and human and automatic evaluation measures, along with a discussion of which approaches and models seem most suitable for live interaction.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 57 of its 128 references that are in the map. First posted on arXiv 23 Feb 2024.
Builds on
57 of 128 references.
References · 57
- 2017Attention Is All You Needcited by 59,932
- 2022Generative Adversarial Networkscited by 5,603
- 2014Neural Machine Translation by Jointly Learning to Align and Translatecited by 4,530
- 2014Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modelingcited by 2,341
- 2016WaveNet: A Generative Model for Raw Audiocited by 1,710
- 2019Generating Long Sequences with Sparse Transformerscited by 1,523
- 2020Jukebox: A Generative Model for Musiccited by 535
- 2017Neural Audio Synthesis of Musical Notes with WaveNet Autoencoderscited by 222
- 2018Enabling Factorized Piano Music Modeling and Generation with the MAESTRO Datasetcited by 215
- 2018Music Transformercited by 207
- 2017MuseGAN: Multi-track Sequential Generative Adversarial Networks for Symbolic Music Generation and Accompanimentcited by 151
- 2018RSA: Byzantine-Robust Stochastic Aggregation Methods for Distributed Learning from Heterogeneous Datasetscited by 148
38 more
- 2018A Hierarchical Latent Vector Model for Learning Long-Term Structure in Musiccited by 131
- 2019GANSynth: Adversarial Neural Audio Synthesiscited by 114
- 2017Onsets and Frames: Dual-Objective Piano Transcriptioncited by 93
- 2016DeepBach: a Steerable Model for Bach Chorales Generationcited by 90
- 2017MidiNet: A Convolutional Generative Adversarial Network for Symbolic-domain Music Generationcited by 72
- 2020PopMAG: Pop Music Accompaniment Generationcited by 68
- 2018The challenge of realistic music generation: modelling raw audio at scalecited by 63
- 2016Learning Features of Music from Scratchcited by 57
- 2019LakhNES: Improving multi-instrumental music generation with cross-domain pre-trainingcited by 54
- 2020The Jazz Transformer on the Front Line: Exploring the Shortcomings of AI-composed Music through Quantitative Measurescited by 53
- 2020MMM : Exploring Conditional Multi-Track Music Generation with the Transformercited by 48
- 2020Music FaderNets: Controllable Music Generation Based On High-Level Features via Low-Level Feature Modellingcited by 45
- 2020Learning Interpretable Representation for Controllable Polyphonic Music Generationcited by 40
- 2020MusPy: A Toolkit for Symbolic Music Generationcited by 37
- 2019Encoding Musical Style with Transformer Autoencoderscited by 35
- 2018MIDI-VAE: Modeling Dynamics and Instrumentation of Music with Applications to Style Transfercited by 33
- 2019Learning to Groove with Inverse Sequence Transformationscited by 33
- 2018SING: Symbol-to-Instrument Neural Generatorcited by 23
- 2017GLSR-VAE: Geodesic Latent Space Regularization for Variational AutoEncoder Architecturescited by 22
- 2018Convolutional Generative Adversarial Networks with Binary Neurons for Polyphonic Music Generationcited by 20
- 2020Pop Music Transformer: Beat-based Modeling and Generation of Expressive Pop Piano Compositionscited by 16
- 2020Improving Perceptual Quality of Drum Transcription with the Expanded Groove MIDI Datasetcited by 16
- 2018Neural Music Synthesis for Flexible Timbre Controlcited by 14
- 2016Song From PI: A Musically Plausible Network for Pop Music Generationcited by 13
- 2018DeepJ: Style-Specific Music Generationcited by 12
- 2018PerformanceNet: Score-to-Audio Music Generation with Multi-Band Convolutional Residual Networkcited by 11
- 2022A Review of Intelligent Music Generation Systemscited by 11
- 2018Conditioning Deep Generative Raw Audio Models for Structured Automatic Musiccited by 10
- 2018From Context to Concept: Exploring Semantic Relationships in Music with Word2Veccited by 9
- 2020Hierarchical Timbre-Painting and Articulation Generationcited by 9
- 2017Chord Generation from Symbolic Melody Using BLSTM Networkscited by 8
- 2019MIDI-Sandwich2: RNN-based Hierarchical Multi-modal Fusion Generation VAE networks for multi-track symbolic music generationcited by 8
- 2014Polyphonic Music Generation by Modeling Temporal Dependencies Using a RNN-DBNcited by 6
- 2016Deep Learning for Musiccited by 6
- 2018Lead Sheet Generation and Arrangement by Conditional Generative Adversarial Networkcited by 6
- 2020Deep generative models for musical audio synthesiscited by 6
- 2019LSTM Based Music Generation Systemcited by 5
- 2020Generating Music with a Self-Correcting Non-Chronological Autoregressive Modelcited by 5
50 most cited of 57 All 57 (JSON)
Built on by
Citing papers per year: 2025: 1; 2026: 1.
2 papers.