Conditional Drums Generation using Compound Word Representations
Not on the map. Why?
Abstract (arXiv)
The field of automatic music composition has seen great progress in recent years, specifically with the invention of transformer-based architectures. When using any deep learning model which considers music as a sequence of events with multiple complex dependencies, the selection of a proper data representation is crucial. In this paper, we tackle the task of conditional drums generation using a novel data encoding scheme inspired by the Compound Word representation, a tokenization process of sequential data. Therefore, we present a sequence-to-sequence architecture where a Bidirectional Long short-term memory (BiLSTM) Encoder receives information about the conditioning parameters (i.e., accompanying tracks and musical attributes), while a Transformer-based Decoder with relative global attention produces the generated drum sequences. We conducted experiments to thoroughly compare the effectiveness of our method to several baselines. Quantitative evaluation shows that our model is able to generate drums sequences that have similar statistical distributions and characteristics to the training corpus. These features include syncopation, compression ratio, and symmetry among others. We also verified, through a listening test, that generated drum sequences sound pleasant, natural and coherent while they "groove" with the given accompaniment.
Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). Builds on 19 of its 48 references that are in the map. First posted on arXiv 9 Feb 2022.
Builds on
19 of 48 references.
References · 19
- 2017Attention Is All You Needcited by 59,932
- 2014Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translationcited by 4,016
- 2018Music Transformercited by 207
- 2017MuseGAN: Multi-track Sequential Generative Adversarial Networks for Symbolic Music Generation and Accompanimentcited by 151
- 2021Compound Word Transformer: Learning to Compose Full-Song Music over Dynamic Directed Hypergraphscited by 109
- 2016DeepBach: a Steerable Model for Bach Chorales Generationcited by 90
- 2018This Time with Feeling: Learning Expressive Musical Performancecited by 67
- 2020The Jazz Transformer on the Front Line: Exploring the Shortcomings of AI-composed Music through Quantitative Measurescited by 53
- 2021EMOPIA: A Multi-Modal Pop Piano Dataset For Emotion Recognition and Emotion-based Music Generationcited by 53
- 2020Music FaderNets: Controllable Music Generation Based On High-Level Features via Low-Level Feature Modellingcited by 45
- 2019Learning to Groove with Inverse Sequence Transformationscited by 33
- 2018A Functional Taxonomy of Music Generation Systemscited by 31
7 more
- 2018MorpheuS: generating structured music with constrained patterns and tensioncited by 22
- 2021Generating Lead Sheets with Affect: A Novel Conditional seq2seq Frameworkcited by 17
- 2019High-Level Control of Drum Track Generation Using Learned Patterns of Rhythmic Interactioncited by 14
- 2021Hierarchical Recurrent Neural Networks for Conditional Melody Generation with Long-term Structurecited by 12
- 2021BERT-like Pre-training for Symbolic Piano Music Classification Taskscited by 12
- 2018Lead Sheet Generation and Arrangement by Conditional Generative Adversarial Networkcited by 6
- 2017Talking Drums: Generating drum grooves with neural networkscited by 2
Built on by
Citing papers per year: 2022: 2; 2023: 1; 2024: 3; 2025: 0; 2026: 1.
7 papers.
- 2023Video2Music: Suitable Music Generation from Videos using an Affective Multimodal Transformer modelcited by 37
- 2022JukeDrummer: Conditional Beat-aware Audio-domain Drum Accompaniment Generation via Transformer VQ-VAEcited by 11
- 2024Natural Language Processing Methods for Symbolic Music Generation and Information Retrieval: a Surveycited by 10
- 2024Motifs, Phrases, and Beyond: The Modelling of Structure in Symbolic Music Generationcited by 6
- 2022LyricJam Sonic: A Generative System for Real-Time Composition and Musical Improvisationcited by 2
- 2024Text Conditioned Symbolic Drumbeat Generation using Latent Diffusion Modelscited by 2
- 2026Can pre-trained Deep Learning models predict groove ratings?cited by 0
- 2026Can pre-trained Deep Learning models predict groove ratings?28 Mar 2026
- 2024Text Conditioned Symbolic Drumbeat Generation using Latent Diffusion Models5 Aug 2024
- 2024Motifs, Phrases, and Beyond: The Modelling of Structure in Symbolic Music Generation12 Mar 2024
- 2024Natural Language Processing Methods for Symbolic Music Generation and Information Retrieval: a Survey27 Feb 2024
- 2023Video2Music: Suitable Music Generation from Videos using an Affective Multimodal Transformer model2 Nov 2023
- 2022LyricJam Sonic: A Generative System for Real-Time Composition and Musical Improvisation27 Oct 2022
- 2022JukeDrummer: Conditional Beat-aware Audio-domain Drum Accompaniment Generation via Transformer VQ-VAE12 Oct 2022