BumbleBee: A Transformer for Music
Not on the map. Why?
Abstract (arXiv)
We will introduce BumbleBee, a transformer model that will generate MIDI music data . We will tackle the issue of transformers applied to long sequences by implementing a longformer generative model that uses dilating sliding windows to compute the attention layers. We will compare our results to that of the music transformer and Long-Short term memory (LSTM) to benchmark our results. This analysis will be performed using piano MIDI files, in particular , the JSB Chorales dataset that has already been used for other research works (Huang et al., 2018)
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 9 of its 10 references that are in the map. First posted on arXiv 7 Jul 2021.
Builds on
9 of 10 references.
References · 9
- 2020Longformer: The Long-Document Transformercited by 3,413
- 2020Jukebox: A Generative Model for Musiccited by 542
- 2018Music Transformercited by 211
- 2017MuseGAN: Multi-track Sequential Generative Adversarial Networks for Symbolic Music Generation and Accompanimentcited by 151
- 2018A Hierarchical Latent Vector Model for Learning Long-Term Structure in Musiccited by 131
- 2016DeepBach: a Steerable Model for Bach Chorales Generationcited by 91
- 2017MidiNet: A Convolutional Generative Adversarial Network for Symbolic-domain Music Generationcited by 72
- 2019Counterpoint by Convolutioncited by 43
- 2017A Hierarchical Recurrent Neural Network for Symbolic Melody Generationcited by 14
Built on by
Citing papers per year: 2023: 1.
1 paper.