SinTra: Learning an inspiration model from a single multi-track music segment
Not on the map. Why?
Abstract (arXiv)
In this paper, we propose SinTra, an auto-regressive sequential generative model that can learn from a single multi-track music segment, to generate coherent, aesthetic, and variable polyphonic music of multi-instruments with an arbitrary length of bar. For this task, to ensure the relevance of generated samples and training music, we present a novel pitch-group representation. SinTra, consisting of a pyramid of Transformer-XL with a multi-scale training strategy, can learn both the musical structure and the relative positional relationship between notes of the single training music segment. Additionally, for maintaining the inter-track correlation, we use the convolution operation to process multi-track music, and when decoding, the tracks are independent to each other to prevent interference. We evaluate SinTra with both subjective study and objective metrics. The comparison results show that our framework can learn information from a single music segment more sufficiently than Music Transformer. Also the comparison between SinTra and its variant, i.e., the single-stage SinTra with the first stage only, shows that the pyramid structure can effectively suppress overly-fragmented notes.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 19 of its 34 references that are in the map. First posted on arXiv 21 Apr 2022.
Builds on
19 of 34 references.
References · 19
- 2017Attention Is All You Needcited by 60,361
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2022Generative Adversarial Networkscited by 5,627
- 2014Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translationcited by 4,057
- 2019The Curious Case of Neural Text Degenerationcited by 2,916
- 2019Transformer-XL: Attentive Language Models Beyond a Fixed-Length Contextcited by 1,850
- 2019Generating Long Sequences with Sparse Transformerscited by 1,546
- 2018Self-Attention with Relative Position Representationscited by 1,120
- 2019SinGAN: Learning a Generative Model from a Single Natural Imagecited by 348
- 2018Music Transformercited by 211
- 2017MuseGAN: Multi-track Sequential Generative Adversarial Networks for Symbolic Music Generation and Accompanimentcited by 151
- 2020Sparse GPU Kernels for Deep Learningcited by 141
7 more
- 2016C-RNN-GAN: Continuous recurrent neural networks with adversarial trainingcited by 132
- 2019LakhNES: Improving multi-instrumental music generation with cross-domain pre-trainingcited by 54
- 2019Transformers with convolutional context for ASRcited by 44
- 2020TOAD-GAN: Coherent Style Level Generation from a Single Examplecited by 22
- 2018Convolutional Generative Adversarial Networks with Binary Neurons for Polyphonic Music Generationcited by 20
- 2019MIDI-Sandwich2: RNN-based Hierarchical Multi-modal Fusion Generation VAE networks for multi-track symbolic music generationcited by 8
- 2020Transformer-XL Based Music Generation with Multiple Sequences of Time-valued Notescited by 5
Built on by
Citing papers per year: 2023: 2.
2 papers.