Integrating Text-to-Music Models with Language Models: Composing Long Structured Music Pieces
Not on the map. Why?
Abstract (arXiv)
Recent music generation methods based on transformers have a context window of up to a minute. The music generated by these methods is largely unstructured beyond the context window. With a longer context window, learning long-scale structures from musical data is a prohibitively challenging problem. This paper proposes integrating a text-to-music model with a large language model to generate music with form. The papers discusses the solutions to the challenges of such integration. The experimental results show that the proposed method can generate 2.5-minute-long music that is highly structured, strongly organized, and cohesive.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 21 of its 28 references that are in the map. First posted on arXiv 1 Oct 2024.
Builds on
21 of 28 references.
References · 21
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2023GPT-4 Technical Reportcited by 18,132
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2019Generating Diverse High-Fidelity Images with VQ-VAE-2cited by 1,376
- 2022High Fidelity Neural Audio Compressioncited by 673
- 2020Jukebox: A Generative Model for Musiccited by 535
- 2023Simple and Controllable Music Generationcited by 480
- 2023MusicLM: Generating Music From Textcited by 442
- 2022Emergent Analogical Reasoning in Large Language Modelscited by 239
- 2018Music Transformercited by 207
9 more
- 2024Many-Shot In-Context Learningcited by 203
- 2021Symbolic Music Generation with Diffusion Modelscited by 152
- 2024In-Context Learning with Long-Context Models: An In-Depth Explorationcited by 126
- 2022Multi-instrument Music Synthesis with Spectrogram Diffusioncited by 42
- 2024HanDiffuser: Text-to-Image Generation With Realistic Hand Appearancescited by 42
- 2024Hand1000: Generating Realistic Hands from Text with Only 1,000 Imagescited by 11
- 2019Enhanced Hierarchical Music Structure Annotations via Feature Level Similarity Fusioncited by 4
- 2023Empirical assessment of ChatGPT's answering capabilities in natural science and engineeringcited by 4
- 2024SpecDiff-GAN: A Spectrally-Shaped Noise Diffusion GAN for Speech and Music Synthesiscited by 3
Built on by
Not cited yet.