JAMMIN-GPT: Text-based Improvisation using LLMs in Ableton Live
Not on the map. Why?
Abstract (arXiv)
We introduce a system that allows users of Ableton Live to create MIDI-clips by naming them with musical descriptions. Users can compose by typing the desired musical content directly in Ableton's clip view, which is then inserted by our integrated system. This allows users to stay in the flow of their creative process while quickly generating musical ideas. The system works by prompting ChatGPT to reply using one of several text-based musical formats, such as ABC notation, chord symbols, or drum tablature. This is an important step in integrating generative AI tools into pre-existing musical workflows, and could be valuable for content makers who prefer to express their creative vision through descriptive language. Code is available at https://github.com/supersational/JAMMIN-GPT.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 11 of its 18 references that are in the map. First posted on arXiv 6 Dec 2023.
Builds on
11 of 18 references.
References · 11
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
- 2022AudioLM: a Language Modeling Approach to Audio Generationcited by 611
- 2023AudioLDM: Text-to-Audio Generation with Latent Diffusion Modelscited by 592
- 2023Simple and Controllable Music Generationcited by 480
- 2018Music Transformercited by 207
- 2018A Hierarchical Latent Vector Model for Learning Long-Term Structure in Musiccited by 131
- 2020MMM : Exploring Conditional Multi-Track Music Generation with the Transformercited by 48
- 2020AI Song Contest: Human-AI Co-Creation in Songwritingcited by 25
- 2019High-Level Control of Drum Track Generation Using Learned Patterns of Rhythmic Interactioncited by 14
- 2023Exploring XAI for the Arts: Explaining Latent Space in Generative Musiccited by 8
- 2023Language Models are Drummers: Drum Composition with Natural Language Pre-Trainingcited by 3
Built on by
Not cited yet.