mlsanityData to 14 Oct 2026

MusiChat: Vibe Composing for Music Creation

arXiv 2607.24873 ↗First posted 27 Jul 2026cs.AI cs.SDcited by 1

Not on the map. Why?

Abstract (arXiv)

Recent advances in AI music generation have enabled users to create complete musical pieces from natural-language prompts. However, most existing systems follow a prompt-and-regenerate paradigm, making iterative refinement difficult because users must repeatedly recreate compositions instead of directly evolving existing musical ideas. We present MusiChat, a conversational vibe composing system that enables collaborative human-AI music creation through natural-language interaction and iterative refinement. At the core of MusiChat is a hierarchical controllable music generation framework that separates lyric-aligned musical structure generation from expressive surface realization, allowing flexible stylistic transformations and structure-preserving edits. The system integrates a large language model with a hybrid symbolic music engine through a memory-augmented architecture that maintains the active composition state and user history across interactions. A hybrid intent-routing mechanism further enables efficient interpretation of both precise musical edits and open-ended creative requests. Rather than regenerating compositions from scratch, MusiChat incrementally transforms an evolving musical artifact while preserving relevant musical structure and user intent. We evaluate MusiChat through objective analysis and human studies, achieving 95.31% and 100% accuracy for single- and multi-turn interactions, respectively, and obtaining like-to-dislike ratios of 2:1 for melody naturalness and 3:1 for musical quality. Our results demonstrate that MusiChat supports coherent multi-turn music authoring and interactive human-AI co-creation through a conversational interface.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 10 of its 17 references that are in the map. First posted on arXiv 27 Jul 2026.

Builds on

10 of 17 references.

References · 10

  1. 2020Jukebox: A Generative Model for Musiccited by 542
  2. 2025LLMs Get Lost In Multi-Turn Conversationcited by 429
  3. 2024A Survey on Recent Advances in LLM-Based Multi-turn Dialogue Systemscited by 170
  4. 2023MelodyGLM: Multi-task Pre-training for Symbolic Melody Generationcited by 10
  5. 2024SongComposer: A Large Language Model for Lyric and Melody Generation in Song Compositioncited by 9
  6. 2024MeloTrans: A Text to Symbolic Music Generation Model Following Human Composition Habitcited by 4
  7. 2023Automatic Time Signature Determination for New Scores Using Lyrics for Latent Rhythmic Structurecited by 2
  8. 2024Relationships between Keywords and Strong Beats in Lyrical Musiccited by 2
  9. 2024SongGLM: Lyric-to-Melody Generation with 2D Alignment Encoding and Multi-Task Pre-Trainingcited by 1
  10. 2025MusicAIR: A Multimodal AI Music Generation Framework Powered by an Algorithm-Driven Corecited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.