mlsanityData to 14 Oct 2026

ComposerX: Multi-Agent Symbolic Music Composition with LLMs

arXiv 2404.18081 ↗First posted 28 Apr 2024cs.SD cs.AI cs.CLcited by 42

On the map: LLM agents and tool use → Multimodal and embodied agents

Abstract (arXiv)

Music composition represents the creative side of humanity, and itself is a complex task that requires abilities to understand and generate information with long dependency and harmony constraints. While demonstrating impressive capabilities in STEM subjects, current LLMs easily fail in this task, generating ill-written music even when equipped with modern techniques like In-Context-Learning and Chain-of-Thoughts. To further explore and enhance LLMs' potential in music composition by leveraging their reasoning ability and the large knowledge base in music history and theory, we propose ComposerX, an agent-based symbolic music generation framework. We find that applying a multi-agent approach significantly improves the music composition quality of GPT-4. The results demonstrate that ComposerX is capable of producing coherent polyphonic music compositions with captivating melodies, while adhering to user instructions.

Key facts. Cited by 42 papers in the map (data through 14 Oct 2026). Placed in Multimodal and embodied agents, one of 16 directions in LLM agents and tool use. Builds on 21 of its 29 references that are in the map. First posted on arXiv 28 Apr 2024.

Builds on

21 of 29 references.

Closest ancestors · 1

Same direction, newest first

  1. 2023MusicAgent: An AI Agent for Music Understanding and Generation with Large Language Models18 Oct

Other references · 20

  1. 2017Attention Is All You Needcited by 60,361
  2. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
  3. 2022Self-Instruct: Aligning Language Models with Self-Generated Instructionscited by 2,724
  4. 2023Sparks of Artificial General Intelligence: Early experiments with GPT-4cited by 2,592
  5. 2023Code Llama: Open Foundation Models for Codecited by 2,139
  6. 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversationcited by 1,988
  7. 2020Jukebox: A Generative Model for Musiccited by 542
  8. 2023Simple and Controllable Music Generationcited by 488
  9. 2023MAmmoTH: Building Math Generalist Models through Hybrid Instruction Tuningcited by 487
  10. 2023MusicLM: Generating Music From Textcited by 448
  11. 2024ChatMusician: Understanding and Generating Music Intrinsically with LLMcited by 68
  12. 2023SingSong: Generating musical accompaniments from singingcited by 55
8 more
  1. 2023MuseCoco: Generating Symbolic Music from Textcited by 52
  2. 2024MuPT: A Generative Symbolic Music Pretrained Transformercited by 33
  3. 2023Content-based Controls For Music Large Language Modelingcited by 19
  4. 2024Arrange, Inpaint, and Refine: Steerable Long-term Music Audio Generation and Editing via Content-based Controlscited by 17
  5. 2023Loop Copilot: Conducting AI Ensembles for Music Generation and Iterative Editingcited by 15
  6. 2022Exploring the Efficacy of Pre-trained Checkpoints in Text-to-Music Generation Taskcited by 13
  7. 2022What is missing in deep music generation? A study of repetition and structure in popular musiccited by 11
  8. 2024ByteComposer: a Human-like Melody Composition Method based on Language Model Agentcited by 6

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 12; 2025: 21; 2026: 9.

42 papers.

Sort:

By area:

  1. 2025From LLM Reasoning to Autonomous AI Agents: A Comprehensive Reviewcited by 149
  2. 2024MAP-Neo: Highly Capable and Transparent Bilingual Large Language Model Seriescited by 67
  3. 2024AI as Humanity's Salieri: Quantifying Linguistic Creativity of Language Models via Systematic Attribution of Machine Text against Web Textcited by 42
  4. 2024VidMuse: A Simple Video-to-Music Generation Framework with Long-Short-Term Modelingcited by 40
  5. 2024Foundation Models for Music: A Surveycited by 37
  6. 2024Time Series Modeling for Heart Rate Prediction: From ARIMA to Transformerscited by 35
  7. 2025From Mind to Machine: The Rise of Manus AI as a Fully Autonomous Digital Agentcited by 33
  8. 2024Harnessing Earnings Reports for Stock Predictions: A QLoRA-Enhanced LLM Approachcited by 24
  9. 2025Does Tone Change the Answer? Evaluating Prompt Politeness Effects on Modern LLMs: GPT, Gemini, and LLaMAcited by 23
  10. 2024Towards Resilient and Efficient LLMs: A Comparative Study of Efficiency, Performance, and Adversarial Robustnesscited by 22
  11. 2024Harnessing LLMs for API Interactions: A Framework for Classification and Synthetic Data Generationcited by 17
  12. 2024Instruct-MusicGen: Unlocking Text-to-Music Editing for Music Language Models via Instruction Tuningcited by 15
30 more
  1. 2024Data Imputation using Large Language Model to Accelerate Recommendation Systemcited by 15
  2. 2025Adaptive Fault Tolerance Mechanisms of Large Language Models in Cloud Computing Environmentscited by 12
  3. 2026Audio-Omni: Extending Multi-modal Understanding to Versatile Audio Generation and Editingcited by 12
  4. 2025Research on Large Language Model Cross-Cloud Privacy Protection and Collaborative Training based on Federated Learningcited by 11
  5. 2025Cloud-Based AI Systems: Leveraging Large Language Models for Intelligent Fault Detection and Autonomous Self-Healingcited by 10
  6. 2025Data Augmentation Through Random Style Replacementcited by 9
  7. 2025Cross-Cloud Data Privacy Protection: Optimizing Collaborative Mechanisms of AI Systems by Integrating Federated Learning and LLMscited by 9
  8. 2024Style Transfer: From Stitching to Neural Networkscited by 8
  9. 2025User Behavior Analysis in Privacy Protection with Large Language Models: A Study on Privacy Preferences with Limited Datacited by 8
  10. 2026Quantifying Trust: Financial Risk Management for Trustworthy AI Agentscited by 8
  11. 2024Creativity in AI: Progresses and Challengescited by 7
  12. 2025Bias Evaluation and Mitigation in Retrieval-Augmented Medical Question-Answering Systemscited by 6
  13. 2025FilmComposer: LLM-Driven Music Production for Silent Film Clipscited by 5
  14. 2025Curriculum Guided Reinforcement Learning for Efficient Multi Hop Retrieval Augmented Generationcited by 5
  15. 2025Instruction Tuning and CoT Prompting for Contextual Medical QA with LLMscited by 5
  16. 2025ReelWave: Multi-Agentic Movie Sound Generation through Multimodal LLM Conversationcited by 4
  17. 2025Let Your Video Listen to Your Music!cited by 3
  18. 2025Teaching LLMs Music Theory with In-Context Learning and Chain-of-Thought Prompting: Pedagogical Strategies for Machinescited by 2
  19. 2025DeepRAG: Integrating Hierarchical Reasoning and Process Supervision for Biomedical Multi-Hop QAcited by 2
  20. 2025Federated Learning-Based Data Collaboration Method for Enhancing Edge Cloud AI System Security Using Large Language Modelscited by 1
  21. 2025CoComposer: LLM Multi-agent Collaborative Music Compositioncited by 1
  22. 2026How Far Can Pretrained LLMs Go in Symbolic Music? Controlled Comparisons of Supervised and Preference-based Adaptationcited by 1
  23. 2026Stemphonic: All-at-once Flexible Multi-stem Music Generationcited by 1
  24. 2026AudioX-Turbo: A Unified Framework for Efficient Anything-to-Audio Generationcited by 1
  25. 2025An Intelligent Fault Self-Healing Mechanism for Cloud AI Systems via Integration of Large Language Models and Deep Reinforcement Learningcited by 0
  26. 2025BREATH: A Bio-Radar Embodied Agent for Tonal and Human-Aware Diffusion Music Generationcited by 0
  27. 2026Exploring LLMs for South Asian Music Understanding and Generationcited by 0
  28. 2026Safe and Adaptive Cloud Healing: Verifying LLM-Generated Recovery Plans with a Neural-Symbolic World Modelcited by 0
  29. 2026Agogic: Performance-Timed Music Tokens for LLM-Native Text-to-Symbolic-Music Generationcited by 0
  30. 2026SpecForge: Recursive Self-Improvement for Coding Agents via Behavioral Specificationscited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2025An Agent-Based Framework for Automated Higher-Voice Harmony Generation
  2. 2026Libretto: Giving LLM Agents a Sense of Musical Structure
  3. 2025Artificial Intelligence Agents in Music Analysis: An Integrative Perspective Based on Two Use Cases
  4. 2024Can LLMs "Reason" in Music? An Evaluation of LLMs' Capability of Music Understanding and Generation
  5. 2025TuneGenie: Reasoning-based LLM agents for preferential music generation
  6. 2026Helping Music Co-Creation Agents 'Listen' Well: Hierarchical Self-Supervised World Models for Understanding and Generation
  7. 2025CSyMR: Benchmarking Compositional Music Information Retrieval in Symbolic Music Reasoning
  8. 2025NotaGen: Advancing Musicality in Symbolic Music Generation with Large Language Model Training Paradigms