mlsanityData to 14 Oct 2026

An Agent-Based Framework for Automated Higher-Voice Harmony Generation

arXiv 2509.24463 ↗First posted 29 Sep 2025cs.SD cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

The generation of musically coherent and aesthetically pleasing harmony remains a significant challenge in the field of algorithmic composition. This paper introduces an innovative Agentic AI-enabled Higher Harmony Music Generator, a multi-agent system designed to create harmony in a collaborative and modular fashion. Our framework comprises four specialized agents: a Music-Ingestion Agent for parsing and standardizing input musical scores; a Chord-Knowledge Agent, powered by a Chord-Former (Transformer model), to interpret and provide the constituent notes of complex chord symbols; a Harmony-Generation Agent, which utilizes a Harmony-GPT and a Rhythm-Net (RNN) to compose a melodically and rhythmically complementary harmony line; and an Audio-Production Agent that employs a GAN-based Symbolic-to-Audio Synthesizer to render the final symbolic output into high-fidelity audio. By delegating specific tasks to specialized agents, our system effectively mimics the collaborative process of human musicians. This modular, agent-based approach allows for robust data processing, deep theoretical understanding, creative composition, and realistic audio synthesis, culminating in a system capable of generating sophisticated and contextually appropriate higher-voice harmonies for given melodies.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 9 of its 23 references that are in the map. First posted on arXiv 29 Sep 2025.

Builds on

9 of 23 references.

References · 9

  1. 2017Attention Is All You Needcited by 60,361
  2. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  3. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
  4. 2019The Curious Case of Neural Text Degenerationcited by 2,916
  5. 2017Improved Training of Wasserstein GANscited by 2,235
  6. 2019Explainable Artificial Intelligence (XAI): Concepts, Taxonomies, Opportunities and Challenges toward Responsible AIcited by 1,552
  7. 2017Neural Audio Synthesis of Musical Notes with WaveNet Autoencoderscited by 225
  8. 2018Music Transformercited by 211
  9. 2019GANSynth: Adversarial Neural Audio Synthesiscited by 116

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2024ComposerX: Multi-Agent Symbolic Music Composition with LLMs
  2. 2024ByteComposer: a Human-like Melody Composition Method based on Language Model Agent
  3. 2026Libretto: Giving LLM Agents a Sense of Musical Structure
  4. 2025CoComposer: LLM Multi-agent Collaborative Music Composition
  5. 2025Artificial Intelligence Agents in Music Analysis: An Integrative Perspective Based on Two Use Cases
  6. 2023MusicAgent: An AI Agent for Music Understanding and Generation with Large Language Models
  7. 2024Audio-Agent: Leveraging LLMs For Audio Generation, Editing and Composition
  8. 2026YuE2: Unifying Symbolic and Audio Music Generation at Frontier Quality