mlsanityData to 14 Oct 2026

AI Harmonizer: Expanding Vocal Expression with a Generative Neurosymbolic Music AI System

arXiv 2506.18143 ↗First posted 22 Jun 2025cs.HC cs.AI cs.SDcited by 1

Not on the map. Why?

Abstract (arXiv)

Vocals harmonizers are powerful tools to help solo vocalists enrich their melodies with harmonically supportive voices. These tools exist in various forms, from commercially available pedals and software to custom-built systems, each employing different methods to generate harmonies. Traditional harmonizers often require users to manually specify a key or tonal center, while others allow pitch selection via an external keyboard-both approaches demanding some degree of musical expertise. The AI Harmonizer introduces a novel approach by autonomously generating musically coherent four-part harmonies without requiring prior harmonic input from the user. By integrating state-of-the-art generative AI techniques for pitch detection and voice modeling with custom-trained symbolic music models, our system arranges any vocal melody into rich choral textures. In this paper, we present our methods, explore potential applications in performance and composition, and discuss future directions for real-time implementations. While our system currently operates offline, we believe it represents a significant step toward AI-assisted vocal performance and expressive musical augmentation. We release our implementation on GitHub.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 8 of its 27 references that are in the map. First posted on arXiv 22 Jun 2025.

Builds on

8 of 27 references.

References · 8

  1. 2021HuBERT: Self-Supervised Speech Representation Learning by Masked Prediction of Hidden Unitscited by 2,342
  2. 2021Conditional Variational Autoencoder with Adversarial Learning for End-to-End Text-to-Speechcited by 561
  3. 2019Counterpoint by Convolutioncited by 43
  4. 2023RMVPE: A Robust Model for Vocal Pitch Estimation in Polyphonic Musiccited by 30
  5. 2017Chord Generation from Symbolic Melody Using BLSTM Networkscited by 8
  6. 2022AccoMontage2: A Complete Harmonization and Accompaniment Arrangement Systemcited by 8
  7. 2020Melody Harmonization Using Orderless NADE, Chord Balancing, and Blocked Gibbs Samplingcited by 7
  8. 2024Local deployment of large-scale music AI models on commodity hardwarecited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.