HAIM: Human-AI Music Datasets for AI Music Production Tracking Benchmark
Not on the map. Why?
Abstract (arXiv)
As generative platforms such as Suno and Udio reach human-grade audio quality, the scope of AI's utility has expanded across the entire music production workflow. Beyond simple track generation, these advancements have catalyzed the adoption of AI-driven methodologies in diverse forms. These include vocal synthesis, arrangement, and professional mastering. However, current detection research remains largely confined to a binary `AI-or-human' paradigm. It fails to reflect the realities of contemporary music production workflows. In real-world production, AI tools are increasingly used to refine or master human-produced tracks, and human engineers likewise post-process AI-generated material to ensure professional quality. Moreover, users often employ adversarial tactics to bypass AI detectors, such as applying human mastering to AI-generated tracks. This creates a grey area that a simple binary classification fails to capture. In this paper, we define and investigate ``AI Music Tracking'': the challenge of identifying specific AI integration across the multifaceted spectrum of music production. To this end, we introduce HAIM, a dataset with diverse labels for stages of music production. It is designed to isolate stages of AI intervention, including hybrid production and agent-level tracking. Our evaluation of state-of-the-art detectors reveals systemic flaws. By releasing HAIM, we propose a new benchmark that shifts the field beyond binary classification toward a granular, structured evaluation of AI music.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 17 of its 24 references that are in the map. First posted on arXiv 1 Jun 2026.
Builds on
17 of 24 references.
References · 17
- 2022Scalable Diffusion Models with Transformerscited by 5,931
- 2020wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representationscited by 3,853
- 2025MuQ: Self-Supervised Music Representation Learning with Mel Residual Vector Quantizationcited by 66
- 2026ACE-Step 1.5: Pushing the Boundaries of Open-Source Music Generationcited by 22
- 2023SingFake: Singing Voice Deepfake Detectioncited by 21
- 2024SONICS: Synthetic Or Not -- Identifying Counterfeit Songscited by 21
- 2022Music Mixing Style Transfer: A Contrastive Learning Approach to Disentangle Audio Effectscited by 18
- 2025Benchmarking Music Generation Models and Metrics via Human Preference Studiescited by 15
- 2025A Fourier Explanation of AI-music Artifactscited by 8
- 2024Detecting music deepfakes is easy but actually hardcited by 7
- 2025SonicMaster: Towards Controllable All-in-One Music Restoration and Masteringcited by 6
- 2023K-pop Lyric Translation: Dataset, Analysis, and Neural-Modellingcited by 4
5 more
- 2025AI-Generated Music Detection and its Challengescited by 4
- 2025From Generation to Attribution: Music AI Agent Architectures for the Post-Streaming Eracited by 3
- 2025AI-Generated Song Detection via Lyrics Transcriptscited by 2
- 2025Melody or Machine: Detecting Synthetic Music with Dual-Stream Contrastive Learningcited by 1
- 2026Fusion Segment Transformer: Bi-Directional Attention Guided Fusion Network for AI-Generated Music Detectioncited by 1
Built on by
Not cited yet.