How Much AI Is in This Track? Quantifying the Proportion of AI-Generated Stems in Hybrid Music Mixtures
Not on the map. Why?
Abstract (arXiv)
AI-generated music is increasingly used at the stem level, with producers integrating synthetic drums, basslines, or vocals alongside human-performed instruments. However, current AI music detection systems are binary, treating tracks as either fully AI or fully human. In this paper, we reformulate AI music detection as a regression problem on a continuous AI energy ratio, alpha in [0, 1]. We propose a methodology that leverages a multi-track music dataset to assemble mixtures of human-performed and AI-reconstructed stems (obtained using a neural audio codec) with known proportions of each content type. Using this approach, we first show that a CNN-based model trained on fully AI-generated or human-performed tracks, which achieves >99% accuracy as a binary detector, when faced with mixed content, yields an output that rises with the AI stems' energy contribution, acting as a noisy and miscalibrated estimator. Our analysis of the influence of different stems shows that detection sensitivity depends on the instrument and reflects its frequency content: drums and guitar carry strong codec-artifact signatures, while vocals and bass are less detectable. Based on these insights, we train a similar CNN-based model for regression of alpha, achieving MAE = 0.076 and R^2 = 0.85 on held-out mixtures from the same pipeline. These results suggest that the regression formulation is an initial promising step towards AI-music detection in realistic music production workflows.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 17 of its 25 references that are in the map. First posted on arXiv 7 Aug 2026.
Builds on
17 of 25 references.
References · 17
- 2022High Fidelity Neural Audio Compressioncited by 673
- 2022AudioLM: a Language Modeling Approach to Audio Generationcited by 611
- 2023Simple and Controllable Music Generationcited by 480
- 2023High-Fidelity Audio Compression with Improved RVQGANcited by 423
- 2016FMA: A Dataset For Music Analysiscited by 205
- 2024Fast Timing-Conditioned Latent Audio Diffusioncited by 178
- 2019Cutting Music Source Separation Some Slakh: A Dataset to Study the Impact of Training Data Quality and Quantitycited by 86
- 2023Moisesdb: A dataset for source separation beyond 4-stemscited by 37
- 2024Diff-A-Riff: Musical Accompaniment Co-creation via Latent Diffusion Modelscited by 33
- 2020Upsampling artifacts in neural audio synthesiscited by 28
- 2024SONICS: Synthetic Or Not -- Identifying Counterfeit Songscited by 21
- 2024Improving Musical Accompaniment Co-creation via Diffusion Transformerscited by 11
5 more
- 2025A Fourier Explanation of AI-music Artifactscited by 8
- 2025AI-Generated Music Detection and its Challengescited by 4
- 2025Music and Artificial Intelligence: Artistic Trendscited by 2
- 2026AI-Generated Music Detection in Broadcast Monitoringcited by 2
- 2026LiveBand: Live Accompaniment Generation in the Audio Domaincited by 2
Built on by
Not cited yet.