Distinguishing AI-Generated Music from Edited Audio as a Hard-Negative Robustness Task
Not on the map. Why?
Abstract (arXiv)
AI-generated music detectors are commonly evaluated against original songs, but real-world uploads are often remixed, re-encoded, pitch-shifted, or otherwise edited. These edited versions form a difficult negative class: they are not generated by AI, yet they may introduce spectral artifacts that resemble synthetic audio fingerprints. We study this problem as a hard-negative robustness setting for AI-generated music detection, focusing on AI-generated and edited variants derived from the same anchor songs. We compile a YouTube-based dataset of AI, edited, and original variants, using the original tracks only as references, and train a binary AI versus edited detector. Audio is processed as 10-second clips and passed as raw waveforms to a pretrained PaSST spectrogram transformer. To reduce leakage, all splits are performed by anchor song. On the held-out test set, the final video-level system achieves 0.811 balanced accuracy. At clip level, AI-generated clips reach an F1-score of 0.836, while edited clips reach a lower F1-score of 0.720. The results suggest that AI-generated music retains detectable fingerprint-like spectral cues beyond ordinary editing, but the lower edited-class F1-score shows that these cues can still overlap with artifacts from edited audio. Grad-CAM visualizations are used to inspect whether high-confidence predictions rely on localized time-frequency regions.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 13 of its 18 references that are in the map. First posted on arXiv 14 Aug 2026.
Builds on
13 of 18 references.
References · 13
- 2021AST: Audio Spectrogram Transformercited by 634
- 2019PANNs: Large-Scale Pretrained Audio Neural Networks for Audio Pattern Recognitioncited by 563
- 2023Simple and Controllable Music Generationcited by 480
- 2020The Creation and Detection of Deepfakes: A Surveycited by 246
- 2021Efficient Training of Audio Transformers with Patchoutcited by 222
- 2022Does Audio Deepfake Detection Generalize?cited by 129
- 2022ASVspoof 2021: Towards Spoofed and Deepfake Speech Detection in the Wildcited by 118
- 2023AI-Synthesized Voice Detection Using Neural Vocoder Artifactscited by 41
- 2023SingFake: Singing Voice Deepfake Detectioncited by 21
- 2024FakeMusicCaps: a Dataset for Detection and Attribution of Synthetic Music Generated via Text-to-Music Modelscited by 13
- 2024CLAD: Robust Audio Deepfake Detection Against Manipulation Attacks with Contrastive Learningcited by 9
- 2025A Fourier Explanation of AI-music Artifactscited by 8
1 more
- 2025AI-Generated Song Detection via Lyrics Transcriptscited by 2
Built on by
Not cited yet.