mlsanityData to 7 Oct 2026

Distinguishing AI-Generated Music from Edited Audio as a Hard-Negative Robustness Task

arXiv 2608.14916 ↗First posted 14 Aug 2026cs.SD cs.AI cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

AI-generated music detectors are commonly evaluated against original songs, but real-world uploads are often remixed, re-encoded, pitch-shifted, or otherwise edited. These edited versions form a difficult negative class: they are not generated by AI, yet they may introduce spectral artifacts that resemble synthetic audio fingerprints. We study this problem as a hard-negative robustness setting for AI-generated music detection, focusing on AI-generated and edited variants derived from the same anchor songs. We compile a YouTube-based dataset of AI, edited, and original variants, using the original tracks only as references, and train a binary AI versus edited detector. Audio is processed as 10-second clips and passed as raw waveforms to a pretrained PaSST spectrogram transformer. To reduce leakage, all splits are performed by anchor song. On the held-out test set, the final video-level system achieves 0.811 balanced accuracy. At clip level, AI-generated clips reach an F1-score of 0.836, while edited clips reach a lower F1-score of 0.720. The results suggest that AI-generated music retains detectable fingerprint-like spectral cues beyond ordinary editing, but the lower edited-class F1-score shows that these cues can still overlap with artifacts from edited audio. Grad-CAM visualizations are used to inspect whether high-confidence predictions rely on localized time-frequency regions.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 13 of its 18 references that are in the map. First posted on arXiv 14 Aug 2026.

Builds on

13 of 18 references.

References · 13

  1. 2021AST: Audio Spectrogram Transformercited by 634
  2. 2019PANNs: Large-Scale Pretrained Audio Neural Networks for Audio Pattern Recognitioncited by 563
  3. 2023Simple and Controllable Music Generationcited by 480
  4. 2020The Creation and Detection of Deepfakes: A Surveycited by 246
  5. 2021Efficient Training of Audio Transformers with Patchoutcited by 222
  6. 2022Does Audio Deepfake Detection Generalize?cited by 129
  7. 2022ASVspoof 2021: Towards Spoofed and Deepfake Speech Detection in the Wildcited by 118
  8. 2023AI-Synthesized Voice Detection Using Neural Vocoder Artifactscited by 41
  9. 2023SingFake: Singing Voice Deepfake Detectioncited by 21
  10. 2024FakeMusicCaps: a Dataset for Detection and Attribution of Synthetic Music Generated via Text-to-Music Modelscited by 13
  11. 2024CLAD: Robust Audio Deepfake Detection Against Manipulation Attacks with Contrastive Learningcited by 9
  12. 2025A Fourier Explanation of AI-music Artifactscited by 8
1 more
  1. 2025AI-Generated Song Detection via Lyrics Transcriptscited by 2

Built on by

Not cited yet.