Beyond Artifacts: Towards Generalizable Synthetic Song Detection via Music-Intrinsic Features
Not on the map. Why?
Abstract (arXiv)
The rapid advancement of AI music generators highlights the urgent need for reliable Synthetic Song Detection (SSD). Existing SSD methods often rely on low-level artifacts or fixed feature assumptions, struggling to capture generator-agnostic cues. To address this, we propose Sofia (Synthetic-song detection framework via music features), a flexible framework that models music-intrinsic attributes via feature-specific experts and an adaptive Mixture-of-Experts (MoE) module. By configuring Sofia with representative Vocal, Audio-effect, Global structure features, and their combinations, we present their individual and complementary contributions. To comprehensively evaluate our framework, we further construct MUSIC8K, a challenging benchmark featuring lastest emerging generators and realistic audio perturbations. Experiments show that Sofia learns generator-agnostic representations from music-intrinsic features, improving the F1 score by 18.5 points over the strongest baseline on MUSIC8K-O while maintaining strong robustness.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 19 of its 35 references that are in the map. First posted on arXiv 15 Jun 2026.
Builds on
19 of 35 references.
References · 19
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2020wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representationscited by 3,853
- 2018UMAP: Uniform Manifold Approximation and Projection for Dimension Reductioncited by 2,841
- 2023MERT: Acoustic Music Understanding Model with Large-Scale Self-supervised Trainingcited by 175
- 2023EfficientViT: Memory Efficient Vision Transformer with Cascaded Group Attentioncited by 172
- 2020End-to-end anti-spoofing with RawNet2cited by 160
- 2025YuE: Scaling Open Foundation Models for Long-Form Music Generationcited by 68
- 2025MuQ: Self-Supervised Music Representation Learning with Mel Residual Vector Quantizationcited by 66
- 2020One-class Learning Towards Synthetic Voice Spoofing Detectioncited by 59
- 2025DiffRhythm: Blazingly Fast and Embarrassingly Simple End-to-End Full-Length Song Generation with Latent Diffusioncited by 46
- 2026ACE-Step 1.5: Pushing the Boundaries of Open-Source Music Generationcited by 22
- 2024SONICS: Synthetic Or Not -- Identifying Counterfeit Songscited by 21
7 more
- 2024CtrSVDD: A Benchmark Dataset and Baseline Analysis for Controlled Singing Voice Deepfake Detectioncited by 16
- 2026HeartMuLa: A Family of Open Sourced Music Foundation Modelscited by 13
- 2023FSD: An Initial Chinese Dataset for Fake Song Detectioncited by 12
- 2025A Fourier Explanation of AI-music Artifactscited by 8
- 2025Fx-Encoder++: Extracting Instrument-Wise Audio Effects Representations from Mixturescited by 6
- 2025Double Entendre: Robust Audio-Based AI-Generated Lyrics Detection via Multi-View Fusioncited by 3
- 2025Deepfake Detection of Singing Voices With Whisper Encodingscited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2024Explainable Detection of Machine Generated Music and Early Systematic Evaluation
- 2025Amadeus: Autoregressive Model with Bidirectional Attribute Modelling for Symbolic Music
- 2024Music Consistency Models
- 2026MusicMark: A Robust Generative Watermarking Framework for Music Generation
- 2025AnyAccomp: Generalizable Accompaniment Generation via Quantized Melodic Bottleneck
- 2025Enhancing Spectrogram Realism in Singing Voice Synthesis via Explicit Bandwidth Extension Prior to Vocoder ↗
- 2026YuE2: Unifying Symbolic and Audio Music Generation at Frontier Quality
- 2025YingMusic-Singer: Zero-shot Singing Voice Synthesis and Editing with Annotation-free Melody Guidance