SONICS: Synthetic Or Not -- Identifying Counterfeit Songs
Not on the map. Why?
Abstract (arXiv)
The recent surge in AI-generated songs presents exciting possibilities and challenges. These innovations necessitate the ability to distinguish between human-composed and synthetic songs to safeguard artistic integrity and protect human musical artistry. Existing research and datasets in fake song detection only focus on singing voice deepfake detection (SVDD), where the vocals are AI-generated but the instrumental music is sourced from real songs. However, these approaches are inadequate for detecting contemporary end-to-end artificial songs where all components (vocals, music, lyrics, and style) could be AI-generated. Additionally, existing datasets lack music-lyrics diversity, long-duration songs, and open-access fake songs. To address these gaps, we introduce SONICS, a novel dataset for end-to-end Synthetic Song Detection (SSD), comprising over 97k songs (4,751 hours) with over 49k synthetic songs from popular platforms like Suno and Udio. Furthermore, we highlight the importance of modeling long-range temporal dependencies in songs for effective authenticity detection, an aspect entirely overlooked in existing methods. To utilize long-range patterns, we introduce SpecTTTra, a novel architecture that significantly improves time and memory efficiency over conventional CNN and Transformer-based models. For long songs, our top-performing variant outperforms ViT by 8% in F1 score, is 38% faster, and uses 26% less memory, while also surpassing ConvNeXt with a 1% F1 score gain, 20% speed boost, and 67% memory reduction.
Key facts. Cited by 21 papers in the map (data through 7 Oct 2026). Builds on 39 of its 58 references that are in the map. First posted on arXiv 26 Aug 2024.
Builds on
39 of 58 references.
References · 39
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2023Visual Instruction Tuningcited by 7,792
- 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,415
- 2015Rethinking the Inception Architecture for Computer Visioncited by 5,451
- 2017mixup: Beyond Empirical Risk Minimizationcited by 5,155
- 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 3,972
- 2020wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representationscited by 3,853
- 2022A ConvNet for the 2020scited by 3,545
- 2020Conformer: Convolution-augmented Transformer for Speech Recognitioncited by 1,838
- 2019SpecAugment: A Simple Data Augmentation Method for Automatic Speech Recognitioncited by 1,355
- 2023CAMEL: Communicative Agents for "Mind" Exploration of Large Language Model Societycited by 1,348
27 more
- 2021AST: Audio Spectrogram Transformercited by 634
- 2023Qwen-Audio: Advancing Universal Audio Understanding via Unified Large-Scale Audio-Language Modelscited by 591
- 2023Towards Universal Fake Image Detectors that Generalize Across Generative Modelscited by 483
- 2023GPT4Tools: Teaching Large Language Model to Use Tools via Self-instructioncited by 245
- 2021AASIST: Audio Anti-Spoofing using Integrated Spectro-Temporal Graph Attention Networkscited by 173
- 2020End-to-end anti-spoofing with RawNet2cited by 160
- 2021DiffSinger: Singing Voice Synthesis via Shallow Diffusion Mechanismcited by 154
- 2022Hybrid Transformers for Music Source Separationcited by 134
- 2023Transcending Forgery Specificity with Latent Space Augmentation for Generalizable Deepfake Detectioncited by 126
- 2022Automatic speaker verification spoofing and deepfake detection using wav2vec 2.0 and data augmentationcited by 110
- 2021Efficient Training of Visual Transformers with Small Datasetscited by 107
- 2021End-to-end speaker segmentation for overlap-aware resegmentationcited by 76
- 2020Voice Conversion Challenge 2020: Intra-lingual semi-parallel and cross-lingual voice conversioncited by 75
- 2020One-class Learning Towards Synthetic Voice Spoofing Detectioncited by 59
- 2023Online Detection of AI-Generated Imagescited by 55
- 2019STC Antispoofing Systems for the ASVspoof2019 Challengecited by 51
- 2023Improved DeepFake Detection Using Whisper Featurescited by 28
- 2024Masked Modeling Duo: Towards a Universal Audio Pre-training Frameworkcited by 23
- 2023SingFake: Singing Voice Deepfake Detectioncited by 21
- 2024CtrSVDD: A Benchmark Dataset and Baseline Analysis for Controlled Singing Voice Deepfake Detectioncited by 16
- 2023FSD: An Initial Chinese Dataset for Fake Song Detectioncited by 12
- 2023Investigating End-to-End ASR Architectures for Long Form Audio Transcriptioncited by 11
- 2023Single and Multi-Speaker Cloned Voice Detection: From Perceptual to Learned Featurescited by 10
- 2024Singing Voice Graph Modeling for SingFake Detectioncited by 9
- 2023Self-Supervised Representations for Singing Voice Conversioncited by 8
- 2023CST-former: Transformer with Channel-Spectro-Temporal Attention for Sound Event Localization and Detectioncited by 8
- 2019WildMix Dataset and Spectro-Temporal Transformer Model for Monoaural Audio Source Separationcited by 7
Built on by
Citing papers per year: 2025: 12; 2026: 9.
21 papers.
Sort:
By area:
- 2025Audio Flamingo 2: An Audio-Language Model with Long-Audio Understanding and Expert Reasoning Abilitiescited by 127
- 2025Survey on AI-Generated Media Detection: From Non-MLLM to MLLMcited by 12
- 2025Double Entendre: Robust Audio-Based AI-Generated Lyrics Detection via Multi-View Fusioncited by 3
- 2025Data-Driven Analysis of Text-Conditioned AI-Generated Music: A Case Study with Suno and Udiocited by 3
- 2025AI-Generated Song Detection via Lyrics Transcriptscited by 2
- 2026AI-Generated Music Detection in Broadcast Monitoringcited by 2
- 2025Evaluating Fake Music Detection Performance Under Audio Augmentationscited by 1
- 2025Segment Transformer: AI-Generated Music Detection via Music Structural Analysiscited by 1
- 2025Melody or Machine: Detecting Synthetic Music with Dual-Stream Contrastive Learningcited by 1
- 2026Fusion Segment Transformer: Bi-Directional Attention Guided Fusion Network for AI-Generated Music Detectioncited by 1
- 2025Detecting Musical Deepfakescited by 0
- 2025TuneGenie: Reasoning-based LLM agents for preferential music generationcited by 0
9 more
- 2025Unmasking Synthetic Realities in Generative AI: A Comprehensive Review of Adversarially Robust Deepfake Detection Systemscited by 0
- 2025Bias beyond Borders: Global Inequalities in AI-Generated Musiccited by 0
- 2026Echoes: A semantically-aligned music deepfake detection datasetcited by 0
- 2026From Talking to Singing: A New Challenge for Audio-Visual Deepfake Detectioncited by 0
- 2026HAIM: Human-AI Music Datasets for AI Music Production Tracking Benchmarkcited by 0
- 2026The Perceived Fragility of Explanations in Audio Models: Manipulation of Attribution with Unchanged Predictionscited by 0
- 2026Beyond Artifacts: Towards Generalizable Synthetic Song Detection via Music-Intrinsic Featurescited by 0
- 2026How Much AI Is in This Track? Quantifying the Proportion of AI-Generated Stems in Hybrid Music Mixturescited by 0
- 2026Assessing AI-generated music detection in real-world broadcast monitoringcited by 0
- 2026Assessing AI-generated music detection in real-world broadcast monitoring7 Aug 2026
- 2026How Much AI Is in This Track? Quantifying the Proportion of AI-Generated Stems in Hybrid Music Mixtures7 Aug 2026
- 2026Beyond Artifacts: Towards Generalizable Synthetic Song Detection via Music-Intrinsic Features15 Jun 2026
- 2026The Perceived Fragility of Explanations in Audio Models: Manipulation of Attribution with Unchanged Predictions12 Jun 2026
- 2026HAIM: Human-AI Music Datasets for AI Music Production Tracking Benchmark1 Jun 2026
- 2026From Talking to Singing: A New Challenge for Audio-Visual Deepfake Detection27 May 2026
- 2026Echoes: A semantically-aligned music deepfake detection dataset24 Mar 2026
- 2026AI-Generated Music Detection in Broadcast Monitoring6 Feb 2026
- 2026Fusion Segment Transformer: Bi-Directional Attention Guided Fusion Network for AI-Generated Music Detection20 Jan 2026
- 2025Melody or Machine: Detecting Synthetic Music with Dual-Stream Contrastive Learning29 Nov 2025
- 2025Bias beyond Borders: Global Inequalities in AI-Generated Music2 Oct 2025
- 2025Data-Driven Analysis of Text-Conditioned AI-Generated Music: A Case Study with Suno and Udio15 Sep 2025
9 more
- 2025Segment Transformer: AI-Generated Music Detection via Music Structural Analysis10 Sep 2025
- 2025Unmasking Synthetic Realities in Generative AI: A Comprehensive Review of Adversarially Robust Deepfake Detection Systems24 Jul 2025
- 2025Evaluating Fake Music Detection Performance Under Audio Augmentations7 Jul 2025
- 2025AI-Generated Song Detection via Lyrics Transcripts23 Jun 2025
- 2025Double Entendre: Robust Audio-Based AI-Generated Lyrics Detection via Multi-View Fusion19 Jun 2025
- 2025TuneGenie: Reasoning-based LLM agents for preferential music generation10 Jun 2025
- 2025Detecting Musical Deepfakes3 May 2025
- 2025Audio Flamingo 2: An Audio-Language Model with Long-Audio Understanding and Expert Reasoning Abilities6 Mar 2025
- 2025Survey on AI-Generated Media Detection: From Non-MLLM to MLLM7 Feb 2025
- 2025Survey on AI-Generated Media Detection: From Non-MLLM to MLLMcited by 12
- 2025Double Entendre: Robust Audio-Based AI-Generated Lyrics Detection via Multi-View Fusioncited by 3
- 2025Data-Driven Analysis of Text-Conditioned AI-Generated Music: A Case Study with Suno and Udiocited by 3
- 2025AI-Generated Song Detection via Lyrics Transcriptscited by 2
- 2026AI-Generated Music Detection in Broadcast Monitoringcited by 2
- 2025Evaluating Fake Music Detection Performance Under Audio Augmentationscited by 1
- 2025Segment Transformer: AI-Generated Music Detection via Music Structural Analysiscited by 1
- 2025Melody or Machine: Detecting Synthetic Music with Dual-Stream Contrastive Learningcited by 1
- 2026Fusion Segment Transformer: Bi-Directional Attention Guided Fusion Network for AI-Generated Music Detectioncited by 1
- 2025Detecting Musical Deepfakescited by 0
- 2025Unmasking Synthetic Realities in Generative AI: A Comprehensive Review of Adversarially Robust Deepfake Detection Systemscited by 0
- 2025Bias beyond Borders: Global Inequalities in AI-Generated Musiccited by 0
12 most cited of 19 All 19 (JSON)
- 2026Assessing AI-generated music detection in real-world broadcast monitoring7 Aug 2026
- 2026How Much AI Is in This Track? Quantifying the Proportion of AI-Generated Stems in Hybrid Music Mixtures7 Aug 2026
- 2026Beyond Artifacts: Towards Generalizable Synthetic Song Detection via Music-Intrinsic Features15 Jun 2026
- 2026The Perceived Fragility of Explanations in Audio Models: Manipulation of Attribution with Unchanged Predictions12 Jun 2026
- 2026HAIM: Human-AI Music Datasets for AI Music Production Tracking Benchmark1 Jun 2026
- 2026From Talking to Singing: A New Challenge for Audio-Visual Deepfake Detection27 May 2026
- 2026Echoes: A semantically-aligned music deepfake detection dataset24 Mar 2026
- 2026AI-Generated Music Detection in Broadcast Monitoring6 Feb 2026
- 2026Fusion Segment Transformer: Bi-Directional Attention Guided Fusion Network for AI-Generated Music Detection20 Jan 2026
- 2025Melody or Machine: Detecting Synthetic Music with Dual-Stream Contrastive Learning29 Nov 2025
- 2025Bias beyond Borders: Global Inequalities in AI-Generated Music2 Oct 2025
- 2025Data-Driven Analysis of Text-Conditioned AI-Generated Music: A Case Study with Suno and Udio15 Sep 2025
12 newest of 19 All 19 (JSON)