mlsanityData to 7 Oct 2026

SONICS: Synthetic Or Not -- Identifying Counterfeit Songs

arXiv 2408.14080 ↗First posted 26 Aug 2024cs.SD cs.AI cs.CVcited by 21

Not on the map. Why?

Abstract (arXiv)

The recent surge in AI-generated songs presents exciting possibilities and challenges. These innovations necessitate the ability to distinguish between human-composed and synthetic songs to safeguard artistic integrity and protect human musical artistry. Existing research and datasets in fake song detection only focus on singing voice deepfake detection (SVDD), where the vocals are AI-generated but the instrumental music is sourced from real songs. However, these approaches are inadequate for detecting contemporary end-to-end artificial songs where all components (vocals, music, lyrics, and style) could be AI-generated. Additionally, existing datasets lack music-lyrics diversity, long-duration songs, and open-access fake songs. To address these gaps, we introduce SONICS, a novel dataset for end-to-end Synthetic Song Detection (SSD), comprising over 97k songs (4,751 hours) with over 49k synthetic songs from popular platforms like Suno and Udio. Furthermore, we highlight the importance of modeling long-range temporal dependencies in songs for effective authenticity detection, an aspect entirely overlooked in existing methods. To utilize long-range patterns, we introduce SpecTTTra, a novel architecture that significantly improves time and memory efficiency over conventional CNN and Transformer-based models. For long songs, our top-performing variant outperforms ViT by 8% in F1 score, is 38% faster, and uses 26% less memory, while also surpassing ConvNeXt with a 1% F1 score gain, 20% speed boost, and 67% memory reduction.

Key facts. Cited by 21 papers in the map (data through 7 Oct 2026). Builds on 39 of its 58 references that are in the map. First posted on arXiv 26 Aug 2024.

Builds on

39 of 58 references.

References · 39

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  3. 2023Visual Instruction Tuningcited by 7,792
  4. 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,415
  5. 2015Rethinking the Inception Architecture for Computer Visioncited by 5,451
  6. 2017mixup: Beyond Empirical Risk Minimizationcited by 5,155
  7. 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 3,972
  8. 2020wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representationscited by 3,853
  9. 2022A ConvNet for the 2020scited by 3,545
  10. 2020Conformer: Convolution-augmented Transformer for Speech Recognitioncited by 1,838
  11. 2019SpecAugment: A Simple Data Augmentation Method for Automatic Speech Recognitioncited by 1,355
  12. 2023CAMEL: Communicative Agents for "Mind" Exploration of Large Language Model Societycited by 1,348
27 more
  1. 2021AST: Audio Spectrogram Transformercited by 634
  2. 2023Qwen-Audio: Advancing Universal Audio Understanding via Unified Large-Scale Audio-Language Modelscited by 591
  3. 2023Towards Universal Fake Image Detectors that Generalize Across Generative Modelscited by 483
  4. 2023GPT4Tools: Teaching Large Language Model to Use Tools via Self-instructioncited by 245
  5. 2021AASIST: Audio Anti-Spoofing using Integrated Spectro-Temporal Graph Attention Networkscited by 173
  6. 2020End-to-end anti-spoofing with RawNet2cited by 160
  7. 2021DiffSinger: Singing Voice Synthesis via Shallow Diffusion Mechanismcited by 154
  8. 2022Hybrid Transformers for Music Source Separationcited by 134
  9. 2023Transcending Forgery Specificity with Latent Space Augmentation for Generalizable Deepfake Detectioncited by 126
  10. 2022Automatic speaker verification spoofing and deepfake detection using wav2vec 2.0 and data augmentationcited by 110
  11. 2021Efficient Training of Visual Transformers with Small Datasetscited by 107
  12. 2021End-to-end speaker segmentation for overlap-aware resegmentationcited by 76
  13. 2020Voice Conversion Challenge 2020: Intra-lingual semi-parallel and cross-lingual voice conversioncited by 75
  14. 2020One-class Learning Towards Synthetic Voice Spoofing Detectioncited by 59
  15. 2023Online Detection of AI-Generated Imagescited by 55
  16. 2019STC Antispoofing Systems for the ASVspoof2019 Challengecited by 51
  17. 2023Improved DeepFake Detection Using Whisper Featurescited by 28
  18. 2024Masked Modeling Duo: Towards a Universal Audio Pre-training Frameworkcited by 23
  19. 2023SingFake: Singing Voice Deepfake Detectioncited by 21
  20. 2024CtrSVDD: A Benchmark Dataset and Baseline Analysis for Controlled Singing Voice Deepfake Detectioncited by 16
  21. 2023FSD: An Initial Chinese Dataset for Fake Song Detectioncited by 12
  22. 2023Investigating End-to-End ASR Architectures for Long Form Audio Transcriptioncited by 11
  23. 2023Single and Multi-Speaker Cloned Voice Detection: From Perceptual to Learned Featurescited by 10
  24. 2024Singing Voice Graph Modeling for SingFake Detectioncited by 9
  25. 2023Self-Supervised Representations for Singing Voice Conversioncited by 8
  26. 2023CST-former: Transformer with Channel-Spectro-Temporal Attention for Sound Event Localization and Detectioncited by 8
  27. 2019WildMix Dataset and Spectro-Temporal Transformer Model for Monoaural Audio Source Separationcited by 7

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 12; 2026: 9.

21 papers.

Sort:

By area:

  1. 2025Audio Flamingo 2: An Audio-Language Model with Long-Audio Understanding and Expert Reasoning Abilitiescited by 127
  2. 2025Survey on AI-Generated Media Detection: From Non-MLLM to MLLMcited by 12
  3. 2025Double Entendre: Robust Audio-Based AI-Generated Lyrics Detection via Multi-View Fusioncited by 3
  4. 2025Data-Driven Analysis of Text-Conditioned AI-Generated Music: A Case Study with Suno and Udiocited by 3
  5. 2025AI-Generated Song Detection via Lyrics Transcriptscited by 2
  6. 2026AI-Generated Music Detection in Broadcast Monitoringcited by 2
  7. 2025Evaluating Fake Music Detection Performance Under Audio Augmentationscited by 1
  8. 2025Segment Transformer: AI-Generated Music Detection via Music Structural Analysiscited by 1
  9. 2025Melody or Machine: Detecting Synthetic Music with Dual-Stream Contrastive Learningcited by 1
  10. 2026Fusion Segment Transformer: Bi-Directional Attention Guided Fusion Network for AI-Generated Music Detectioncited by 1
  11. 2025Detecting Musical Deepfakescited by 0
  12. 2025TuneGenie: Reasoning-based LLM agents for preferential music generationcited by 0
9 more
  1. 2025Unmasking Synthetic Realities in Generative AI: A Comprehensive Review of Adversarially Robust Deepfake Detection Systemscited by 0
  2. 2025Bias beyond Borders: Global Inequalities in AI-Generated Musiccited by 0
  3. 2026Echoes: A semantically-aligned music deepfake detection datasetcited by 0
  4. 2026From Talking to Singing: A New Challenge for Audio-Visual Deepfake Detectioncited by 0
  5. 2026HAIM: Human-AI Music Datasets for AI Music Production Tracking Benchmarkcited by 0
  6. 2026The Perceived Fragility of Explanations in Audio Models: Manipulation of Attribution with Unchanged Predictionscited by 0
  7. 2026Beyond Artifacts: Towards Generalizable Synthetic Song Detection via Music-Intrinsic Featurescited by 0
  8. 2026How Much AI Is in This Track? Quantifying the Proportion of AI-Generated Stems in Hybrid Music Mixturescited by 0
  9. 2026Assessing AI-generated music detection in real-world broadcast monitoringcited by 0