mlsanityData to 14 Oct 2026

Double Entendre: Robust Audio-Based AI-Generated Lyrics Detection via Multi-View Fusion

arXiv 2506.15981 ↗First posted 19 Jun 2025cs.CL cs.AI cs.SDcited by 3

Not on the map. Why?

Abstract (arXiv)

The rapid advancement of AI-based music generation tools is revolutionizing the music industry but also posing challenges to artists, copyright holders, and providers alike. This necessitates reliable methods for detecting such AI-generated content. However, existing detectors, relying on either audio or lyrics, face key practical limitations: audio-based detectors fail to generalize to new or unseen generators and are vulnerable to audio perturbations; lyrics-based methods require cleanly formatted and accurate lyrics, unavailable in practice. To overcome these limitations, we propose a novel, practically grounded approach: a multimodal, modular late-fusion pipeline that combines automatically transcribed sung lyrics and speech features capturing lyrics-related information within the audio. By relying on lyrical aspects directly from audio, our method enhances robustness, mitigates susceptibility to low-level artifacts, and enables practical applicability. Experiments show that our method, DE-detect, outperforms existing lyrics-based detectors while also being more robust to audio perturbations. Thus, it offers an effective, robust solution for detecting AI-generated music in real-world scenarios. Our code is available at https://github.com/deezer/robust-AI-lyrics-detection.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 23 of its 38 references that are in the map. First posted on arXiv 19 Jun 2025.

Builds on

23 of 38 references.

References · 23

  1. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
  2. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
  3. 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 4,057
  4. 2020wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representationscited by 3,905
  5. 2021SimCSE: Simple Contrastive Learning of Sentence Embeddingscited by 2,173
  6. 2024M3-Embedding: Multi-Linguality, Multi-Functionality, Multi-Granularity Text Embeddings Through Self-Knowledge Distillationcited by 1,073
  7. 2023DetectGPT: Zero-Shot Machine-Generated Text Detection using Probability Curvaturecited by 726
  8. 2018ESPnet: End-to-End Speech Processing Toolkitcited by 558
  9. 2019Release Strategies and the Social Impacts of Language Modelscited by 513
  10. 2019GLTR: Statistical Detection and Visualization of Generated Textcited by 496
  11. 2023Scaling Speech Technology to 1,000+ Languagescited by 411
  12. 2024LLM2Vec: Large Language Models Are Secretly Powerful Text Encoderscited by 404
11 more
  1. 2019Automatic Detection of Generated Text is Easiest when Humans are Fooledcited by 261
  2. 2020MiniLMv2: Multi-Head Self-Attention Relation Distillation for Compressing Pretrained Transformerscited by 245
  3. 2023MAGE: Machine-generated Text Detection in the Wildcited by 132
  4. 2024Towards Robust Speech Representation Learning for Thousands of Languagescited by 50
  5. 2019SemEval-2013 Task 2: Sentiment Analysis in Twittercited by 22
  6. 2024As Good As A Coin Toss: Human detection of AI-generated images, videos, audio, and audiovisual stimulicited by 22
  7. 2024SONICS: Synthetic Or Not -- Identifying Counterfeit Songscited by 21
  8. 2024From Audio Deepfake Detection to AI-Generated Music Detection -- A Pathway and Overviewcited by 11
  9. 2024Detecting music deepfakes is easy but actually hardcited by 7
  10. 2024Lyrics Transcription for Humans: A Readability-Aware Benchmarkcited by 5
  11. 2024Synthetic Lyrics Detection Across Languages and Genrescited by 4

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 2.

3 papers.