Synthetic Lyrics Detection Across Languages and Genres
Not on the map. Why?
Abstract (arXiv)
In recent years, the use of large language models (LLMs) to generate music content, particularly lyrics, has gained in popularity. These advances provide valuable tools for artists and enhance their creative processes, but they also raise concerns about copyright violations, consumer satisfaction, and content spamming. Previous research has explored content detection in various domains. However, no work has focused on the text modality, lyrics, in music. To address this gap, we curated a diverse dataset of real and synthetic lyrics from multiple languages, music genres, and artists. The generation pipeline was validated using both humans and automated methods. We performed a thorough evaluation of existing synthetic text detection approaches on lyrics, a previously unexplored data type. We also investigated methods to adapt the best-performing features to lyrics through unsupervised domain adaptation. Following both music and industrial constraints, we examined how well these approaches generalize across languages, scale with data availability, handle multilingual language content, and perform on novel genres in few-shot settings. Our findings show promising results that could inform policy decisions around AI-generated music and enhance transparency for users.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 41 of its 73 references that are in the map. First posted on arXiv 21 Jun 2024.
Builds on
41 of 73 references.
References · 41
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
- 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
- 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,304
- 2021SimCSE: Simple Contrastive Learning of Sentence Embeddingscited by 2,168
- 2021Fantastically Ordered Prompts and Where to Find Them: Overcoming Few-Shot Prompt Order Sensitivitycited by 1,122
- 2023WizardLM: Empowering large pre-trained language models to follow complex instructionscited by 1,116
- 2020MPNet: Masked and Permuted Pre-training for Language Understandingcited by 973
- 2023DetectGPT: Zero-Shot Machine-Generated Text Detection using Probability Curvaturecited by 705
- 2024TinyLlama: An Open-Source Small Language Modelcited by 604
- 2020Jukebox: A Generative Model for Musiccited by 535
- 2019Release Strategies and the Social Impacts of Language Modelscited by 505
29 more
- 2019GLTR: Statistical Detection and Visualization of Generated Textcited by 490
- 2024LLM2Vec: Large Language Models Are Secretly Powerful Text Encoderscited by 396
- 2023Can AI-Generated Text be Reliably Detected?cited by 372
- 2019Automatic Detection of Generated Text is Easiest when Humans are Fooledcited by 260
- 2020MiniLMv2: Multi-Head Self-Attention Relation Distillation for Compressing Pretrained Transformerscited by 240
- 2023DetectLLM: Leveraging Log Rank Information for Zero-Shot Detection of Machine-Generated Textcited by 207
- 2024RAID: A Shared Benchmark for Robust Evaluation of Machine-Generated Text Detectorscited by 157
- 2023MAGE: Machine-generated Text Detection in the Wildcited by 130
- 2020Adversarial Watermarking Transformer: Towards Tracing Text Provenance with Data Hidingcited by 121
- 2019Real or Fake? Learning to Discriminate Machine from Human Generated Textcited by 98
- 2023Music ControlNet: Multiple Time-varying Controls for Music Generationcited by 82
- 2023A Survey on Detection of LLMs-Generated Contentcited by 70
- 2019The Limitations of Stylometry for Detecting Machine-Generated Fake Newscited by 63
- 2020One-class Learning Towards Synthetic Voice Spoofing Detectioncited by 59
- 2023LLMDet: A Third Party Large Language Models Generated Text Detection Toolcited by 44
- 2024M4GT-Bench: Evaluation Benchmark for Black-Box Machine-Generated Text Detectioncited by 43
- 2024Few-Shot Detection of Machine-Generated Text using Style Representationscited by 40
- 2023Token Prediction as Implicit Classification to Identify LLM-Generated Textcited by 26
- 2023From Text to Source: Results in Detecting Large Language Model-Generated Contentcited by 25
- 2023How Reliable Are AI-Generated-Text Detectors? An Assessment Framework Using Evasive Soft Promptscited by 23
- 2019SemEval-2013 Task 2: Sentiment Analysis in Twittercited by 22
- 2021SciXGen: A Scientific Paper Dataset for Context-Aware Text Generationcited by 22
- 2024Generative AI in EU Law: Liability, Privacy, Intellectual Property, and Cybersecuritycited by 21
- 2023Counter Turing Test CT^2: AI-Generated Text Detection is Not as Easy as You May Think -- Introducing AI Detectability Indexcited by 14
- 2023A Simple yet Efficient Ensemble Approach for AI-generated Text Detectioncited by 12
- 2024AI Art is Theft: Labour, Extraction, and Exploitation, Or, On the Dangers of Stochastic Pollockscited by 12
- 2023Unsupervised Melody-to-Lyric Generationcited by 7
- 2024Detecting music deepfakes is easy but actually hardcited by 7
- 2020Modeling the Music Genre Perception across Language-Bound Culturescited by 6
Built on by
Citing papers per year: 2025: 3; 2026: 1.
4 papers.
- 2025Double Entendre: Robust Audio-Based AI-Generated Lyrics Detection via Multi-View Fusioncited by 3
- 2025AI-Generated Song Detection via Lyrics Transcriptscited by 2
- 2025Bias beyond Borders: Global Inequalities in AI-Generated Musiccited by 0
- 2026Phun-Bench: Evaluating LLMs on Phonological Understanding in Chinesecited by 0
- 2026Phun-Bench: Evaluating LLMs on Phonological Understanding in Chinese5 Jun 2026
- 2025Bias beyond Borders: Global Inequalities in AI-Generated Music2 Oct 2025
- 2025AI-Generated Song Detection via Lyrics Transcripts23 Jun 2025
- 2025Double Entendre: Robust Audio-Based AI-Generated Lyrics Detection via Multi-View Fusion19 Jun 2025