mlsanityData to 14 Oct 2026

Lyrics Matter: Exploiting the Power of Learnt Representations for Music Popularity Prediction

arXiv 2512.05508 ↗First posted 5 Dec 2025cs.SD cs.AI cs.LGcited by 1

Not on the map. Why?

Abstract (arXiv)

Accurately predicting music popularity is a critical challenge in the music industry, offering benefits to artists, producers, and streaming platforms. Prior research has largely focused on audio features, social metadata, or model architectures. This work addresses the under-explored role of lyrics in predicting popularity. We present an automated pipeline that uses LLM to extract high-dimensional lyric embeddings, capturing semantic, syntactic, and sequential information. These features are integrated into HitMusicLyricNet, a multimodal architecture that combines audio, lyrics, and social metadata for popularity score prediction in the range 0-100. Our method outperforms existing baselines on the SpotGenTrack dataset, which contains over 100,000 tracks, achieving 9% and 20% improvements in MAE and MSE, respectively. Ablation confirms that gains arise from our LLM-driven lyrics feature pipeline (LyricsAENet), underscoring the value of dense lyric representations.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 14 of its 45 references that are in the map. First posted on arXiv 5 Dec 2025.

Builds on

14 of 45 references.

References · 14

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2017A Unified Approach to Interpreting Model Predictionscited by 6,555
  3. 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,070
  4. 2016Gaussian Error Linear Units (GELUs)cited by 3,502
  5. 2017Sigmoid-Weighted Linear Units for Neural Network Function Approximation in Reinforcement Learningcited by 950
  6. 2017Self-Normalizing Neural Networkscited by 598
  7. 2024Foundation Models for Music: A Surveycited by 37
  8. 2020Disentangled Multidimensional Metric Learning for Music Similaritycited by 16
  9. 2018Music Popularity: Metrics, Characteristics, and Audio-Based Predictioncited by 4
  10. 2021Direction is what you need: Improving Word Embedding Compression in Large Language Modelscited by 4
  11. 2019It's Only Words And Words Are All I Havecited by 3
  12. 2019Dance Hit Song Predictioncited by 3
2 more
  1. 2021Lyric document embeddings for music taggingcited by 2
  2. 2022Unique in what sense? Heterogeneous relationships between multiple types of uniqueness and popularity in musiccited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.