mlsanityData to 14 Oct 2026

Synergistic Feature Fusion for Latent Lyrical Classification: A Gated Deep Learning Architecture

arXiv 2511.11673 ↗First posted 11 Nov 2025cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

This study addresses the challenge of integrating complex, high-dimensional deep semantic features with simple, interpretable structural cues for lyrical content classification. We introduce a novel Synergistic Fusion Layer (SFL) architecture, a deep learning model utilizing a gated mechanism to modulate Sentence-BERT embeddings (Fdeep) using low-dimensional auxiliary features (Fstruct). The task, derived from clustering UMAP-reduced lyrical embeddings, is reframed as binary classification, distinguishing a dominant, homogeneous cluster (Class 0) from all other content (Class 1). The SFL model achieved an accuracy of 0.9894 and a Macro F1 score of 0.9894, outperforming a comprehensive Random Forest (RF) baseline that used feature concatenation (Accuracy = 0.9868). Crucially, the SFL model demonstrated vastly superior reliability and calibration, exhibiting a 93% reduction in Expected Calibration Error (ECE = 0.0035) and a 2.5x lower Log Loss (0.0304) compared to the RF baseline (ECE = 0.0500; Log Loss = 0.0772). This performance validates the architectural hypothesis that non-linear gating is superior to simple feature concatenation, establishing the SFL model as a robust and trustworthy system for complex multimodal lyrical analysis.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 8 of its 15 references that are in the map. First posted on arXiv 11 Nov 2025.

Builds on

8 of 15 references.

References · 8

  1. 2017Attention Is All You Needcited by 60,361
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  3. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
  4. 2014Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translationcited by 4,057
  5. 2018UMAP: Uniform Manifold Approximation and Projection for Dimension Reductioncited by 2,898
  6. 2024Conformal Prediction via Regression-as-Classificationcited by 18
  7. 2024Powerful batch conformal prediction for classificationcited by 4
  8. 2025Multi-label Cross-lingual automatic music genre classification from lyrics with Sentence BERTcited by 2

Built on by

Not cited yet.