And what if two musical versions don't share melody, harmony, rhythm, or lyrics ?
Not on the map. Why?
Abstract (arXiv)
Version identification (VI) has seen substantial progress over the past few years. On the one hand, the introduction of the metric learning paradigm has favored the emergence of scalable yet accurate VI systems. On the other hand, using features focusing on specific aspects of musical pieces, such as melody, harmony, or lyrics, yielded interpretable and promising performances. In this work, we build upon these recent advances and propose a metric learning-based system systematically leveraging four dimensions commonly admitted to convey musical similarity between versions: melodic line, harmonic structure, rhythmic patterns, and lyrics. We describe our deliberately simple model architecture, and we show in particular that an approximated representation of the lyrics is an efficient proxy to discriminate between versions and non-versions. We then describe how these features complement each other and yield new state-of-the-art performances on two publicly available datasets. We finally suggest that a VI system using a combination of melodic, harmonic, rhythmic and lyrics features could theoretically reach the optimal performances obtainable on these datasets.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 13 of its 30 references that are in the map. First posted on arXiv 3 Oct 2022.
Builds on
13 of 30 references.
References · 13
- 2015FaceNet: A Unified Embedding for Face Recognition and Clusteringcited by 2,833
- 2016Wav2Letter: an End-to-End ConvNet-based Speech Recognition Systemcited by 43
- 2018Towards a universal neural network encoder for time seriescited by 28
- 2018Fully Convolutional Speech Recognitioncited by 19
- 2019DALI: a large Dataset of synchronized Audio, LyrIcs and notes, automatically created using teacher-student machine learning paradigmcited by 19
- 2020Disentangled Multidimensional Metric Learning for Music Similaritycited by 16
- 2019End-to-end Lyrics Alignment for Polyphonic Music Using an Audio-to-Character Recognition Modelcited by 15
- 2021Energy Consumption of Deep Generative Audio Modelscited by 12
- 2021Audio-based Musical Version Identification: Elements and Challengescited by 12
- 2019Learning a Representation for Cover Song Identification Using Convolutional Neural Networkcited by 8
- 2019Accurate and Scalable Version Identification Using Musically-Motivated Embeddingscited by 7
- 2019Acoustic Modeling for Automatic Lyrics-to-Audio Alignmentcited by 5
1 more
- 2019Cover Detection using Dominant Melody Embeddingscited by 3
Built on by
Citing papers per year: 2024: 1; 2025: 0; 2026: 2.
3 papers.