From West to East: Who can understand the music of the others better?
Not on the map. Why?
Abstract (arXiv)
Recent developments in MIR have led to several benchmark deep learning models whose embeddings can be used for a variety of downstream tasks. At the same time, the vast majority of these models have been trained on Western pop/rock music and related styles. This leads to research questions on whether these models can be used to learn representations for different music cultures and styles, or whether we can build similar music audio embedding models trained on data from different cultures or styles. To that end, we leverage transfer learning methods to derive insights about the similarities between the different music cultures to which the data belongs to. We use two Western music datasets, two traditional/folk datasets coming from eastern Mediterranean cultures, and two datasets belonging to Indian art music. Three deep audio embedding models are trained and transferred across domains, including two CNN-based and a Transformer-based architecture, to perform auto-tagging for each target domain dataset. Experimental results show that competitive performance is achieved in all domains via transfer learning, while the best source dataset varies for each music culture. The implementation and the trained models are both provided in a public repository.
Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 18 of its 38 references that are in the map. First posted on arXiv 19 Jul 2023.
Builds on
18 of 38 references.
References · 18
- 2017Attention Is All You Needcited by 59,932
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
- 2013Rich feature hierarchies for accurate object detection and semantic segmentationcited by 2,160
- 2015Learning Transferable Features with Deep Adaptation Networkscited by 1,323
- 2014How transferable are features in deep neural networks?cited by 1,216
- 2019A Comprehensive Survey on Transfer Learningcited by 1,154
- 2016CNN Architectures for Large-Scale Audio Classificationcited by 701
- 2021AST: Audio Spectrogram Transformercited by 634
- 2015Simultaneous Deep Transfer Across Domains and Taskscited by 205
- 2016FMA: A Dataset For Music Analysiscited by 205
- 2018Wave-U-Net: A Multi-Scale Neural Network for End-to-End Audio Source Separationcited by 125
6 more
- 2019musicnn: Pre-trained convolutional neural networks for music audio taggingcited by 49
- 2016Automatic tagging using deep convolutional neural networkscited by 39
- 2020Evaluation of CNN-based Automatic Music Tagging Modelscited by 39
- 2017Transfer Learning for Sequence Tagging with Hierarchical Recurrent Networkscited by 30
- 2017End-to-end learning for music audio tagging at scalecited by 25
- 2022A Dataset for Greek Traditional and Folk Music: Lyracited by 8
Built on by
Citing papers per year: 2024: 1; 2025: 3; 2026: 1.
5 papers.
- 2024LC-Protonets: Multi-Label Few-Shot Learning for World Music Audio Taggingcited by 6
- 2025Universal Music Representations? Evaluating Foundation Models on World Music Corporacited by 3
- 2025CultureMERT: Continual Pre-Training for Cross-Cultural Music Representation Learningcited by 1
- 2025Learning Music Audio Representations With Limited Datacited by 0
- 2026Pose-Aware Multimodal Automatic Tagging for Greek Traditional Musiccited by 0
- 2026Pose-Aware Multimodal Automatic Tagging for Greek Traditional Music22 Sep 2026
- 2025CultureMERT: Continual Pre-Training for Cross-Cultural Music Representation Learning21 Jun 2025
- 2025Universal Music Representations? Evaluating Foundation Models on World Music Corpora20 Jun 2025
- 2025Learning Music Audio Representations With Limited Data9 May 2025
- 2024LC-Protonets: Multi-Label Few-Shot Learning for World Music Audio Tagging17 Sep 2024