musicnn: Pre-trained convolutional neural networks for music audio tagging
Not on the map. Why?
Abstract (arXiv)
Pronounced as "musician", the musicnn library contains a set of pre-trained musically motivated convolutional neural networks for music audio tagging: https://github.com/jordipons/musicnn. This repository also includes some pre-trained vgg-like baselines. These models can be used as out-of-the-box music audio taggers, as music feature extractors, or as pre-trained models for transfer learning. We also provide the code to train the aforementioned models: https://github.com/jordipons/musicnn-training. This framework also allows implementing novel models. For example, a musically motivated convolutional neural network with an attention-based output layer (instead of the temporal pooling layer) can achieve state-of-the-art results for music audio tagging: 90.77 ROC-AUC / 38.61 PR-AUC on the MagnaTagATune dataset --- and 88.81 ROC-AUC / 31.51 PR-AUC on the Million Song Dataset.
Key facts. Cited by 50 papers in the map (data through 14 Oct 2026). First posted on arXiv 14 Sep 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 3; 2022: 12; 2023: 11; 2024: 12; 2025: 6; 2026: 6.
50 papers.
Sort:
By area:
- 2023MERT: Acoustic Music Understanding Model with Large-Scale Self-supervised Trainingcited by 181
- 2021Codified audio language modeling learns useful representations for music information retrievalcited by 64
- 2023MARBLE: Music Audio Representation Benchmark for Universal Evaluationcited by 38
- 2022Supervised and Unsupervised Learning of Audio Representations for Music Understandingcited by 35
- 2024Music2Latent: Consistency Autoencoders for Latent Audio Compressioncited by 33
- 2022MAP-Music2Vec: A Simple and Effective Baseline for Self-Supervised Music Audio Representation Learningcited by 22
- 2023MuseChat: A Conversational Music Recommendation System for Videoscited by 21
- 2022It's Time for Artistic Correspondence in Music and Videocited by 18
- 2023Language-Guided Music Recommendation for Video via Prompt Analogiescited by 18
- 2022Low-Resource Music Genre Classification with Cross-Modal Neural Model Reprogrammingcited by 17
- 2024A Multimodal Single-Branch Embedding Network for Recommendation in Cold-Start and Missing Modality Scenarioscited by 13
- 2022Flow Moods: Recommending Music by Moods on Deezercited by 11
38 more
- 2022Contrastive Learning with Positive-Negative Frame Mask for Music Representationcited by 10
- 2024ECC Analyzer: Extract Trading Signal from Earnings Conference Calls using Large Language Model for Stock Performance Predictioncited by 9
- 2024LC-Protonets: Multi-Label Few-Shot Learning for World Music Audio Taggingcited by 7
- 2022Jointist: Joint Learning for Multi-instrument Transcription and Its Applicationscited by 6
- 2024Music Foundation Model as Generic Booster for Music Downstream Taskscited by 6
- 2022Towards Proper Contrastive Self-supervised Learning Strategies For Music Audio Representationcited by 5
- 2023Learning Music Sequence Representation from Text Supervisioncited by 5
- 2023From West to East: Who can understand the music of the others better?cited by 5
- 2025FilmComposer: LLM-Driven Music Production for Silent Film Clipscited by 5
- 2022Exploiting Negative Preference in Content-based Music Recommendation with Contrastive Learningcited by 4
- 2025Music2Latent2: Audio Compression with Summary Embeddings and Autoregressive Decodingcited by 4
- 2025A Comprehensive Survey on Generative AI for Video-to-Music Generationcited by 4
- 2021Deep Learning Based EDM Subgenre Classification using Mel-Spectrogram and Tempogram Featurescited by 3
- 2022Learning Unsupervised Hierarchies of Audio Conceptscited by 3
- 2022Music Instrument Classification Reprogrammedcited by 3
- 2023Jointist: Simultaneous Improvement of Multi-instrument Transcription and Music Source Separation via Joint Trainingcited by 3
- 2025Myna: Masking-Based Contrastive Learning of Musical Representationscited by 3
- 2025Universal Music Representations? Evaluating Foundation Models on World Music Corporacited by 3
- 2024MVBIND: Self-Supervised Music Recommendation For Videos Via Embedding Space Bindingcited by 2
- 2024PIAST: A Multimodal Piano Dataset with Audio, Symbolic and Textcited by 2
- 2023What You Hear Is What You See: Audio Quality Metrics From Image Quality Metricscited by 1
- 2023Towards Contrastive Learning in Music Video Domaincited by 1
- 2023MDSC: Towards Evaluating the Style Consistency Between Music and Dancecited by 1
- 2023A Holistic Evaluation of Piano Sound Qualitycited by 1
- 2024A Computational Analysis of Lyric Similarity Perceptioncited by 1
- 2024Towards Training Music Taggers on Synthetic Datacited by 1
- 2024Music auto-tagging in the long tail: A few-shot approachcited by 1
- 2021Multi-task Learning with Metadata for Music Mood Classificationcited by 0
- 2022Pathway to Future Symbiotic Creativitycited by 0
- 2024An approach to hummed-tune and song sequences matchingcited by 0
- 2024Combining Genre Classification and Harmonic-Percussive Features with Diffusion Models for Music-Video Generationcited by 0
- 2025Learning Music Audio Representations With Limited Datacited by 0
- 2026Linear Complexity Self-Supervised Learning for Music Understanding with Random Quantizercited by 0
- 2026Scalable Music Cover Retrieval Using Lyrics-Aligned Audio Embeddingscited by 0
- 2026LabelBuddy: An Open Source Music and Audio Language Annotation Tagging Tool Using AI Assistancecited by 0
- 2026Constructing Composite Features for Interpretable Music-Taggingcited by 0
- 2026Multimodal Music Recommendation System using LLMscited by 0
- 2026Self-Representation Alignment in Diffusion Models for Video Background Music Generationcited by 0
- 2026Self-Representation Alignment in Diffusion Models for Video Background Music Generation11 Oct 2026
- 2026Multimodal Music Recommendation System using LLMs28 May 2026
- 2026Constructing Composite Features for Interpretable Music-Tagging30 Mar 2026
- 2026LabelBuddy: An Open Source Music and Audio Language Annotation Tagging Tool Using AI Assistance4 Mar 2026
- 2026Scalable Music Cover Retrieval Using Lyrics-Aligned Audio Embeddings16 Jan 2026
- 2026Linear Complexity Self-Supervised Learning for Music Understanding with Random Quantizer14 Jan 2026
- 2025Universal Music Representations? Evaluating Foundation Models on World Music Corpora20 Jun 2025
- 2025Learning Music Audio Representations With Limited Data9 May 2025
- 2025FilmComposer: LLM-Driven Music Production for Silent Film Clips11 Mar 2025
- 2025Myna: Masking-Based Contrastive Learning of Musical Representations18 Feb 2025
- 2025A Comprehensive Survey on Generative AI for Video-to-Music Generation18 Feb 2025
- 2025Music2Latent2: Audio Compression with Summary Embeddings and Autoregressive Decoding29 Jan 2025
38 more
- 2024Combining Genre Classification and Harmonic-Percussive Features with Diffusion Models for Music-Video Generation7 Dec 2024
- 2024PIAST: A Multimodal Piano Dataset with Audio, Symbolic and Text4 Nov 2024
- 2024Music Foundation Model as Generic Booster for Music Downstream Tasks2 Nov 2024
- 2024An approach to hummed-tune and song sequences matching27 Oct 2024
- 2024A Multimodal Single-Branch Embedding Network for Recommendation in Cold-Start and Missing Modality Scenarios26 Sep 2024
- 2024LC-Protonets: Multi-Label Few-Shot Learning for World Music Audio Tagging17 Sep 2024
- 2024Music auto-tagging in the long tail: A few-shot approach12 Sep 2024
- 2024Music2Latent: Consistency Autoencoders for Latent Audio Compression12 Aug 2024
- 2024Towards Training Music Taggers on Synthetic Data2 Jul 2024
- 2024MVBIND: Self-Supervised Music Recommendation For Videos Via Embedding Space Binding15 May 2024
- 2024ECC Analyzer: Extract Trading Signal from Earnings Conference Calls using Large Language Model for Stock Performance Prediction29 Apr 2024
- 2024A Computational Analysis of Lyric Similarity Perception2 Apr 2024
- 2023MuseChat: A Conversational Music Recommendation System for Videos10 Oct 2023
- 2023A Holistic Evaluation of Piano Sound Quality7 Oct 2023
- 2023MDSC: Towards Evaluating the Style Consistency Between Music and Dance4 Sep 2023
- 2023Towards Contrastive Learning in Music Video Domain1 Sep 2023
- 2023From West to East: Who can understand the music of the others better?19 Jul 2023
- 2023MARBLE: Music Audio Representation Benchmark for Universal Evaluation18 Jun 2023
- 2023Language-Guided Music Recommendation for Video via Prompt Analogies15 Jun 2023
- 2023MERT: Acoustic Music Understanding Model with Large-Scale Self-supervised Training31 May 2023
- 2023Learning Music Sequence Representation from Text Supervision31 May 2023
- 2023What You Hear Is What You See: Audio Quality Metrics From Image Quality Metrics19 May 2023
- 2023Jointist: Simultaneous Improvement of Multi-instrument Transcription and Music Source Separation via Joint Training1 Feb 2023
- 2022MAP-Music2Vec: A Simple and Effective Baseline for Self-Supervised Music Audio Representation Learning5 Dec 2022
- 2022Music Instrument Classification Reprogrammed15 Nov 2022
- 2022Low-Resource Music Genre Classification with Cross-Modal Neural Model Reprogramming2 Nov 2022
- 2022Supervised and Unsupervised Learning of Audio Representations for Music Understanding7 Oct 2022
- 2022Pathway to Future Symbiotic Creativity18 Aug 2022
- 2022Exploiting Negative Preference in Content-based Music Recommendation with Contrastive Learning28 Jul 2022
- 2022Learning Unsupervised Hierarchies of Audio Concepts21 Jul 2022
- 2022Flow Moods: Recommending Music by Moods on Deezer15 Jul 2022
- 2022Towards Proper Contrastive Self-supervised Learning Strategies For Music Audio Representation10 Jul 2022
- 2022Jointist: Joint Learning for Multi-instrument Transcription and Its Applications22 Jun 2022
- 2022It's Time for Artistic Correspondence in Music and Video14 Jun 2022
- 2022Contrastive Learning with Positive-Negative Frame Mask for Music Representation17 Mar 2022
- 2021Deep Learning Based EDM Subgenre Classification using Mel-Spectrogram and Tempogram Features17 Oct 2021
- 2021Multi-task Learning with Metadata for Music Mood Classification10 Oct 2021
- 2021Codified audio language modeling learns useful representations for music information retrieval12 Jul 2021
- 2024Music2Latent: Consistency Autoencoders for Latent Audio Compressioncited by 33
- 2025Music2Latent2: Audio Compression with Summary Embeddings and Autoregressive Decodingcited by 4
- 2024Combining Genre Classification and Harmonic-Percussive Features with Diffusion Models for Music-Video Generationcited by 0
- 2026Self-Representation Alignment in Diffusion Models for Video Background Music Generationcited by 0
- 2026Self-Representation Alignment in Diffusion Models for Video Background Music Generation11 Oct 2026
- 2025Music2Latent2: Audio Compression with Summary Embeddings and Autoregressive Decoding29 Jan 2025
- 2024Combining Genre Classification and Harmonic-Percussive Features with Diffusion Models for Music-Video Generation7 Dec 2024
- 2024Music2Latent: Consistency Autoencoders for Latent Audio Compression12 Aug 2024
- 2023MERT: Acoustic Music Understanding Model with Large-Scale Self-supervised Trainingcited by 181
- 2021Codified audio language modeling learns useful representations for music information retrievalcited by 64
- 2023MARBLE: Music Audio Representation Benchmark for Universal Evaluationcited by 38
- 2022Supervised and Unsupervised Learning of Audio Representations for Music Understandingcited by 35
- 2022MAP-Music2Vec: A Simple and Effective Baseline for Self-Supervised Music Audio Representation Learningcited by 22
- 2023MuseChat: A Conversational Music Recommendation System for Videoscited by 21
- 2022It's Time for Artistic Correspondence in Music and Videocited by 18
- 2023Language-Guided Music Recommendation for Video via Prompt Analogiescited by 18
- 2022Low-Resource Music Genre Classification with Cross-Modal Neural Model Reprogrammingcited by 17
- 2024A Multimodal Single-Branch Embedding Network for Recommendation in Cold-Start and Missing Modality Scenarioscited by 13
- 2022Flow Moods: Recommending Music by Moods on Deezercited by 11
- 2022Contrastive Learning with Positive-Negative Frame Mask for Music Representationcited by 10
12 most cited of 46 All 46 (JSON)
- 2026Multimodal Music Recommendation System using LLMs28 May 2026
- 2026Constructing Composite Features for Interpretable Music-Tagging30 Mar 2026
- 2026LabelBuddy: An Open Source Music and Audio Language Annotation Tagging Tool Using AI Assistance4 Mar 2026
- 2026Scalable Music Cover Retrieval Using Lyrics-Aligned Audio Embeddings16 Jan 2026
- 2026Linear Complexity Self-Supervised Learning for Music Understanding with Random Quantizer14 Jan 2026
- 2025Universal Music Representations? Evaluating Foundation Models on World Music Corpora20 Jun 2025
- 2025Learning Music Audio Representations With Limited Data9 May 2025
- 2025FilmComposer: LLM-Driven Music Production for Silent Film Clips11 Mar 2025
- 2025Myna: Masking-Based Contrastive Learning of Musical Representations18 Feb 2025
- 2025A Comprehensive Survey on Generative AI for Video-to-Music Generation18 Feb 2025
- 2024PIAST: A Multimodal Piano Dataset with Audio, Symbolic and Text4 Nov 2024
- 2024Music Foundation Model as Generic Booster for Music Downstream Tasks2 Nov 2024
12 newest of 46 All 46 (JSON)