Automatic tagging using deep convolutional neural networks
Not on the map. Why?
Abstract (arXiv)
We present a content-based automatic music tagging algorithm using fully convolutional neural networks (FCNs). We evaluate different architectures consisting of 2D convolutional layers and subsampling layers only. In the experiments, we measure the AUC-ROC scores of the architectures with different complexities and input types using the MagnaTagATune dataset, where a 4-layer architecture shows state-of-the-art performance with mel-spectrogram input. Furthermore, we evaluated the performances of the architectures with varying the number of layers on a larger dataset (Million Song Dataset), and found that deeper models outperformed the 4-layer architecture. The experiments show that mel-spectrogram is an effective time-frequency representation for automatic tagging and that more complex models benefit from more training data.
Key facts. Cited by 39 papers in the map (data through 7 Oct 2026). First posted on arXiv 1 Jun 2016.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 10; 2022: 4; 2023: 12; 2024: 9; 2025: 2; 2026: 2.
39 papers.
Sort:
By area:
- 2024Foundation Models for Music: A Surveycited by 34
- 2021Single-Layer Vision Transformers for More Accurate Early Exits with Less Overheadcited by 26
- 2021MusCaps: Generating Captions for Music Audiocited by 23
- 2023MuseChat: A Conversational Music Recommendation System for Videoscited by 21
- 2021Multi-Task Self-Supervised Pre-Training for Music Classificationcited by 18
- 2023Language-Guided Music Recommendation for Video via Prompt Analogiescited by 18
- 2021SpecTNT: a Time-Frequency Transformer for Music Audiocited by 15
- 2022Continual Transformers: Redundancy-Free Attention for Online Inferencecited by 12
- 2022Flow Moods: Recommending Music by Moods on Deezercited by 11
- 2022Contrastive Learning with Positive-Negative Frame Mask for Music Representationcited by 10
- 2023Learning Music Sequence Representation from Text Supervisioncited by 5
- 2023From West to East: Who can understand the music of the others better?cited by 5
27 more
- 2023Joint Music and Language Attention Models for Zero-shot Music Taggingcited by 5
- 2022Pretrained audio neural networks for Speech emotion recognition in Portuguesecited by 3
- 2023LEAN: Light and Efficient Audio Classification Networkcited by 3
- 2021Listen, Read, and Identify: Multimodal Singing Language Identification of Musiccited by 2
- 2023Employing Crowdsourcing for Enriching a Music Knowledge Base in Higher Educationcited by 2
- 2024Movie Trailer Genre Classification Using Multimodal Pretrained Featurescited by 2
- 2024Continual Low-Rank Scaled Dot-product Attentioncited by 2
- 2021A Visual Domain Transfer Learning Approach for Heartbeat Sound Classificationcited by 1
- 2021Unsupervised Source Separation By Steering Pretrained Music Modelscited by 1
- 2023Towards Contrastive Learning in Music Video Domaincited by 1
- 2023MDSC: Towards Evaluating the Style Consistency Between Music and Dancecited by 1
- 2024Automated Bioacoustic Monitoring for South African Bird Species on Unlabeled Datacited by 1
- 2024MERGE -- A Bimodal Audio-Lyrics Dataset for Static Music Emotion Recognitioncited by 1
- 2024Knowledge Distillation for Real-Time Classification of Early Media in Voice Communicationscited by 1
- 2021MuSLCAT: Multi-Scale Multi-Level Convolutional Attention Transformer for Discriminative Music Modeling on Raw Waveformscited by 0
- 2021Timbre Classification of Musical Instruments with a Deep Learning Multi-Head Attention-Based Modelcited by 0
- 2021Multi-task Learning with Metadata for Music Mood Classificationcited by 0
- 2023Audio-Visual Dataset and Method for Anomaly Detection in Traffic Videoscited by 0
- 2023Improving Primate Sounds Classification using Binary Presorting for Deep Learningcited by 0
- 2023AI and Tempo Estimation: A Reviewcited by 0
- 2024Pictures Of MIDI: Controlled Music Generation via Graphical Prompts for Image-Based Diffusion Inpaintingcited by 0
- 2024Music Era Recognition Using Supervised Contrastive Learning and Artist Informationcited by 0
- 2024An approach to hummed-tune and song sequences matchingcited by 0
- 2025MMVA: Multimodal Matching Based on Valence and Arousal across Images, Music, and Musical Captionscited by 0
- 2025Learning Normal Patterns in Musical Loopscited by 0
- 2026Structural Bottlenecks on Frequency Representation in End-to-End Audio Modelscited by 0
- 2026Flower Hub: A Reproducible Benchmarking Platform for Federated Learning in Simulation and Deploymentcited by 0
- 2026Flower Hub: A Reproducible Benchmarking Platform for Federated Learning in Simulation and Deployment25 Aug 2026
- 2026Structural Bottlenecks on Frequency Representation in End-to-End Audio Models9 Jul 2026
- 2025Learning Normal Patterns in Musical Loops22 May 2025
- 2025MMVA: Multimodal Matching Based on Valence and Arousal across Images, Music, and Musical Captions2 Jan 2025
- 2024Continual Low-Rank Scaled Dot-product Attention4 Dec 2024
- 2024Knowledge Distillation for Real-Time Classification of Early Media in Voice Communications28 Oct 2024
- 2024An approach to hummed-tune and song sequences matching27 Oct 2024
- 2024Movie Trailer Genre Classification Using Multimodal Pretrained Features11 Oct 2024
- 2024Foundation Models for Music: A Survey26 Aug 2024
- 2024MERGE -- A Bimodal Audio-Lyrics Dataset for Static Music Emotion Recognition8 Jul 2024
- 2024Music Era Recognition Using Supervised Contrastive Learning and Artist Information7 Jul 2024
- 2024Pictures Of MIDI: Controlled Music Generation via Graphical Prompts for Image-Based Diffusion Inpainting1 Jul 2024
27 more
- 2024Automated Bioacoustic Monitoring for South African Bird Species on Unlabeled Data19 Jun 2024
- 2023AI and Tempo Estimation: A Review30 Dec 2023
- 2023Joint Music and Language Attention Models for Zero-shot Music Tagging16 Oct 2023
- 2023MuseChat: A Conversational Music Recommendation System for Videos10 Oct 2023
- 2023MDSC: Towards Evaluating the Style Consistency Between Music and Dance4 Sep 2023
- 2023Towards Contrastive Learning in Music Video Domain1 Sep 2023
- 2023From West to East: Who can understand the music of the others better?19 Jul 2023
- 2023Improving Primate Sounds Classification using Binary Presorting for Deep Learning28 Jun 2023
- 2023Language-Guided Music Recommendation for Video via Prompt Analogies15 Jun 2023
- 2023Employing Crowdsourcing for Enriching a Music Knowledge Base in Higher Education12 Jun 2023
- 2023Learning Music Sequence Representation from Text Supervision31 May 2023
- 2023Audio-Visual Dataset and Method for Anomaly Detection in Traffic Videos24 May 2023
- 2023LEAN: Light and Efficient Audio Classification Network22 May 2023
- 2022Pretrained audio neural networks for Speech emotion recognition in Portuguese26 Oct 2022
- 2022Flow Moods: Recommending Music by Moods on Deezer15 Jul 2022
- 2022Contrastive Learning with Positive-Negative Frame Mask for Music Representation17 Mar 2022
- 2022Continual Transformers: Redundancy-Free Attention for Online Inference17 Jan 2022
- 2021Unsupervised Source Separation By Steering Pretrained Music Models25 Oct 2021
- 2021SpecTNT: a Time-Frequency Transformer for Music Audio18 Oct 2021
- 2021Multi-task Learning with Metadata for Music Mood Classification10 Oct 2021
- 2021A Visual Domain Transfer Learning Approach for Heartbeat Sound Classification28 Jul 2021
- 2021Timbre Classification of Musical Instruments with a Deep Learning Multi-Head Attention-Based Model13 Jul 2021
- 2021Single-Layer Vision Transformers for More Accurate Early Exits with Less Overhead19 May 2021
- 2021MusCaps: Generating Captions for Music Audio24 Apr 2021
- 2021MuSLCAT: Multi-Scale Multi-Level Convolutional Attention Transformer for Discriminative Music Modeling on Raw Waveforms6 Apr 2021
- 2021Listen, Read, and Identify: Multimodal Singing Language Identification of Music2 Mar 2021
- 2021Multi-Task Self-Supervised Pre-Training for Music Classification5 Feb 2021
- 2024Foundation Models for Music: A Surveycited by 34
- 2024Foundation Models for Music: A Survey26 Aug 2024
- 2021MusCaps: Generating Captions for Music Audiocited by 23
- 2023MuseChat: A Conversational Music Recommendation System for Videoscited by 21
- 2021Multi-Task Self-Supervised Pre-Training for Music Classificationcited by 18
- 2023Language-Guided Music Recommendation for Video via Prompt Analogiescited by 18
- 2021SpecTNT: a Time-Frequency Transformer for Music Audiocited by 15
- 2022Continual Transformers: Redundancy-Free Attention for Online Inferencecited by 12
- 2022Flow Moods: Recommending Music by Moods on Deezercited by 11
- 2022Contrastive Learning with Positive-Negative Frame Mask for Music Representationcited by 10
- 2023Learning Music Sequence Representation from Text Supervisioncited by 5
- 2023From West to East: Who can understand the music of the others better?cited by 5
- 2023Joint Music and Language Attention Models for Zero-shot Music Taggingcited by 5
- 2022Pretrained audio neural networks for Speech emotion recognition in Portuguesecited by 3
12 most cited of 37 All 37 (JSON)
- 2026Flower Hub: A Reproducible Benchmarking Platform for Federated Learning in Simulation and Deployment25 Aug 2026
- 2026Structural Bottlenecks on Frequency Representation in End-to-End Audio Models9 Jul 2026
- 2025Learning Normal Patterns in Musical Loops22 May 2025
- 2025MMVA: Multimodal Matching Based on Valence and Arousal across Images, Music, and Musical Captions2 Jan 2025
- 2024Continual Low-Rank Scaled Dot-product Attention4 Dec 2024
- 2024Knowledge Distillation for Real-Time Classification of Early Media in Voice Communications28 Oct 2024
- 2024An approach to hummed-tune and song sequences matching27 Oct 2024
- 2024Movie Trailer Genre Classification Using Multimodal Pretrained Features11 Oct 2024
- 2024MERGE -- A Bimodal Audio-Lyrics Dataset for Static Music Emotion Recognition8 Jul 2024
- 2024Music Era Recognition Using Supervised Contrastive Learning and Artist Information7 Jul 2024
- 2024Pictures Of MIDI: Controlled Music Generation via Graphical Prompts for Image-Based Diffusion Inpainting1 Jul 2024
- 2024Automated Bioacoustic Monitoring for South African Bird Species on Unlabeled Data19 Jun 2024
12 newest of 37 All 37 (JSON)