JamendoMaxCaps: A Large Scale Music-caption Dataset with Imputed Metadata
Not on the map. Why?
Abstract (arXiv)
We introduce JamendoMaxCaps, a large-scale music-caption dataset featuring over 362,000 freely licensed instrumental tracks from the renowned Jamendo platform. The dataset includes captions generated by a state-of-the-art captioning model, enhanced with imputed metadata. We also introduce a retrieval system that leverages both musical features and metadata to identify similar songs, which are then used to fill in missing metadata using a local large language model (LLLM). This approach allows us to provide a more comprehensive and informative dataset for researchers working on music-language understanding tasks. We validate this approach quantitatively with five different measurements. By making the JamendoMaxCaps dataset publicly available, we provide a high-quality resource to advance research in music-language understanding tasks such as music retrieval, multimodal representation learning, and generative music models.
Key facts. Cited by 14 papers in the map (data through 7 Oct 2026). Builds on 19 of its 24 references that are in the map. First posted on arXiv 11 Feb 2025.
Builds on
19 of 24 references.
References · 19
- 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,069
- 2019BERTScore: Evaluating Text Generation with BERTcited by 5,462
- 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 3,972
- 2022A Survey on In-context Learningcited by 717
- 2022Large-scale Contrastive Language-Audio Pretraining with Feature Fusion and Keyword-to-Caption Augmentationcited by 707
- 2024Qwen2-Audio Technical Reportcited by 543
- 2023SALMONN: Towards Generic Hearing Abilities for Large Language Modelscited by 492
- 2023Simple and Controllable Music Generationcited by 480
- 2022BEATs: Audio Pre-Training with Acoustic Tokenizerscited by 378
- 2023WavCaps: A ChatGPT-Assisted Weakly-Labelled Audio Captioning Dataset for Audio-Language Multimodal Researchcited by 266
- 2023MERT: Acoustic Music Understanding Model with Large-Scale Self-supervised Trainingcited by 175
- 2023Noise2Music: Text-conditioned Music Generation with Diffusion Modelscited by 173
7 more
- 2023Mustango: Toward Controllable Text-to-Music Generationcited by 100
- 2023The Song Describer Dataset: a Corpus of Audio Captions for Music-and-Language Evaluationcited by 68
- 2023Video2Music: Suitable Music Generation from Videos using an Affective Multimodal Transformer modelcited by 37
- 2024Missing Modality Prediction for Unpaired Multimodal Learning via Joint Embedding of Unimodal Modelscited by 20
- 2024MidiCaps: A large-scale MIDI dataset with text captionscited by 19
- 2024Text2midi: Generating Symbolic Music from Captionscited by 18
- 2018Deep Content-User Embedding Model for Music Recommendationcited by 1
Built on by
Citing papers per year: 2025: 5; 2026: 9.
14 papers.
Sort:
By area:
- 2026MOVA: Towards Scalable and Synchronized Video-Audio Generationcited by 39
- 2025SonicMaster: Towards Controllable All-in-One Music Restoration and Masteringcited by 6
- 2025Revisiting Audio-language Pretraining for Learning General-purpose Audio Representationcited by 3
- 2025MelodySim: Measuring Melody-aware Music Similarity for Plagiarism Detectioncited by 2
- 2026Decomposing multimodal embedding spaces with group-sparse autoencoderscited by 2
- 2026Rethinking Music Captioning with Music Metadata LLMscited by 2
- 2026Video-Robin: Autoregressive Diffusion Planning for Intent-Grounded Video-to-Music Generationcited by 2
- 2026Unlocking Strong Supervision: A Data-Centric Study of General-Purpose Audio Pre-Training Methodscited by 1
- 2025SonicVerse: Multi-Task Learning for Music Feature-Informed Captioningcited by 0
- 2025Aligning Generative Music AI with Human Preferences: Methods and Challengescited by 0
- 2026Beyond Musical Descriptors: Extracting Preference-Bearing Intent in Music Queriescited by 0
- 2026FIGMA: Towards FIne-Grained Music retrievAlcited by 0
2 more
- 2026TrueMuse: A Benchmark for Data Attribution in Text-to-Music Models30 Sep 2026
- 2026VIBE: Video Instruction-aligned Background music gEneration31 Aug 2026
- 2026FIGMA: Towards FIne-Grained Music retrievAl4 Jun 2026
- 2026Video-Robin: Autoregressive Diffusion Planning for Intent-Grounded Video-to-Music Generation19 Apr 2026
- 2026Unlocking Strong Supervision: A Data-Centric Study of General-Purpose Audio Pre-Training Methods26 Mar 2026
- 2026Beyond Musical Descriptors: Extracting Preference-Bearing Intent in Music Queries11 Feb 2026
- 2026MOVA: Towards Scalable and Synchronized Video-Audio Generation9 Feb 2026
- 2026Rethinking Music Captioning with Music Metadata LLMs3 Feb 2026
- 2026Decomposing multimodal embedding spaces with group-sparse autoencoders27 Jan 2026
- 2025Revisiting Audio-language Pretraining for Learning General-purpose Audio Representation20 Nov 2025
- 2025Aligning Generative Music AI with Human Preferences: Methods and Challenges19 Nov 2025
- 2025SonicMaster: Towards Controllable All-in-One Music Restoration and Mastering5 Aug 2025
2 more
- 2026MOVA: Towards Scalable and Synchronized Video-Audio Generationcited by 39
- 2025SonicMaster: Towards Controllable All-in-One Music Restoration and Masteringcited by 6
- 2025Revisiting Audio-language Pretraining for Learning General-purpose Audio Representationcited by 3
- 2025MelodySim: Measuring Melody-aware Music Similarity for Plagiarism Detectioncited by 2
- 2026Decomposing multimodal embedding spaces with group-sparse autoencoderscited by 2
- 2026Rethinking Music Captioning with Music Metadata LLMscited by 2
- 2026Video-Robin: Autoregressive Diffusion Planning for Intent-Grounded Video-to-Music Generationcited by 2
- 2026Unlocking Strong Supervision: A Data-Centric Study of General-Purpose Audio Pre-Training Methodscited by 1
- 2025SonicVerse: Multi-Task Learning for Music Feature-Informed Captioningcited by 0
- 2026Beyond Musical Descriptors: Extracting Preference-Bearing Intent in Music Queriescited by 0
- 2026FIGMA: Towards FIne-Grained Music retrievAlcited by 0
- 2026TrueMuse: A Benchmark for Data Attribution in Text-to-Music Modelscited by 0
- 2026TrueMuse: A Benchmark for Data Attribution in Text-to-Music Models30 Sep 2026
- 2026FIGMA: Towards FIne-Grained Music retrievAl4 Jun 2026
- 2026Video-Robin: Autoregressive Diffusion Planning for Intent-Grounded Video-to-Music Generation19 Apr 2026
- 2026Unlocking Strong Supervision: A Data-Centric Study of General-Purpose Audio Pre-Training Methods26 Mar 2026
- 2026Beyond Musical Descriptors: Extracting Preference-Bearing Intent in Music Queries11 Feb 2026
- 2026MOVA: Towards Scalable and Synchronized Video-Audio Generation9 Feb 2026
- 2026Rethinking Music Captioning with Music Metadata LLMs3 Feb 2026
- 2026Decomposing multimodal embedding spaces with group-sparse autoencoders27 Jan 2026
- 2025Revisiting Audio-language Pretraining for Learning General-purpose Audio Representation20 Nov 2025
- 2025SonicMaster: Towards Controllable All-in-One Music Restoration and Mastering5 Aug 2025
- 2025SonicVerse: Multi-Task Learning for Music Feature-Informed Captioning18 Jun 2025
- 2025MelodySim: Measuring Melody-aware Music Similarity for Plagiarism Detection27 May 2025