DISCO-10M: A Large-Scale Music Dataset
Not on the map. Why?
Abstract (arXiv)
Music datasets play a crucial role in advancing research in machine learning for music. However, existing music datasets suffer from limited size, accessibility, and lack of audio resources. To address these shortcomings, we present DISCO-10M, a novel and extensive music dataset that surpasses the largest previously available music dataset by an order of magnitude. To ensure high-quality data, we implement a multi-stage filtering process. This process incorporates similarities based on textual descriptions and audio embeddings. Moreover, we provide precomputed CLAP embeddings alongside DISCO-10M, facilitating direct application on various downstream tasks. These embeddings enable efficient exploration of machine learning applications on the provided data. With DISCO-10M, we aim to democratize and facilitate new research to help advance the development of novel machine learning models for music.
Key facts. Cited by 13 papers in the map (data through 14 Oct 2026). Builds on 22 of its 73 references that are in the map. First posted on arXiv 23 Jun 2023.
Builds on
22 of 73 references.
References · 22
- 2017Attention Is All You Needcited by 60,361
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
- 2018Representation Learning with Contrastive Predictive Codingcited by 7,777
- 2017Inductive Representation Learning on Large Graphscited by 6,320
- 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,152
- 2020The Pile: An 800GB Dataset of Diverse Text for Language Modelingcited by 2,411
- 2015Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networkscited by 2,054
- 2021LAION-400M: Open Dataset of CLIP-Filtered 400 Million Image-Text Pairscited by 1,555
- 2021SoundStream: An End-to-End Neural Audio Codeccited by 771
10 more
- 2022Large-scale Contrastive Language-Audio Pretraining with Feature Fusion and Keyword-to-Caption Augmentationcited by 719
- 2022High Fidelity Neural Audio Compressioncited by 687
- 2018The Open Images Dataset V4: Unified image classification, object detection, and visual relationship detection at scalecited by 544
- 2020Jukebox: A Generative Model for Musiccited by 542
- 2023MusicLM: Generating Music From Textcited by 448
- 2022AudioGen: Textually Guided Audio Generationcited by 295
- 2016FMA: A Dataset For Music Analysiscited by 207
- 2023Noise2Music: Text-conditioned Music Generation with Diffusion Modelscited by 173
- 2022MuLan: A Joint Embedding of Music Audio and Natural Languagecited by 87
- 2013The GTZAN dataset: Its contents, its faults, their effects on evaluation, and its future usecited by 11
Built on by
Citing papers per year: 2024: 6; 2025: 7.
13 papers.
Sort:
By area:
- 2024Foundation Models for Music: A Surveycited by 37
- 2025LeVo: High-Quality Song Generation with Multi-Preference Alignmentcited by 25
- 2024VMAS: Video-to-Music Generation via Semantic Alignment in Web Music Videoscited by 15
- 2025Analyzable Chain-of-Musical-Thought Prompting for High-Fidelity Music Generationcited by 14
- 2024SongCreator: Lyrics-based Universal Song Generationcited by 12
- 2024CLaMP 2: Multimodal Music Information Retrieval Across 101 Languages Using Large Language Modelscited by 12
- 2024Multimodal Music Generation with Explicit Bridges and Retrieval Augmentationcited by 6
- 2025Vision-to-Music Generation: A Surveycited by 4
- 2025Back to Ear: Perceptually Driven High Fidelity Music Reconstructioncited by 4
- 2025Bias beyond Borders: Global Inequalities in AI-Generated Musiccited by 1
- 2024Audio Atlas: Visualizing and Exploring Audio Datasetscited by 0
- 2025SLEEPING-DISCO 9M: A large-scale pre-training dataset for generative music modelingcited by 0
1 more
- 2025Robust Neural Audio Fingerprinting using Music Foundation Models7 Nov 2025
- 2025Bias beyond Borders: Global Inequalities in AI-Generated Music2 Oct 2025
- 2025Back to Ear: Perceptually Driven High Fidelity Music Reconstruction18 Sep 2025
- 2025SLEEPING-DISCO 9M: A large-scale pre-training dataset for generative music modeling17 Jun 2025
- 2025LeVo: High-Quality Song Generation with Multi-Preference Alignment9 Jun 2025
- 2025Vision-to-Music Generation: A Survey27 Mar 2025
- 2025Analyzable Chain-of-Musical-Thought Prompting for High-Fidelity Music Generation25 Mar 2025
- 2024Multimodal Music Generation with Explicit Bridges and Retrieval Augmentation12 Dec 2024
- 2024Audio Atlas: Visualizing and Exploring Audio Datasets30 Nov 2024
- 2024CLaMP 2: Multimodal Music Information Retrieval Across 101 Languages Using Large Language Models17 Oct 2024
- 2024VMAS: Video-to-Music Generation via Semantic Alignment in Web Music Videos11 Sep 2024
- 2024SongCreator: Lyrics-based Universal Song Generation9 Sep 2024
1 more
- 2024Foundation Models for Music: A Survey26 Aug 2024
- 2024Foundation Models for Music: A Surveycited by 37
- 2025Back to Ear: Perceptually Driven High Fidelity Music Reconstructioncited by 4
- 2025Back to Ear: Perceptually Driven High Fidelity Music Reconstruction18 Sep 2025
- 2024Foundation Models for Music: A Survey26 Aug 2024
- 2024VMAS: Video-to-Music Generation via Semantic Alignment in Web Music Videoscited by 15
- 2025Analyzable Chain-of-Musical-Thought Prompting for High-Fidelity Music Generationcited by 14
- 2024SongCreator: Lyrics-based Universal Song Generationcited by 12
- 2024CLaMP 2: Multimodal Music Information Retrieval Across 101 Languages Using Large Language Modelscited by 12
- 2024Multimodal Music Generation with Explicit Bridges and Retrieval Augmentationcited by 6
- 2025Vision-to-Music Generation: A Surveycited by 4
- 2025Bias beyond Borders: Global Inequalities in AI-Generated Musiccited by 1
- 2024Audio Atlas: Visualizing and Exploring Audio Datasetscited by 0
- 2025SLEEPING-DISCO 9M: A large-scale pre-training dataset for generative music modelingcited by 0
- 2025Robust Neural Audio Fingerprinting using Music Foundation Modelscited by 0
- 2025Robust Neural Audio Fingerprinting using Music Foundation Models7 Nov 2025
- 2025Bias beyond Borders: Global Inequalities in AI-Generated Music2 Oct 2025
- 2025SLEEPING-DISCO 9M: A large-scale pre-training dataset for generative music modeling17 Jun 2025
- 2025Vision-to-Music Generation: A Survey27 Mar 2025
- 2025Analyzable Chain-of-Musical-Thought Prompting for High-Fidelity Music Generation25 Mar 2025
- 2024Multimodal Music Generation with Explicit Bridges and Retrieval Augmentation12 Dec 2024
- 2024Audio Atlas: Visualizing and Exploring Audio Datasets30 Nov 2024
- 2024CLaMP 2: Multimodal Music Information Retrieval Across 101 Languages Using Large Language Models17 Oct 2024
- 2024VMAS: Video-to-Music Generation via Semantic Alignment in Web Music Videos11 Sep 2024
- 2024SongCreator: Lyrics-based Universal Song Generation9 Sep 2024