mlsanityData to 14 Oct 2026

DISCO-10M: A Large-Scale Music Dataset

arXiv 2306.13512 ↗First posted 23 Jun 2023cs.SD cs.LG eess.AScited by 13

Not on the map. Why?

Abstract (arXiv)

Music datasets play a crucial role in advancing research in machine learning for music. However, existing music datasets suffer from limited size, accessibility, and lack of audio resources. To address these shortcomings, we present DISCO-10M, a novel and extensive music dataset that surpasses the largest previously available music dataset by an order of magnitude. To ensure high-quality data, we implement a multi-stage filtering process. This process incorporates similarities based on textual descriptions and audio embeddings. Moreover, we provide precomputed CLAP embeddings alongside DISCO-10M, facilitating direct application on various downstream tasks. These embeddings enable efficient exploration of machine learning applications on the provided data. With DISCO-10M, we aim to democratize and facilitate new research to help advance the development of novel machine learning models for music.

Key facts. Cited by 13 papers in the map (data through 14 Oct 2026). Builds on 22 of its 73 references that are in the map. First posted on arXiv 23 Jun 2023.

Builds on

22 of 73 references.

References · 22

  1. 2017Attention Is All You Needcited by 60,361
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  3. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  4. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
  5. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
  6. 2018Representation Learning with Contrastive Predictive Codingcited by 7,777
  7. 2017Inductive Representation Learning on Large Graphscited by 6,320
  8. 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,152
  9. 2020The Pile: An 800GB Dataset of Diverse Text for Language Modelingcited by 2,411
  10. 2015Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networkscited by 2,054
  11. 2021LAION-400M: Open Dataset of CLIP-Filtered 400 Million Image-Text Pairscited by 1,555
  12. 2021SoundStream: An End-to-End Neural Audio Codeccited by 771
10 more
  1. 2022Large-scale Contrastive Language-Audio Pretraining with Feature Fusion and Keyword-to-Caption Augmentationcited by 719
  2. 2022High Fidelity Neural Audio Compressioncited by 687
  3. 2018The Open Images Dataset V4: Unified image classification, object detection, and visual relationship detection at scalecited by 544
  4. 2020Jukebox: A Generative Model for Musiccited by 542
  5. 2023MusicLM: Generating Music From Textcited by 448
  6. 2022AudioGen: Textually Guided Audio Generationcited by 295
  7. 2016FMA: A Dataset For Music Analysiscited by 207
  8. 2023Noise2Music: Text-conditioned Music Generation with Diffusion Modelscited by 173
  9. 2022MuLan: A Joint Embedding of Music Audio and Natural Languagecited by 87
  10. 2013The GTZAN dataset: Its contents, its faults, their effects on evaluation, and its future usecited by 11

Built on by

Cited by year

Citing papers per year: 2024: 6; 2025: 7.

13 papers.

Sort:

By area: