mlsanityData to 7 Oct 2026

One Billion Audio Sounds from GPU-enabled Modular Synthesis

arXiv 2104.12922 ↗First posted 27 Apr 2021cs.SD cs.AI cs.LGcited by 11

Not on the map. Why?

Abstract (arXiv)

We release synth1B1, a multi-modal audio corpus consisting of 1 billion 4-second synthesized sounds, paired with the synthesis parameters used to generate them. The dataset is 100x larger than any audio dataset in the literature. We also introduce torchsynth, an open source modular synthesizer that generates the synth1B1 samples on-the-fly at 16200x faster than real-time (714MHz) on a single GPU. Finally, we release two new audio datasets: FM synth timbre and subtractive synth pitch. Using these datasets, we demonstrate new rank-based evaluation criteria for existing audio representations. Finally, we propose a novel approach to synthesizer hyperparameter optimization.

Key facts. Cited by 11 papers in the map (data through 7 Oct 2026). Builds on 24 of its 41 references that are in the map. First posted on arXiv 27 Apr 2021.

Builds on

24 of 41 references.

References · 24

  1. 2020Language Models are Few-Shot Learnerscited by 32,199
  2. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
  3. 2019Optuna: A Next-generation Hyperparameter Optimization Frameworkcited by 2,455
  4. 2017Domain Randomization for Transferring Deep Neural Networks from Simulation to the Real Worldcited by 1,401
  5. 2020Jukebox: A Generative Model for Musiccited by 535
  6. 2019Libri-Light: A Benchmark for ASR with Limited or No Supervisioncited by 462
  7. 2020FSD50K: An Open Dataset of Human-Labeled Sound Eventscited by 339
  8. 2019Parallel WaveGAN: A fast waveform generation model based on generative adversarial networks with multi-resolution spectrogramcited by 337
  9. 2017Neural Audio Synthesis of Musical Notes with WaveNet Autoencoderscited by 222
  10. 2018Enabling Factorized Piano Music Modeling and Generation with the MAESTRO Datasetcited by 215
  11. 2020DDSP: Differentiable Digital Signal Processingcited by 177
  12. 2020Contrastive Learning of General-Purpose Audio Representationscited by 168
12 more
  1. 2013A Theoretical Analysis of NDCG Type Ranking Measurescited by 119
  2. 2021BYOL for Audio: Self-Supervised Learning for General-Purpose Audio Representationcited by 106
  3. 2019Neural source-filter waveform models for statistical parametric speech synthesiscited by 46
  4. 2019How Large Are Lions? Inducing Distributions over Quantitative Attributescited by 26
  5. 2020A Differentiable Perceptual Audio Metric Learned from Just Noticeable Differencescited by 22
  6. 2020I'm Sorry for Your Loss: Spectrally-Based Audio Distances Are Bad at Pitchcited by 17
  7. 2019Universal audio synthesizer control with normalizing flowscited by 16
  8. 2020COALA: Co-Aligned Autoencoders for Learning Semantically Enriched Audio Representationscited by 13
  9. 2019Neural Percussive Synthesis Parameterised by High-Level Timbral Featurescited by 8
  10. 2020Neural Granular Sound Synthesiscited by 4
  11. 2020Introducing Latent Timbre Synthesiscited by 2
  12. 2020Timbre Space Representation of a Subtractive Synthesizercited by 1

Built on by

Cited by year

Citing papers per year: 2021: 1; 2022: 3; 2023: 0; 2024: 4; 2025: 3.

11 papers.

  1. 2022Masked Modeling Duo: Learning Representations by Encouraging Both Networks to Model the Inputcited by 23
  2. 2024Differentiable All-pole Filters for Time-varying Audio Systemscited by 7
  3. 2022TimbreCLIP: Connecting Timbre to Text and Imagescited by 5
  4. 2021Neural Synthesis of Footsteps Sound Effects with Generative Adversarial Networkscited by 4
  5. 2024Investigating Design Choices in Joint-Embedding Predictive Architectures for General Audio Representation Learningcited by 4
  6. 2024Creative Text-to-Audio Generation via Synthesizer Programmingcited by 4
  7. 2024Contrastive Learning from Synthetic Audio Doppelg"angerscited by 1
  8. 2025Modulation Discovery with Differentiable Digital Signal Processingcited by 1
  9. 2022Learning Audio Representations with MLPscited by 0
  10. 2025Neural Proxies for Sound Synthesizers: Learning Perceptually Informed Preset Representationscited by 0
  11. 2025AaSP: Aliasing-aware Self-Supervised Pre-Training for Audio Spectrogram Transformerscited by 0