mlsanityData to 14 Oct 2026

DiffMoog: a Differentiable Modular Synthesizer for Sound Matching

arXiv 2401.12570 ↗First posted 23 Jan 2024eess.AS cs.AI cs.SDcited by 7

Not on the map. Why?

Abstract (arXiv)

This paper presents DiffMoog - a differentiable modular synthesizer with a comprehensive set of modules typically found in commercial instruments. Being differentiable, it allows integration into neural networks, enabling automated sound matching, to replicate a given audio input. Notably, DiffMoog facilitates modulation capabilities (FM/AM), low-frequency oscillators (LFOs), filters, envelope shapers, and the ability for users to create custom signal chains. We introduce an open-source platform that comprises DiffMoog and an end-to-end sound matching framework. This framework utilizes a novel signal-chain loss and an encoder network that self-programs its outputs to predict DiffMoogs parameters based on the user-defined modular architecture. Moreover, we provide insights and lessons learned towards sound matching using differentiable synthesis. Combining robust sound capabilities with a holistic platform, DiffMoog stands as a premier asset for expediting research in audio synthesis and machine learning.

Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Builds on 18 of its 30 references that are in the map. First posted on arXiv 23 Jan 2024.

Builds on

18 of 30 references.

References · 18

  1. 2016Categorical Reparameterization with Gumbel-Softmaxcited by 2,739
  2. 2020DiffWave: A Versatile Diffusion Model for Audio Synthesiscited by 1,354
  3. 2017Neural Audio Synthesis of Musical Notes with WaveNet Autoencoderscited by 225
  4. 2020DDSP: Differentiable Digital Signal Processingcited by 178
  5. 2023Noise2Music: Text-conditioned Music Generation with Diffusion Modelscited by 173
  6. 2019GANSynth: Adversarial Neural Audio Synthesiscited by 116
  7. 2018CREPE: A Convolutional Representation for Pitch Estimationcited by 110
  8. 2021RAVE: A variational autoencoder for fast and high-quality neural audio synthesiscited by 73
  9. 2020Automatic multitrack mixing with a differentiable mixing console of neural audio effectscited by 27
  10. 2018SING: Symbol-to-Instrument Neural Generatorcited by 23
  11. 2022Style Transfer of Audio Effects with Differentiable Signal Processingcited by 18
  12. 2019Universal audio synthesizer control with normalizing flowscited by 17
6 more
  1. 2020I'm Sorry for Your Loss: Spectrally-Based Audio Distances Are Bad at Pitchcited by 17
  2. 2019WGANSing: A Multi-Voice Singing Voice Synthesizer Based on the Wasserstein-GANcited by 13
  3. 2022DDX7: Differentiable FM Synthesis of Musical Instrument Soundscited by 13
  4. 2018InverSynth: Deep Estimation of Synthesizer Parameter Configurations from Audio Signalscited by 11
  5. 2021Differentiable Signal Processing With Black-Box Audio Effectscited by 10
  6. 2021Differentiable Wavetable Synthesiscited by 4

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 1; 2025: 4; 2026: 2.

7 papers.

  1. 2025Audio synthesizer inversion in symmetric parameter spaces with approximately equivariant flow matchingcited by 6
  2. 2024Synthesizer Sound Matching Using Audio Spectrogram Transformerscited by 4
  3. 2025Modulation Discovery with Differentiable Digital Signal Processingcited by 1
  4. 2025WildFX: A DAW-Powered Pipeline for In-the-Wild Audio FX Graph Modelingcited by 0
  5. 2025Neural Proxies for Sound Synthesizers: Learning Perceptually Informed Preset Representationscited by 0
  6. 2026DDSynth-RL: Audio Synthesizer Inversion via Discrete Diffusion with Reinforcement Learningcited by 0
  7. 2026Evaluating Loss Functions in Differentiable Out-of-Domain Sound-Matching with Partial Parameter Distancecited by 0