Sound2Synth: Interpreting Sound via FM Synthesizer Parameters Estimation
Not on the map. Why?
Abstract (arXiv)
Synthesizer is a type of electronic musical instrument that is now widely used in modern music production and sound design. Each parameters configuration of a synthesizer produces a unique timbre and can be viewed as a unique instrument. The problem of estimating a set of parameters configuration that best restore a sound timbre is an important yet complicated problem, i.e.: the synthesizer parameters estimation problem. We proposed a multi-modal deep-learning-based pipeline Sound2Synth, together with a network structure Prime-Dilated Convolution (PDC) specially designed to solve this problem. Our method achieved not only SOTA but also the first real-world applicable results on Dexed synthesizer, a popular FM synthesizer.
Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). Builds on 6 of its 27 references that are in the map. First posted on arXiv 6 May 2022.
Builds on
6 of 27 references.
References · 6
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
- 2016Densely Connected Convolutional Networkscited by 6,691
- 2020DDSP: Differentiable Digital Signal Processingcited by 177
- 2019Universal audio synthesizer control with normalizing flowscited by 16
- 2021SerumRNN: Step by Step Audio VST Effect Programmingcited by 3
Built on by
Citing papers per year: 2022: 2; 2023: 1; 2024: 0; 2025: 2; 2026: 2.
7 papers.
- 2022DDX7: Differentiable FM Synthesis of Musical Instrument Soundscited by 13
- 2022Synthesizer Preset Interpolation using Transformer Auto-Encoderscited by 3
- 2025Modulation Discovery with Differentiable Digital Signal Processingcited by 1
- 2023NAS-FM: Neural Architecture Search for Tunable and Interpretable Sound Synthesis based on Frequency Modulationcited by 0
- 2025Neural Proxies for Sound Synthesizers: Learning Perceptually Informed Preset Representationscited by 0
- 2026DDSynth-RL: Audio Synthesizer Inversion via Discrete Diffusion with Reinforcement Learningcited by 0
- 2026Off-manifold robustness in synthesizer inversion with joint distribution flow matchingcited by 0
- 2026Off-manifold robustness in synthesizer inversion with joint distribution flow matching24 Sep 2026
- 2026DDSynth-RL: Audio Synthesizer Inversion via Discrete Diffusion with Reinforcement Learning4 Aug 2026
- 2025Modulation Discovery with Differentiable Digital Signal Processing7 Oct 2025
- 2025Neural Proxies for Sound Synthesizers: Learning Perceptually Informed Preset Representations9 Sep 2025
- 2023NAS-FM: Neural Architecture Search for Tunable and Interpretable Sound Synthesis based on Frequency Modulation22 May 2023
- 2022Synthesizer Preset Interpolation using Transformer Auto-Encoders27 Oct 2022
- 2022DDX7: Differentiable FM Synthesis of Musical Instrument Sounds12 Aug 2022