Unsupervised Estimation of Nonlinear Audio Effects: Comparing Diffusion-Based and Adversarial approaches
On the map: Diffusion models → Audio, speech and music
Abstract (arXiv)
Accurately estimating nonlinear audio effects without access to paired input-output signals remains a challenging problem. This work studies unsupervised probabilistic approaches for solving this task. We introduce a method, novel for this application, based on diffusion generative models for blind system identification, enabling the estimation of unknown nonlinear effects using black- and gray-box models. This study compares this method with a previously proposed adversarial approach, analyzing the performance of both methods under different parameterizations of the effect operator and varying lengths of available effected recordings. Through experiments on guitar distortion effects, we show that the diffusion-based approach provides more stable results and is less sensitive to data availability, while the adversarial approach is superior at estimating more pronounced distortion effects. Our findings contribute to the robust unsupervised blind estimation of audio effects, demonstrating the potential of diffusion models for system identification in music technology.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Placed in Audio, speech and music, one of 14 directions in Diffusion models. Builds on 34 of its 49 references that are in the map. First posted on arXiv 7 Apr 2025.
Builds on
34 of 49 references.
Closest ancestors · 7
Same direction, newest first
- 2024Unsupervised Blind Joint Dereverberation and Room Acoustics Estimation with Diffusion Models14 Aug
- 2024BUDDy: Single-Channel Blind Unsupervised Dereverberation with Diffusion Models7 May
- 2024A Diffusion-Based Generative Equalizer for Music Restoration27 Mar
- 2024Diffusion Models for Audio Restoration15 Feb
- 2023Unsupervised speech enhancement with diffusion-based generative models19 Sep
- 2023AudioLDM: Text-to-Audio Generation with Latent Diffusion Models29 Jan
- 2022Solving Audio Inverse Problems with a Diffusion Model27 Oct
Other references · 27
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
- 2022Elucidating the Design Space of Diffusion-Based Generative Modelscited by 2,994
- 2021Efficiently Modeling Long Sequences with Structured State Spacescited by 2,424
- 2017Improved Training of Wasserstein GANscited by 2,223
- 2022Diffusion Posterior Sampling for General Noisy Inverse Problemscited by 1,375
- 2017Geometric GANcited by 232
- 2024Stable Audio Opencited by 192
- 2023Fast Diffusion EM: a diffusion model for blind inverse problems with application to deconvolutioncited by 36
- 2023Blind Audio Bandwidth Extension: A Diffusion-Based Zero-Shot Approachcited by 21
- 2018Deep Learning for Tube Amplifier Emulationcited by 18
- 2022Style Transfer of Audio Effects with Differentiable Signal Processingcited by 18
- 2022Music Mixing Style Transfer: A Contrastive Learning Approach to Disentangle Audio Effectscited by 18
15 more
- 2021Lightweight and interpretable neural modeling of an audio distortion effect using hyperconditioned differentiable biquadscited by 10
- 2022towards automatic transcription of polyphonic electric guitar music:a new dataset and a multi-loss transformer modelcited by 9
- 2023General Purpose Audio Effect Removalcited by 7
- 2024ST-ITO: Controlling Audio Effects for Style Transfer with Inference-Time Optimizationcited by 7
- 2025Differentiable Black-box and Gray-box Modeling of Nonlinear Audio Effectscited by 6
- 2022Adversarial Guitar Amplifier Modelling With Unpaired Datacited by 5
- 2023Blind Estimation of Audio Processing Graphcited by 5
- 2023Blind estimation of audio effects using an auto-encoder approach and differentiable digital signal processingcited by 5
- 2024Towards zero-shot amplifier modeling: One-to-many amplifier modeling via tone embedding controlcited by 4
- 2024Comparative Study of State-based Neural Networks for Virtual Analog Audio Effects Modelingcited by 3
- 2024Open-Amp: Synthetic Data Framework for Audio Effect Foundation Modelscited by 3
- 2024Modeling Analog Dynamic Range Compressors using Deep Learning and State-space Modelscited by 2
- 2024Improving Unsupervised Clean-to-Rendered Guitar Tone Transformation Using GANs and Integrated Unaligned Clean Datacited by 2
- 2025Estimation and Restoration of Unknown Nonlinear Distortion using Diffusioncited by 2
- 2025NablAFx: A Framework for Differentiable Black-box and Gray-box Modeling of Audio Effectscited by 2
Built on by
Citing papers per year: 2025: 2; 2026: 2.
4 papers.
- 2025ArrayDPS: Unsupervised Blind Speech Separation with a Diffusion Priorcited by 7
- 2025Unsupervised Multi-channel Speech Dereverberation via Diffusioncited by 0
- 2026Music Restoration via Latent Operator Optimization and Diffusion Model Priorscited by 0
- 2026End-to-End Historical Music Restoration in Latent Spacecited by 0
- 2026End-to-End Historical Music Restoration in Latent Space30 Sep 2026
- 2026Music Restoration via Latent Operator Optimization and Diffusion Model Priors3 Aug 2026
- 2025Unsupervised Multi-channel Speech Dereverberation via Diffusion4 Aug 2025
- 2025ArrayDPS: Unsupervised Blind Speech Separation with a Diffusion Prior8 May 2025
Similar, not cited
Close in wording, no citation either way
- 2025Estimating Musical Surprisal from Audio in Autoregressive Diffusion Model Noise Spaces
- 2023Deep Generative Models of Music Expectation
- 2026Diff-VS: Efficient Audio-Aware Diffusion U-Net for Vocals Separation
- 2022Unsupervised vocal dereverberation with diffusion-based generative models
- 2023Timbre transfer using image-to-image denoising diffusion implicit models
- 2026Membership Inference Attack Against Music Diffusion Models via Generative Manifold Perturbation
- 2024Unsupervised Composable Representations for Audio
- 2023Defending against Adversarial Audio via Diffusion Model