Blind Audio Bandwidth Extension: A Diffusion-Based Zero-Shot Approach
Not on the map. Why?
Abstract (arXiv)
Audio bandwidth extension involves the realistic reconstruction of high-frequency spectra from bandlimited observations. In cases where the lowpass degradation is unknown, such as in restoring historical audio recordings, this becomes a blind problem. This paper introduces a novel method called BABE (Blind Audio Bandwidth Extension) that addresses the blind problem in a zero-shot setting, leveraging the generative priors of a pre-trained unconditional diffusion model. During the inference process, BABE utilizes a generalized version of diffusion posterior sampling, where the degradation operator is unknown but parametrized and inferred iteratively. The performance of the proposed method is evaluated using objective and subjective metrics, and the results show that BABE surpasses state-of-the-art blind bandwidth extension baselines and achieves competitive performance compared to informed methods when tested with synthetic data. Moreover, BABE exhibits robust generalization capabilities when enhancing real historical recordings, effectively reconstructing the missing high-frequency content while maintaining coherence with the original recording. Subjective preference tests confirm that BABE significantly improves the audio quality of historical music recordings. Examples of historical recordings restored with the proposed method are available on the companion webpage: (http://research.spa.aalto.fi/publications/papers/ieee-taslp-babe/)
Key facts. Cited by 21 papers in the map (data through 7 Oct 2026). Builds on 45 of its 84 references that are in the map. First posted on arXiv 2 Jun 2023.
Builds on
45 of 84 references.
References · 45
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
- 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,067
- 2022Elucidating the Design Space of Diffusion-Based Generative Modelscited by 2,994
- 2022Video Diffusion Modelscited by 2,280
- 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,903
- 2022Diffusion Posterior Sampling for General Noisy Inverse Problemscited by 1,375
- 2022Denoising Diffusion Restoration Modelscited by 951
- 2021ILVR: Conditioning Method for Denoising Diffusion Probabilistic Modelscited by 634
- 2023AudioLDM: Text-to-Audio Generation with Latent Diffusion Modelscited by 592
- 2019PANNs: Large-Scale Pretrained Audio Neural Networks for Audio Pattern Recognitioncited by 563
- 2021Come-Closer-Diffuse-Faster: Accelerating Conditional Diffusion Models for Inverse Problems through Stochastic Contractioncited by 306
33 more
- 2022Perception Prioritized Training of Diffusion Modelscited by 301
- 2023Understanding Diffusion Objectives as the ELBO with Simple Data Augmentationcited by 293
- 2023A Variational Perspective on Solving Inverse Problems with Diffusion Modelscited by 217
- 2018Enabling Factorized Piano Music Modeling and Generation with the MAESTRO Datasetcited by 215
- 2022Speech Enhancement and Dereverberation with Diffusion-based Generative Modelscited by 195
- 2023Noise2Music: Text-conditioned Music Generation with Diffusion Modelscited by 173
- 2022Generative Modelling With Inverse Heat Dissipationcited by 164
- 2013Generalized Denoising Auto-Encoders as Generative Modelscited by 113
- 2022Parallel Diffusion Models of Operator and Image for Blind Inverse Problemscited by 113
- 2022StoRM: A Diffusion-based Stochastic Regeneration Model for Speech Enhancement and Dereverberationcited by 105
- 2023Mousai: Text-to-Music Generation with Long-Context Latent Diffusioncited by 77
- 2022Universal Speech Enhancement with Score-based Diffusioncited by 75
- 2022Solving Audio Inverse Problems with a Diffusion Modelcited by 62
- 2023GibbsDDRM: A Partially Collapsed Gibbs Sampler for Solving Blind Inverse Problems with Denoising Diffusion Restorationcited by 58
- 2021VoiceFixer: Toward General Speech Restoration with Neural Vocodercited by 50
- 2022HiFi++: a Unified Framework for Bandwidth Extension and Speech Enhancementcited by 49
- 2023Denoising Diffusion Probabilistic Models for Robust Image Super-Resolution in the Wildcited by 46
- 2022Neural Vocoder is All You Need for Speech Super-resolutioncited by 37
- 2022NU-Wave 2: A General Neural Audio Upsampling Model for Various Sampling Ratescited by 36
- 2022Analysing Diffusion-based Generative Approaches versus Discriminative Approaches for Speech Restorationcited by 34
- 2022Full-band General Audio Synthesis with Score-based Diffusioncited by 32
- 2021MIDI-DDSP: Detailed Control of Musical Performance via Hierarchical Modelingcited by 31
- 2022Cold Diffusion for Speech Enhancementcited by 31
- 2020Real-time Speech Frequency Bandwidth Extensioncited by 22
- 2022Conditioning and Sampling in Variational Diffusion Models for Speech Super-Resolutioncited by 20
- 2021WSRGlow: A Glow-based Waveform Generative Model for Audio Super-Resolutioncited by 19
- 2022A Two-Stage U-Net for High-Fidelity Denoising of Historical Recordingscited by 17
- 2022AERO: Audio Super Resolution in the Spectral Domaincited by 17
- 2022BEHM-GAN: Bandwidth Extension of Historical Music using Generative Adversarial Networkscited by 13
- 2023Diffusion-Based Audio Inpaintingcited by 13
- 2020On Filter Generalization for Music Bandwidth Extension Using Deep Neural Networkscited by 10
- 2022The Chamber Ensemble Generator: Limitless High-Quality MIR Data via Generative Modelingcited by 10
- 2019Speech bandwidth extension with WaveNetcited by 3
Built on by
Citing papers per year: 2024: 8; 2025: 10; 2026: 3.
21 papers.
Sort:
By area:
- 2024A Survey on Diffusion Models for Inverse Problemscited by 173
- 2024Diffusion Models for Audio Restorationcited by 32
- 2025Audio Super-Resolution with Latent Bridge Modelscited by 13
- 2024A Diffusion-Based Generative Equalizer for Music Restorationcited by 12
- 2024Unsupervised Blind Joint Dereverberation and Room Acoustics Estimation with Diffusion Modelscited by 11
- 2024BUDDy: Single-Channel Blind Unsupervised Dereverberation with Diffusion Modelscited by 9
- 2025ArrayDPS: Unsupervised Blind Speech Separation with a Diffusion Priorcited by 7
- 2025SonicMaster: Towards Controllable All-in-One Music Restoration and Masteringcited by 6
- 2025Learning to Upsample and Upmix Audio in the Latent Domaincited by 5
- 2025Unsupervised Estimation of Nonlinear Audio Effects: Comparing Diffusion-Based and Adversarial approachescited by 4
- 2024HRTF Estimation using a Score-based Priorcited by 3
- 2024Audio Decoding by Inverse Problem Solvingcited by 1
9 more
- 2024Improving Music Source Separation with Diffusion and Consistency Refinementcited by 1
- 2025Audio Generation Through Score-Based Generative Modeling: Design Principles and Implementationcited by 1
- 2025Diffusion-Based Unsupervised Audio-Visual Speech Separation in Noisy Environments with Noise Priorcited by 1
- 2025SUBARU: A Practical Approach to Power Saving in Hearables Using SUB-Nyquist Audio Resolution Upsamplingcited by 0
- 2025Unsupervised Multi-channel Speech Dereverberation via Diffusioncited by 0
- 2025Twenty-Five Years of MIR Research: Achievements, Practices, Evaluations, and Future Challengescited by 0
- 2026SSNAPS: Audio-Visual Separation of Speech and Background Noise with Diffusion Inverse Samplingcited by 0
- 2026On the Geometry of Music Bandwidth Extension in Latent Spaces of Audio Codecscited by 0
- 2026End-to-End Historical Music Restoration in Latent Spacecited by 0
- 2026End-to-End Historical Music Restoration in Latent Space30 Sep 2026
- 2026On the Geometry of Music Bandwidth Extension in Latent Spaces of Audio Codecs4 Aug 2026
- 2026SSNAPS: Audio-Visual Separation of Speech and Background Noise with Diffusion Inverse Sampling1 Feb 2026
- 2025Twenty-Five Years of MIR Research: Achievements, Practices, Evaluations, and Future Challenges10 Nov 2025
- 2025Audio Super-Resolution with Latent Bridge Models22 Sep 2025
- 2025Diffusion-Based Unsupervised Audio-Visual Speech Separation in Noisy Environments with Noise Prior17 Sep 2025
- 2025SonicMaster: Towards Controllable All-in-One Music Restoration and Mastering5 Aug 2025
- 2025Unsupervised Multi-channel Speech Dereverberation via Diffusion4 Aug 2025
- 2025SUBARU: A Practical Approach to Power Saving in Hearables Using SUB-Nyquist Audio Resolution Upsampling27 Jun 2025
- 2025Audio Generation Through Score-Based Generative Modeling: Design Principles and Implementation10 Jun 2025
- 2025Learning to Upsample and Upmix Audio in the Latent Domain31 May 2025
- 2025ArrayDPS: Unsupervised Blind Speech Separation with a Diffusion Prior8 May 2025
9 more
- 2025Unsupervised Estimation of Nonlinear Audio Effects: Comparing Diffusion-Based and Adversarial approaches7 Apr 2025
- 2024Improving Music Source Separation with Diffusion and Consistency Refinement9 Dec 2024
- 2024HRTF Estimation using a Score-based Prior2 Oct 2024
- 2024A Survey on Diffusion Models for Inverse Problems30 Sep 2024
- 2024Audio Decoding by Inverse Problem Solving12 Sep 2024
- 2024Unsupervised Blind Joint Dereverberation and Room Acoustics Estimation with Diffusion Models14 Aug 2024
- 2024BUDDy: Single-Channel Blind Unsupervised Dereverberation with Diffusion Models7 May 2024
- 2024A Diffusion-Based Generative Equalizer for Music Restoration27 Mar 2024
- 2024Diffusion Models for Audio Restoration15 Feb 2024
- 2024A Survey on Diffusion Models for Inverse Problemscited by 173
- 2024Diffusion Models for Audio Restorationcited by 32
- 2024A Diffusion-Based Generative Equalizer for Music Restorationcited by 12
- 2024Unsupervised Blind Joint Dereverberation and Room Acoustics Estimation with Diffusion Modelscited by 11
- 2024BUDDy: Single-Channel Blind Unsupervised Dereverberation with Diffusion Modelscited by 9
- 2025ArrayDPS: Unsupervised Blind Speech Separation with a Diffusion Priorcited by 7
- 2025Learning to Upsample and Upmix Audio in the Latent Domaincited by 5
- 2025Unsupervised Estimation of Nonlinear Audio Effects: Comparing Diffusion-Based and Adversarial approachescited by 4
- 2024HRTF Estimation using a Score-based Priorcited by 3
- 2024Improving Music Source Separation with Diffusion and Consistency Refinementcited by 1
- 2025Audio Generation Through Score-Based Generative Modeling: Design Principles and Implementationcited by 1
- 2025Unsupervised Multi-channel Speech Dereverberation via Diffusioncited by 0
12 most cited of 13 All 13 (JSON)
- 2026On the Geometry of Music Bandwidth Extension in Latent Spaces of Audio Codecs4 Aug 2026
- 2025Unsupervised Multi-channel Speech Dereverberation via Diffusion4 Aug 2025
- 2025Audio Generation Through Score-Based Generative Modeling: Design Principles and Implementation10 Jun 2025
- 2025Learning to Upsample and Upmix Audio in the Latent Domain31 May 2025
- 2025ArrayDPS: Unsupervised Blind Speech Separation with a Diffusion Prior8 May 2025
- 2025Unsupervised Estimation of Nonlinear Audio Effects: Comparing Diffusion-Based and Adversarial approaches7 Apr 2025
- 2024Improving Music Source Separation with Diffusion and Consistency Refinement9 Dec 2024
- 2024HRTF Estimation using a Score-based Prior2 Oct 2024
- 2024A Survey on Diffusion Models for Inverse Problems30 Sep 2024
- 2024Unsupervised Blind Joint Dereverberation and Room Acoustics Estimation with Diffusion Models14 Aug 2024
- 2024BUDDy: Single-Channel Blind Unsupervised Dereverberation with Diffusion Models7 May 2024
- 2024A Diffusion-Based Generative Equalizer for Music Restoration27 Mar 2024
12 newest of 13 All 13 (JSON)
- 2025Audio Super-Resolution with Latent Bridge Modelscited by 13
- 2025SonicMaster: Towards Controllable All-in-One Music Restoration and Masteringcited by 6
- 2024Audio Decoding by Inverse Problem Solvingcited by 1
- 2025Diffusion-Based Unsupervised Audio-Visual Speech Separation in Noisy Environments with Noise Priorcited by 1
- 2025SUBARU: A Practical Approach to Power Saving in Hearables Using SUB-Nyquist Audio Resolution Upsamplingcited by 0
- 2025Twenty-Five Years of MIR Research: Achievements, Practices, Evaluations, and Future Challengescited by 0
- 2026SSNAPS: Audio-Visual Separation of Speech and Background Noise with Diffusion Inverse Samplingcited by 0
- 2026End-to-End Historical Music Restoration in Latent Spacecited by 0
- 2026End-to-End Historical Music Restoration in Latent Space30 Sep 2026
- 2026SSNAPS: Audio-Visual Separation of Speech and Background Noise with Diffusion Inverse Sampling1 Feb 2026
- 2025Twenty-Five Years of MIR Research: Achievements, Practices, Evaluations, and Future Challenges10 Nov 2025
- 2025Audio Super-Resolution with Latent Bridge Models22 Sep 2025
- 2025Diffusion-Based Unsupervised Audio-Visual Speech Separation in Noisy Environments with Noise Prior17 Sep 2025
- 2025SonicMaster: Towards Controllable All-in-One Music Restoration and Mastering5 Aug 2025
- 2025SUBARU: A Practical Approach to Power Saving in Hearables Using SUB-Nyquist Audio Resolution Upsampling27 Jun 2025
- 2024Audio Decoding by Inverse Problem Solving12 Sep 2024
Similar, not cited
Close in wording, no citation either way
- 2026Single-step Controllable Music Bandwidth Extension With Flow Matching
- 2026A Survey of Advancing Audio Super-Resolution and Bandwidth Extension from Discriminative to Generative Models
- 2025Estimation and Restoration of Unknown Nonlinear Distortion using Diffusion
- 2023Zero-Shot Duet Singing Voices Separation with Diffusion Models
- 2023VRDMG: Vocal Restoration via Diffusion Posterior Sampling with Multiple Guidance
- 2025Estimating Musical Surprisal from Audio in Autoregressive Diffusion Model Noise Spaces
- 2025Token-Based Audio Inpainting via Discrete Diffusion
- 2026FastWave: Optimized Diffusion Model for Audio Super-Resolution