Generative Learning for Ambisonic Upscaling
On the map: Diffusion models → Audio, speech and music
Abstract (arXiv)
Ambisonics Upscaling (AU) aims to enhance the spatial resolution of sound fields by estimating high-order Ambisonics (HOA) components from low-order observations. While deep learning and model-based strategies have been considered for AU, both approaches exhibit significant performance degradation in realistic scenarios, where reverberant sound fields violate the directional sparsity inherent to discriminative mappings. In this work, we address AU as a generative task rather than a deterministic reconstruction, expanding generative modeling to specifically target the recovery of spatial information in reverberant speech. We investigate two dominant continuous-time generative paradigms, adapting both Score-based Generative Model and Flow Matching to these complex acoustic settings. We provide an extensive numerical study comparing our methods against state-of-the-art baselines in various acoustic scenarios. Additionally, we conduct subjective listening tests to evaluate the perceived quality and spatial accuracy of the proposed generative framework across various reverberant scenarios. The studies reveal that Flow Matching consistently outperforms both its discriminative counterparts and Diffusion-based paradigms in all reverberant settings.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Audio, speech and music, one of 14 directions in Diffusion models. Builds on 24 of its 54 references that are in the map. First posted on arXiv 20 Sep 2026.
Builds on
24 of 54 references.
Closest ancestors · 5
Same direction, newest first
- 2026SIRUP: A diffusion-based virtual upmixer of steering vectors for highly-directive spatialization with first-order ambisonics18 Feb
- 2026ImmersiveFlow: Stereo-to-7.1.4 spatial audio generation with flow matching19 Jan
- 2024Diff-SAGe: End-to-End Spatial Audio Generation Using Diffusion Models15 Oct
- 2024Diffusion Models for Audio Restoration15 Feb
- 2022Speech Enhancement and Dereverberation with Diffusion-based Generative Models11 Aug
Other references · 19
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
- 2022Flow Matching for Generative Modelingcited by 5,702
- 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,101
- 2022RePaint: Inpainting using Denoising Diffusion Probabilistic Modelscited by 1,430
- 2022Diffusion Posterior Sampling for General Noisy Inverse Problemscited by 1,416
- 2024A Survey on Diffusion Models for Inverse Problemscited by 180
- 2017Pyroomacoustics: A Python package for audio room simulations and array processing algorithmscited by 132
- 2024Simple ReFlow: Improved Techniques for Fast Flow Modelscited by 34
- 2022Discriminative and Generative Learning for Linear Estimation of Random Signals [Lecture Notes]cited by 14
- 2025Deep Unfolding: Recent Developments, Theory, and Design Guidelinescited by 7
- 2025EDSep: An Effective Diffusion-Based Method for Speech Source Separationcited by 5
- 2024Ambisonics Encoding For Arbitrary Microphone Arrays Incorporating Residual Channels For Binaural Reproductioncited by 4
7 more
- 2024A Physics-Informed Neural Network-Based Approach for the Spatial Upsampling of Spherical Microphone Arrayscited by 2
- 2025Gen-A: Generalizing Ambisonics Neural Encoding to Unseen Microphone Arrayscited by 2
- 2025Ambisonics Super-Resolution Using A Waveform-Domain Neural Networkcited by 2
- 2025DiffAU: Diffusion-Based Ambisonics Upscalingcited by 2
- 2024Ambisonizer: Neural Upmixing as Spherical Harmonics Generationcited by 1
- 2024HARP: A Large-Scale Higher-Order Ambisonic Room Impulse Response Datasetcited by 1
- 2025AI-Aided Annealed Langevin Dynamics for Rapid Optimization of Programmable Channelscited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Flow-HOA: Generative Joint Optimization for Ambisonics Encoding via Flow Matching
- 2026Ambisonics Encoding of Room Impulse Responses using a Device-Agnostic Diffusion Model
- 2024ImmerseDiffusion: A Generative Spatial Audio Latent Diffusion Model
- 2026DynFOA: Generating First-Order Ambisonics with Conditional Diffusion for Dynamic and Acoustically Complex 360-Degree Videos
- 2026DynFOA: Generating First-Order Ambisonics with Conditional Diffusion for Dynamic and Acoustically Complex 360-Degree Videos
- 2025Generating Moving 3D Soundscapes with Latent Diffusion Models
- 2026Few-shot Acoustic Synthesis with Multimodal Flow Matching
- 2025Audio Generation Through Score-Based Generative Modeling: Design Principles and Implementation