Flow-HOA: Generative Joint Optimization for Ambisonics Encoding via Flow Matching
On the map: Diffusion models → Audio, speech and music
Abstract (arXiv)
Higher-Order Ambisonics (HOA) encoding from sparse, irregular microphone arrays remains a critical challenge for consumer spatial audio capture in immersive communication and XR. We propose Flow-HOA, a generative framework that jointly optimizes a multi-dimensional objective encompassing time-domain, spectral, and spatial fidelity while producing a deployable, time-invariant bank of Finite Impulse Response (FIR) encoding filters. Using conditional flow matching, the model learns to map a simple prior distribution to the target distribution of FIR filter coefficients. Training is guided by a composite loss that balances time-domain waveform fidelity, multi-resolution spectral consistency, sub-band energy preservation, and spatial directivity constraints. Objective evaluations on synthetically simulated data demonstrate improved performance over strong model-based baselines in both signal fidelity and spatial accuracy metrics. Subjective listening tests on real microphone array recordings further confirm that Flow-HOA yields higher overall sound quality with reduced artifacts, demonstrating generalization from synthetic training data to real-world capture conditions.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Audio, speech and music, one of 14 directions in Diffusion models. Builds on 7 of its 25 references that are in the map. First posted on arXiv 3 Jun 2026.
Builds on
7 of 25 references.
References · 7
- 2022Flow Matching for Generative Modelingcited by 5,426
- 2020HiFi-GAN: Generative Adversarial Networks for Efficient and High Fidelity Speech Synthesiscited by 1,139
- 2018SDR - half-baked or well done?cited by 420
- 2020FSD50K: An Open Dataset of Human-Labeled Sound Eventscited by 339
- 2024Neural Ambisonic Encoding For Multi-Speaker Scenarios Using A Circular Microphone Arraycited by 1
- 2025Ambisonics Binaural Rendering via Masked Magnitude Least Squarescited by 1
- 2025Ambisonics Encoder for Wearable Array with Improved Binaural Reproductioncited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Ambisonics Encoding of Room Impulse Responses using a Device-Agnostic Diffusion Model
- 2026Generative Learning for Ambisonic Upscaling
- 2026ImmersiveFlow: Stereo-to-7.1.4 spatial audio generation with flow matching
- 2026Geometry-adaptive Ambisonic encoding for sparse microphone arrays of variable topology using physics-informed diffusion ↗
- 2024Diff-SAGe: End-to-End Spatial Audio Generation Using Diffusion Models
- 2025DiffAU: Diffusion-Based Ambisonics Upscaling
- 2026Few-shot Acoustic Synthesis with Multimodal Flow Matching
- 2026DynFOA: Generating First-Order Ambisonics with Conditional Diffusion for Dynamic and Acoustically Complex 360-Degree Videos