mlsanityData to 7 Oct 2026

Flow-HOA: Generative Joint Optimization for Ambisonics Encoding via Flow Matching

arXiv 2606.04570 ↗First posted 3 Jun 2026cs.SDcited by 0

On the map: Diffusion models → Audio, speech and music

Abstract (arXiv)

Higher-Order Ambisonics (HOA) encoding from sparse, irregular microphone arrays remains a critical challenge for consumer spatial audio capture in immersive communication and XR. We propose Flow-HOA, a generative framework that jointly optimizes a multi-dimensional objective encompassing time-domain, spectral, and spatial fidelity while producing a deployable, time-invariant bank of Finite Impulse Response (FIR) encoding filters. Using conditional flow matching, the model learns to map a simple prior distribution to the target distribution of FIR filter coefficients. Training is guided by a composite loss that balances time-domain waveform fidelity, multi-resolution spectral consistency, sub-band energy preservation, and spatial directivity constraints. Objective evaluations on synthetically simulated data demonstrate improved performance over strong model-based baselines in both signal fidelity and spatial accuracy metrics. Subjective listening tests on real microphone array recordings further confirm that Flow-HOA yields higher overall sound quality with reduced artifacts, demonstrating generalization from synthetic training data to real-world capture conditions.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Audio, speech and music, one of 14 directions in Diffusion models. Builds on 7 of its 25 references that are in the map. First posted on arXiv 3 Jun 2026.

Builds on

7 of 25 references.

References · 7

  1. 2022Flow Matching for Generative Modelingcited by 5,426
  2. 2020HiFi-GAN: Generative Adversarial Networks for Efficient and High Fidelity Speech Synthesiscited by 1,139
  3. 2018SDR - half-baked or well done?cited by 420
  4. 2020FSD50K: An Open Dataset of Human-Labeled Sound Eventscited by 339
  5. 2024Neural Ambisonic Encoding For Multi-Speaker Scenarios Using A Circular Microphone Arraycited by 1
  6. 2025Ambisonics Binaural Rendering via Masked Magnitude Least Squarescited by 1
  7. 2025Ambisonics Encoder for Wearable Array with Improved Binaural Reproductioncited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Ambisonics Encoding of Room Impulse Responses using a Device-Agnostic Diffusion Model
  2. 2026Generative Learning for Ambisonic Upscaling
  3. 2026ImmersiveFlow: Stereo-to-7.1.4 spatial audio generation with flow matching
  4. 2026Geometry-adaptive Ambisonic encoding for sparse microphone arrays of variable topology using physics-informed diffusion ↗
  5. 2024Diff-SAGe: End-to-End Spatial Audio Generation Using Diffusion Models
  6. 2025DiffAU: Diffusion-Based Ambisonics Upscaling
  7. 2026Few-shot Acoustic Synthesis with Multimodal Flow Matching
  8. 2026DynFOA: Generating First-Order Ambisonics with Conditional Diffusion for Dynamic and Acoustically Complex 360-Degree Videos