ImmersiveFlow: Stereo-to-7.1.4 spatial audio generation with flow matching
On the map: Diffusion models → Audio, speech and music
Abstract (arXiv)
Immersive spatial audio has become increasingly critical for applications ranging from AR/VR to home entertainment and automotive sound systems. However, existing generative methods remain constrained to low-dimensional formats such as binaural audio and First-Order Ambisonics (FOA). Binaural rendering is inherently limited to headphone playback, while FOA suffers from spatial aliasing and insufficient resolution for high-frequency. To overcome these limitations, we introduce ImmersiveFlow, the first end-to-end generative framework that directly synthesizes discrete 7.1.4 format spatial audio from stereo input. ImmersiveFlow leverages Flow Matching to learn trajectories from stereo inputs to multichannel spatial features within a pretrained VAE latent space. At inference, the Flow Matching model predicted latent features are decoded by the VAE and converted into the final 7.1.4 waveform. Comprehensive objective and subjective evaluations demonstrate that our method produces perceptually rich sound fields and enhanced spatial impression, significantly outperforming traditional upmixing techniques.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Audio, speech and music, one of 14 directions in Diffusion models. Builds on 23 of its 36 references that are in the map. First posted on arXiv 19 Jan 2026.
Builds on
23 of 36 references.
Closest ancestors · 7
Same direction, newest first
- 2025Flow2GAN: Hybrid Flow Matching and GAN with Multi-Resolution Network for Few-step High-Fidelity Audio Generation29 Dec
- 2025FlowSE: Efficient and High-Quality Speech Enhancement via Flow Matching26 May
- 2025FLowHigh: Towards Efficient and High-Quality Audio Super-Resolution with Single-Step Flow Matching9 Jan
- 2024Diff-SAGe: End-to-End Spatial Audio Generation Using Diffusion Models15 Oct
- 2024Both Ears Wide Open: Towards Language-Driven Spatial Audio Generation14 Oct
- 2024FlowSep: Language-Queried Sound Separation with Rectified Flow Matching11 Sep
- 2023AudioLDM 2: Learning Holistic Audio Generation with Self-supervised Pretraining10 Aug
Other references · 16
- 2022Scalable Diffusion Models with Transformerscited by 5,931
- 2017FiLM: Visual Reasoning with a General Conditioning Layercited by 2,286
- 2023Improving and generalizing flow-based generative models with minibatch optimal transportcited by 835
- 2022Large-scale Contrastive Language-Audio Pretraining with Feature Fusion and Keyword-to-Caption Augmentationcited by 707
- 2022BigVGAN: A Universal Neural Vocoder with Large-Scale Trainingcited by 245
- 2018Fr'echet Audio Distance: A Metric for Evaluating Music Enhancement Algorithmscited by 221
- 2024Fast Timing-Conditioned Latent Audio Diffusioncited by 178
- 2023MERT: Acoustic Music Understanding Model with Large-Scale Self-supervised Trainingcited by 175
- 2020ViSQOL v3: An Open Source Production Ready Objective Speech and Audio Metriccited by 76
- 2021Visually Informed Binaural Audio Generation without Binaural Audioscited by 46
- 2025LeVo: High-Quality Song Generation with Multi-Preference Alignmentcited by 23
- 2024PAM: Prompting Audio-Language Models for Audio Quality Assessmentcited by 20
4 more
- 2025Aligning Text-to-Music Evaluation with Human Preferencescited by 20
- 2025OmniAudio: Generating Spatial Audio from 360-Degree Videocited by 17
- 2021Exploiting Audio-Visual Consistency with Partial Supervision for Spatial Audio Generationcited by 14
- 2025ASAudio: A Survey of Advanced Spatial Audio Researchcited by 4
Built on by
Citing papers per year: 2026: 1.
1 paper.
- 2026Generative Learning for Ambisonic Upscalingcited by 0
- 2026Generative Learning for Ambisonic Upscaling20 Sep 2026
Similar, not cited
Close in wording, no citation either way
- 2026Flow-HOA: Generative Joint Optimization for Ambisonics Encoding via Flow Matching
- 2025Generating Moving 3D Soundscapes with Latent Diffusion Models
- 2024ImmerseDiffusion: A Generative Spatial Audio Latent Diffusion Model
- 2026DynFOA: Generating First-Order Ambisonics with Conditional Diffusion for Dynamic and Acoustically Complex 360-Degree Videos
- 2026DynFOA: Generating First-Order Ambisonics with Conditional Diffusion for Dynamic and Acoustically Complex 360-Degree Videos
- 2025ViSAudio: End-to-End Video-Driven Binaural Spatial Audio Generation
- 2025FoleySpace: Vision-Aligned Binaural Spatial Audio Generation
- 2025BinauralFlow: A Causal and Streamable Approach for High-Quality Binaural Speech Synthesis with Flow Matching Models