LatentFlowSR: High-Fidelity Audio Super-Resolution via Noise-Robust Latent Flow Matching
On the map: Diffusion models → Audio, speech and music
Abstract (arXiv)
Audio super-resolution aims to recover missing high-frequency details from bandwidth-limited low-resolution audio, thereby improving the naturalness and perceptual quality of the reconstructed signal. However, most existing methods directly operate in the waveform or time-frequency domain, which not only involves high-dimensional generation spaces but is also largely limited to speech tasks, leaving substantial room for improvement on more complex audio types such as sound effects and music. To mitigate these limitations, we introduce LatentFlowSR, a new audio super-resolution approach that leverages conditional flow matching (CFM) within a latent representation space. Specifically, we first train a noise-robust autoencoder, which encodes low-resolution audio into a continuous latent space. Conditioned on the low-resolution latent representation, a CFM mechanism progressively generates the corresponding high-resolution latent representation from a Gaussian prior with a one-step ordinary differential equation (ODE) solver. The resulting high-resolution latent representation is then decoded by the pretrained autoencoder to reconstruct the high-resolution audio. Experimental results demonstrate that LatentFlowSR achieves competitive or superior performance compared with baseline methods across various audio types and super-resolution settings. These results indicate that the proposed method possesses strong high-frequency reconstruction capability and robust generalization performance, providing compelling evidence for the effectiveness of latent-space modeling in audio super-resolution. All relevant code will be made publicly available upon completion of the paper review process.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Audio, speech and music, one of 14 directions in Diffusion models. Builds on 37 of its 60 references that are in the map. First posted on arXiv 10 Apr 2026.
Builds on
37 of 60 references.
Closest ancestors · 5
Same direction, newest first
- 2025FlashSR: One-step Versatile Audio Super-resolution via Diffusion Distillation18 Jan
- 2025FLowHigh: Towards Efficient and High-Quality Audio Super-Resolution with Single-Step Flow Matching9 Jan
- 2023AUDIT: Audio Editing by Following Instructions with Latent Diffusion Models3 Apr
- 2022Conditioning and Sampling in Variational Diffusion Models for Speech Super-Resolution27 Oct
- 2021NU-Wave: A Diffusion Probabilistic Model for Neural Audio Upsampling6 Apr
Other references · 32
- 2017Attention Is All You Needcited by 59,932
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
- 2022Flow Matching for Generative Modelingcited by 5,426
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,550
- 2016Identity Mappings in Deep Residual Networkscited by 1,960
- 2020HiFi-GAN: Generative Adversarial Networks for Efficient and High Fidelity Speech Synthesiscited by 1,139
- 2023Improving and generalizing flow-based generative models with minibatch optimal transportcited by 835
- 2021SoundStream: An End-to-End Neural Audio Codeccited by 756
- 2022High Fidelity Neural Audio Compressioncited by 673
20 more
- 2023High-Fidelity Audio Compression with Improved RVQGANcited by 423
- 2020FSD50K: An Open Dataset of Human-Labeled Sound Eventscited by 339
- 2022BigVGAN: A Universal Neural Vocoder with Large-Scale Trainingcited by 245
- 2018Wave-U-Net: A Multi-Scale Neural Network for End-to-End Audio Source Separationcited by 125
- 2020Neural Networks Fail to Learn Periodic Functions and How to Fix Itcited by 97
- 2021Meta-StyleSpeech : Multi-Speaker Adaptive Text-to-Speech Generationcited by 93
- 2020ViSQOL v3: An Open Source Production Ready Objective Speech and Audio Metriccited by 76
- 2023AudioSR: Versatile Audio Super-resolution at Scalecited by 39
- 2022Neural Vocoder is All You Need for Speech Super-resolutioncited by 37
- 2022NU-Wave 2: A General Neural Audio Upsampling Model for Various Sampling Ratescited by 36
- 2017Audio Super Resolution using Neural Networkscited by 26
- 2021WSRGlow: A Glow-based Waveform Generative Model for Audio Super-Resolutioncited by 19
- 2024Binarized Diffusion Model for Image Super-Resolutioncited by 18
- 2022AERO: Audio Super Resolution in the Spectral Domaincited by 17
- 2024Towards High-Quality and Efficient Speech Bandwidth Extension with Parallel Amplitude and Phase Predictioncited by 14
- 2022BEHM-GAN: Bandwidth Extension of Historical Music using Generative Adversarial Networkscited by 13
- 2025Audio Super-Resolution with Latent Bridge Modelscited by 13
- 2024APCodec: A Neural Audio Codec with Parallel Amplitude and Phase Spectrum Encoding and Decodingcited by 12
- 2021Self-Attention for Audio Super-Resolutioncited by 9
- 2023mdctGAN: Taming transformer-based GAN for speech super-resolution with Modified DCT spectracited by 6
Built on by
Citing papers per year: 2026: 1.
1 paper.
- 2026End-to-End Historical Music Restoration in Latent Spacecited by 0
- 2026End-to-End Historical Music Restoration in Latent Space30 Sep 2026
Similar, not cited
Close in wording, no citation either way
- 2025UniverSR: Unified and Versatile Audio Super-Resolution via Vocoder-Free Flow Matching
- 2025SAGA-SR: Semantically and Acoustically Guided Audio Super-Resolution
- 2026P2Flow: Phoneme-aware Progressive Flow Matching for Extreme Speech Super-Resolution
- 2026CodecFlow: Efficient Bandwidth Extension via Conditional Flow Matching in Neural Codec Latent Space
- 2026A Survey of Advancing Audio Super-Resolution and Bandwidth Extension from Discriminative to Generative Models
- 2025Learning to Upsample and Upmix Audio in the Latent Domain
- 2026WavFlow: Audio Generation in Waveform Space
- 2025Inference-time Scaling for Diffusion-based Audio Super-resolution