UniverSR: Unified and Versatile Audio Super-Resolution via Vocoder-Free Flow Matching
On the map: Diffusion models → Audio, speech and music
Abstract (arXiv)
In this paper, we present a vocoder-free framework for audio super-resolution that employs a flow matching generative model to capture the conditional distribution of complex-valued spectral coefficients. Unlike conventional two-stage diffusion-based approaches that predict a mel-spectrogram and then rely on a pre-trained neural vocoder to synthesize waveforms, our method directly reconstructs waveforms via the inverse Short-Time Fourier Transform (iSTFT), thereby eliminating the dependence on a separate vocoder. This design not only simplifies end-to-end optimization but also overcomes a critical bottleneck of two-stage pipelines, where the final audio quality is fundamentally constrained by vocoder performance. Experiments show that our model consistently produces high-fidelity 48 kHz audio across diverse upsampling factors, achieving state-of-the-art performance on both speech and general audio datasets.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Placed in Audio, speech and music, one of 14 directions in Diffusion models. Builds on 31 of its 42 references that are in the map. First posted on arXiv 1 Oct 2025.
Builds on
31 of 42 references.
Closest ancestors · 3
Same direction, newest first
- 2025FlashSR: One-step Versatile Audio Super-resolution via Diffusion Distillation18 Jan
- 2025FLowHigh: Towards Efficient and High-Quality Audio Super-Resolution with Single-Step Flow Matching9 Jan
- 2022Conditioning and Sampling in Variational Diffusion Models for Speech Super-Resolution27 Oct
Other references · 28
- 2017Attention Is All You Needcited by 60,361
- 2022Classifier-Free Diffusion Guidancecited by 5,847
- 2022Flow Matching for Generative Modelingcited by 5,702
- 2017FiLM: Visual Reasoning with a General Conditioning Layercited by 2,333
- 2020HiFi-GAN: Generative Adversarial Networks for Efficient and High Fidelity Speech Synthesiscited by 1,154
- 2023ConvNeXt V2: Co-designing and Scaling ConvNets with Masked Autoencoderscited by 712
- 2020FSD50K: An Open Dataset of Human-Labeled Sound Eventscited by 342
- 2018Enabling Factorized Piano Music Modeling and Generation with the MAESTRO Datasetcited by 217
- 2016FMA: A Dataset For Music Analysiscited by 207
- 2023Guided Flows for Generative Modeling and Decision Makingcited by 101
- 2023EXPRESSO: A Benchmark and Analysis of Discrete Expressive Speech Resynthesiscited by 98
- 2024EARS: An Anechoic Fullband Speech Dataset Benchmarked for Speech Enhancement and Dereverberationcited by 64
16 more
- 2016Creating A Multi-track Classical Musical Performance Dataset for Multimodal Music Analysis: Challenges, Insights, and Applicationscited by 61
- 2021VoiceFixer: Toward General Speech Restoration with Neural Vocodercited by 50
- 2023Moisesdb: A dataset for source separation beyond 4-stemscited by 39
- 2023AudioSR: Versatile Audio Super-resolution at Scalecited by 39
- 2022Neural Vocoder is All You Need for Speech Super-resolutioncited by 37
- 2022NU-Wave 2: A General Neural Audio Upsampling Model for Various Sampling Ratescited by 36
- 2017Audio Super Resolution using Neural Networkscited by 26
- 2020Real-time Speech Frequency Bandwidth Extensioncited by 22
- 2022AERO: Audio Super Resolution in the Spectral Domaincited by 17
- 2024Towards High-Quality and Efficient Speech Bandwidth Extension with Parallel Amplitude and Phase Predictioncited by 14
- 2025Audio Super-Resolution with Latent Bridge Modelscited by 14
- 2022BEHM-GAN: Bandwidth Extension of Historical Music using Generative Adversarial Networkscited by 13
- 2025A2SB: Audio-to-Audio Schrodinger Bridgescited by 11
- 2024Wave-U-Mamba: An End-To-End Framework For High-Quality And Efficient Speech Super Resolutioncited by 9
- 2023BAE-Net: A Low complexity and high fidelity Bandwidth-Adaptive neural network for speech super-resolutioncited by 3
- 2025HiFi-SR: A Unified Generative Transformer-Convolutional Adversarial Network for High-Fidelity Speech Super-Resolutioncited by 2
Built on by
Citing papers per year: 2026: 3.
3 papers.
- 2026CodecFlow: Efficient Bandwidth Extension via Conditional Flow Matching in Neural Codec Latent Spacecited by 1
- 2026CyFM: Cylindrical Optimal Transport for Few-Step Complex-Valued Flow Matchingcited by 0
- 2026P2Flow: Phoneme-aware Progressive Flow Matching for Extreme Speech Super-Resolutioncited by 0
- 2026P2Flow: Phoneme-aware Progressive Flow Matching for Extreme Speech Super-Resolution21 Sep 2026
- 2026CyFM: Cylindrical Optimal Transport for Few-Step Complex-Valued Flow Matching12 Sep 2026
- 2026CodecFlow: Efficient Bandwidth Extension via Conditional Flow Matching in Neural Codec Latent Space2 Mar 2026
Similar, not cited
Close in wording, no citation either way
- 2026LatentFlowSR: High-Fidelity Audio Super-Resolution via Noise-Robust Latent Flow Matching
- 2025SAGA-SR: Semantically and Acoustically Guided Audio Super-Resolution
- 2025WaveFM: A High-Fidelity and Efficient Vocoder Based on Flow Matching
- 2026A Survey of Advancing Audio Super-Resolution and Bandwidth Extension from Discriminative to Generative Models
- 2025Inference-time Scaling for Diffusion-based Audio Super-resolution
- 2026FastWave: Optimized Diffusion Model for Audio Super-Resolution
- 2025STSR: High-Fidelity Speech Super-Resolution via Spectral-Transient Context Modeling ↗
- 2025Real-Time Streaming Mel Vocoding with Generative Flow Matching