CodecFlow: Efficient Bandwidth Extension via Conditional Flow Matching in Neural Codec Latent Space
On the map: Diffusion models → Audio, speech and music
Abstract (arXiv)
Speech Bandwidth Extension improves clarity and intelligibility by restoring/inferring appropriate high-frequency content for low-bandwidth speech. Existing methods often rely on spectrogram or waveform modeling, which can incur higher computational cost and have limited high-frequency fidelity. Neural audio codecs offer compact latent representations that better preserve acoustic detail, yet accurately recovering high-resolution latent information remains challenging due to representation mismatch. We present CodecFlow, a neural codec-based BWE framework that performs efficient speech reconstruction in a compact latent space. CodecFlow employs a voicing-aware conditional flow converter on continuous codec embeddings and a structure-constrained residual vector quantizer to improve latent alignment stability. Optimized end-to-end, CodecFlow achieves strong spectral fidelity and enhanced perceptual quality on 8 kHz to 16 kHz and 44.1 kHz speech BWE tasks.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Audio, speech and music, one of 14 directions in Diffusion models. Builds on 27 of its 39 references that are in the map. First posted on arXiv 2 Mar 2026.
Builds on
27 of 39 references.
Closest ancestors · 7
Same direction, newest first
- 2025UniverSR: Unified and Versatile Audio Super-Resolution via Vocoder-Free Flow Matching1 Oct
- 2025FlowSE: Flow Matching-based Speech Enhancement9 Aug
- 2025FLowHigh: Towards Efficient and High-Quality Audio Super-Resolution with Single-Step Flow Matching9 Jan
- 2024F5-TTS: A Fairytaler that Fakes Fluent and Faithful Speech with Flow Matching9 Oct
- 2024Vector Quantized Diffusion Model Based Speech Bandwidth Extension9 Sep
- 2024FlowAVSE: Efficient Audio-Visual Speech Enhancement with Conditional Flow Matching13 Jun
- 2024NaturalSpeech 3: Zero-Shot Speech Synthesis with Factorized Codec and Diffusion Models5 Mar
Other references · 20
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2020Conformer: Convolution-augmented Transformer for Speech Recognitioncited by 1,838
- 2021Structured Denoising Diffusion Models in Discrete State-Spacescited by 1,665
- 2023Neural Codec Language Models are Zero-Shot Text to Speech Synthesizerscited by 737
- 2019LibriTTS: A Corpus Derived from LibriSpeech for Text-to-Speechcited by 639
- 2023High-Fidelity Audio Compression with Improved RVQGANcited by 423
- 2024CosyVoice: A Scalable Multilingual Zero-shot Text-to-speech Synthesizer based on Supervised Semantic Tokenscited by 323
- 2021NISQA: A Deep CNN-Self-Attention Model for Multidimensional Speech Quality Prediction with Crowdsourced Datasetscited by 189
- 2024MaskGCT: Zero-Shot Text-to-Speech with Masked Generative Codec Transformercited by 159
- 2020ViSQOL v3: An Open Source Production Ready Objective Speech and Audio Metriccited by 76
- 2022VoiceFixer: A Unified Framework for High-Fidelity Speech Restorationcited by 37
- 2019Temporal FiLM: Capturing Long-Range Sequence Dependencies with Feature-Wise Modulationscited by 36
8 more
- 2022NU-Wave 2: A General Neural Audio Upsampling Model for Various Sampling Ratescited by 36
- 2025Vevo: Controllable Zero-Shot Voice Imitation with Self-Supervised Disentanglementcited by 34
- 2022AERO: Audio Super Resolution in the Spectral Domaincited by 17
- 2024Towards High-Quality and Efficient Speech Bandwidth Extension with Parallel Amplitude and Phase Predictioncited by 14
- 2022A Multi-Stage Multi-Codebook VQ-VAE Approach to High-Performance Neural TTScited by 9
- 2023mdctGAN: Taming transformer-based GAN for speech super-resolution with Modified DCT spectracited by 6
- 2025Prosody-Adaptable Audio Codecs for Zero-Shot Voice Conversion via In-Context Learningcited by 6
- 2018Waveform Modeling and Generation Using Hierarchical Recurrent Neural Networks for Speech Bandwidth Extensioncited by 3
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026CFMDCTCodec: A Low-Bitrate Neural Speech Codec with Noise-Prior-aware Conditional Flow Matching for MDCT-Spectral Enhancement ↗
- 2026LatentFlowSR: High-Fidelity Audio Super-Resolution via Noise-Robust Latent Flow Matching
- 2024FlowMAC: Conditional Flow Matching for Audio Coding at Low Bit Rates
- 2025FlowDec: A flow-based full-band general audio codec with high perceptual quality
- 2026One-Step Token-to-Waveform Generation with MeanFlow in Latent Space ↗
- 2026Ultra-Low-Bitrate Mel-Spectrogram-based Neural Speech Coding with Flow-Matching-based Refinement and Vocoding-driven Reconstruction ↗
- 2026Beyond U-Net: A Latent-Representation-Aligned Skip-Free Backbone for Flow-Matching Speech Enhancement
- 2026On the Geometry of Music Bandwidth Extension in Latent Spaces of Audio Codecs