mlsanityData to 14 Oct 2026

P2Flow: Phoneme-aware Progressive Flow Matching for Extreme Speech Super-Resolution

arXiv 2609.24138 ↗First posted 21 Sep 2026eess.AS cs.LG cs.SDcited by 0

On the map: Diffusion models → Audio, speech and music

Abstract (arXiv)

Generative models have recently demonstrated considerable promise in speech super-resolution (SSR). Nevertheless, the majority of existing work has concentrated on standard or versatile SSR configurations, leaving the extreme setting with severely limited spectral inputs largely unexplored. In this regime, current approaches exhibit marked performance degradation, underscoring the need for dedicated solutions. To bridge this gap, we introduce P2Flow, a phoneme-aware progressive flow matching (FM) framework designed for extreme SSR with three main strategies. First, our model leverages phonetic information to reconstruct missing spectral components. Furthermore, it employs a progressive architectural design that hierarchically restores distinct frequency regions. Finally, we incorporate post-training of the vocoder to enhance overall waveform fidelity. Extensive experiments are conducted on the TIMIT and VCTK datasets under both 1 kHz to 16 kHz and 2 kHz to 16 kHz settings, demonstrating that P2Flow yields state-of-the-art results across multiple evaluation metrics.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Audio, speech and music, one of 14 directions in Diffusion models. Builds on 32 of its 45 references that are in the map. First posted on arXiv 21 Sep 2026.

Builds on

32 of 45 references.

Closest ancestors · 7

Same direction, newest first

  1. 2026CodecFlow: Efficient Bandwidth Extension via Conditional Flow Matching in Neural Codec Latent Space2 Mar
  2. 2025Towards Real-Time Generative Speech Restoration with Flow-Matching19 Oct
  3. 2025UniverSR: Unified and Versatile Audio Super-Resolution via Vocoder-Free Flow Matching1 Oct
  4. 2025FLowHigh: Towards Efficient and High-Quality Audio Super-Resolution with Single-Step Flow Matching9 Jan
  5. 2024Vector Quantized Diffusion Model Based Speech Bandwidth Extension9 Sep
  6. 2022Conditioning and Sampling in Variational Diffusion Models for Speech Super-Resolution27 Oct
  7. 2021NU-Wave: A Diffusion Probabilistic Model for Neural Audio Upsampling6 Apr

Other references · 25

  1. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  2. 2022Flow Matching for Generative Modelingcited by 5,702
  3. 2021HuBERT: Self-Supervised Speech Representation Learning by Masked Prediction of Hidden Unitscited by 2,342
  4. 2020HiFi-GAN: Generative Adversarial Networks for Efficient and High Fidelity Speech Synthesiscited by 1,154
  5. 2021Multi-Stage Progressive Image Restorationcited by 816
  6. 2022BigVGAN: A Universal Neural Vocoder with Large-Scale Trainingcited by 251
  7. 2023Denoising Diffusion Bridge Modelscited by 178
  8. 2020ViSQOL v3: An Open Source Production Ready Objective Speech and Audio Metriccited by 79
  9. 2020Multi-band MelGAN: Faster Waveform Generation for High-Quality Text-to-Speechcited by 63
  10. 2018A Fully Progressive Approach to Single-Image Super-Resolutioncited by 46
  11. 2023AudioSR: Versatile Audio Super-resolution at Scalecited by 39
  12. 2019Temporal FiLM: Capturing Long-Range Sequence Dependencies with Feature-Wise Modulationscited by 36
13 more
  1. 2022NU-Wave 2: A General Neural Audio Upsampling Model for Various Sampling Ratescited by 36
  2. 2022AERO: Audio Super Resolution in the Spectral Domaincited by 17
  3. 2024Towards High-Quality and Efficient Speech Bandwidth Extension with Parallel Amplitude and Phase Predictioncited by 14
  4. 2025Audio Super-Resolution with Latent Bridge Modelscited by 14
  5. 2025Bridge-SR: Schr"odinger Bridge for Efficient SRcited by 11
  6. 2025A2SB: Audio-to-Audio Schrodinger Bridgescited by 11
  7. 2021Self-Attention for Audio Super-Resolutioncited by 9
  8. 2024Wave-U-Mamba: An End-To-End Framework For High-Quality And Efficient Speech Super Resolutioncited by 9
  9. 2021TUNet: A Block-online Bandwidth Extension Model based on Transformers and Self-supervised Pretrainingcited by 8
  10. 2024Improving Spoken Language Modeling with Phoneme Classification: A Simple Fine-tuning Approachcited by 8
  11. 2026A Survey of Advancing Audio Super-Resolution and Bandwidth Extension from Discriminative to Generative Modelscited by 6
  12. 2022EBEN: Extreme bandwidth extension network applied to speech signals captured with noise-resilient body-conduction microphonescited by 5
  13. 2025SAGA-SR: Semantically and Acoustically Guided Audio Super-Resolutioncited by 4

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026LatentFlowSR: High-Fidelity Audio Super-Resolution via Noise-Robust Latent Flow Matching
  2. 2025STSR: High-Fidelity Speech Super-Resolution via Spectral-Transient Context Modeling ↗
  3. 2025CogSR: Semantic-Aware Speech Super-Resolution via Chain-of-Thought Guided Flow Matching
  4. 2025Real-Time Streaming Mel Vocoding with Generative Flow Matching
  5. 2025WaveFM: A High-Fidelity and Efficient Vocoder Based on Flow Matching
  6. 2026FlowW2N: Whispered-to-Normal Speech Conversion via Flow-Matching
  7. 2026PhASE-Flow: Phonetic-Conditioned Acoustic Flow Matching in SSL Representation Domain for Speech Enhancement
  8. 2025FlowSE: Efficient and High-Quality Speech Enhancement via Flow Matching