AudioSR: Versatile Audio Super-resolution at Scale
Not on the map. Why?
Abstract (arXiv)
Audio super-resolution is a fundamental task that predicts high-frequency components for low-resolution audio, enhancing audio quality in digital applications. Previous methods have limitations such as the limited scope of audio types (e.g., music, speech) and specific bandwidth settings they can handle (e.g., 4kHz to 8kHz). In this paper, we introduce a diffusion-based generative model, AudioSR, that is capable of performing robust audio super-resolution on versatile audio types, including sound effects, music, and speech. Specifically, AudioSR can upsample any input audio signal within the bandwidth range of 2kHz to 16kHz to a high-resolution audio signal at 24kHz bandwidth with a sampling rate of 48kHz. Extensive objective evaluation on various audio super-resolution benchmarks demonstrates the strong result achieved by the proposed model. In addition, our subjective evaluation shows that AudioSR can acts as a plug-and-play module to enhance the generation quality of a wide range of audio generative models, including AudioLDM, Fastspeech2, and MusicGen. Our code and demo are available at https://audioldm.github.io/audiosr.
Key facts. Cited by 39 papers in the map (data through 14 Oct 2026). Builds on 18 of its 26 references that are in the map. First posted on arXiv 13 Sep 2023.
Builds on
18 of 26 references.
References · 18
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2020Denoising Diffusion Implicit Modelscited by 9,781
- 2020HiFi-GAN: Generative Adversarial Networks for Efficient and High Fidelity Speech Synthesiscited by 1,154
- 2020FastSpeech 2: Fast and High-Quality End-to-End Text to Speechcited by 717
- 2023AudioLDM: Text-to-Audio Generation with Latent Diffusion Modelscited by 599
- 2023Simple and Controllable Music Generationcited by 488
- 2023MusicLM: Generating Music From Textcited by 448
- 2023AudioLDM 2: Learning Holistic Audio Generation with Self-supervised Pretrainingcited by 344
- 2023Common Diffusion Noise Schedules and Sample Steps are Flawedcited by 310
- 2023WavCaps: A ChatGPT-Assisted Weakly-Labelled Audio Captioning Dataset for Audio-Language Multimodal Researchcited by 267
- 2021NU-Wave: A Diffusion Probabilistic Model for Neural Audio Upsamplingcited by 50
- 2021VoiceFixer: Toward General Speech Restoration with Neural Vocodercited by 50
6 more
- 2023Moisesdb: A dataset for source separation beyond 4-stemscited by 39
- 2022Neural Vocoder is All You Need for Speech Super-resolutioncited by 37
- 2022NU-Wave 2: A General Neural Audio Upsampling Model for Various Sampling Ratescited by 36
- 2021GAN Vocoder: Multi-Resolution Discriminator Is All You Needcited by 16
- 2021Self-Attention for Audio Super-Resolutioncited by 9
- 2020Phase-aware music super-resolution using generative adversarial networkscited by 5
Built on by
Citing papers per year: 2023: 1; 2024: 9; 2025: 17; 2026: 12.
39 papers.
Sort:
By area:
- 2024Moshi: a speech-text foundation model for real-time dialoguecited by 568
- 2024SemantiCodec: An Ultra Low Bitrate Semantic Audio Codec for General Soundcited by 45
- 2023HierSpeech++: Bridging the Gap between Semantic and Acoustic Representation of Speech by Hierarchical Variational Inference for Zero-shot Speech Synthesiscited by 35
- 2024Taming Data and Transformers for Audio Generationcited by 28
- 2024Masked Generative Video-to-Audio Transformers with Enhanced Synchronicitycited by 28
- 2025AnyEnhance: A Unified Generative Model with Prompt-Guidance and Self-Critic for Voice Enhancementcited by 23
- 2025FLowHigh: Towards Efficient and High-Quality Audio Super-Resolution with Single-Step Flow Matchingcited by 18
- 2025Audio Super-Resolution with Latent Bridge Modelscited by 14
- 2025A2SB: Audio-to-Audio Schrodinger Bridgescited by 11
- 2024SoundCTM: Unifying Score-based and Consistency Models for Full-band Text-to-Sound Generationcited by 9
- 2024Wave-U-Mamba: An End-To-End Framework For High-Quality And Efficient Speech Super Resolutioncited by 9
- 2025Multi-Metric Preference Alignment for Generative Speech Restorationcited by 7
27 more
- 2025UniFlow-Audio: Unified Flow Matching for Audio Generation from Omni-Modalitiescited by 6
- 2024Vibravox: A Dataset of French Speech Captured with Body-conduction Audio Sensorscited by 5
- 2025FlashSR: One-step Versatile Audio Super-resolution via Diffusion Distillationcited by 5
- 2025Learning to Upsample and Upmix Audio in the Latent Domaincited by 5
- 2024Vector Quantized Diffusion Model Based Speech Bandwidth Extensioncited by 4
- 2025VoiceBridge: General Speech Restoration with One-step Latent Bridge Modelscited by 4
- 2025Inference-time Scaling for Diffusion-based Audio Super-resolutioncited by 3
- 2025UniverSR: Unified and Versatile Audio Super-Resolution via Vocoder-Free Flow Matchingcited by 3
- 2025HQ-SVC: Towards High-Quality Zero-Shot Singing Voice Conversion in Low-Resource Scenarioscited by 2
- 2025A High-Fidelity Speech Super Resolution Network using a Complex Global Attention Module with Spectro-Temporal Losscited by 1
- 2026SIRUP: A diffusion-based virtual upmixer of steering vectors for highly-directive spatialization with first-order ambisonicscited by 1
- 2026LatentFlowSR: High-Fidelity Audio Super-Resolution via Noise-Robust Latent Flow Matchingcited by 1
- 2026AuK Technical Report: An Open-Source Foundational Model for Speech Generation and Editingcited by 1
- 2024Speech Bandwidth Expansion Via High Fidelity Generative Adversarial Networkscited by 0
- 2025Neural Spectral Band Generation for Audio Codingcited by 0
- 2025SUBARU: A Practical Approach to Power Saving in Hearables Using SUB-Nyquist Audio Resolution Upsamplingcited by 0
- 2025BridgeVoC: Revitalizing Neural Vocoder from a Restoration Perspectivecited by 0
- 2025CogSR: Semantic-Aware Speech Super-Resolution via Chain-of-Thought Guided Flow Matchingcited by 0
- 2026Discriminating real and synthetic super-resolved audio samples using embedding-based classifierscited by 0
- 2026FastWave: Optimized Diffusion Model for Audio Super-Resolutioncited by 0
- 2026Fast and Flexible Audio Bandwidth Extension via Vocoscited by 0
- 2026Stage-adaptive audio diffusion modelingcited by 0
- 2026Synthetic Audio Generation Framework for Air Traffic Control Speech Recognitioncited by 0
- 2026VeRe-Flow: Guiding Flow Matching toward Clean Speech via Velocity Contrastive Regularization and Representation Alignment for Noise-Robust Bandwidth Expansioncited by 0
- 2026On the Geometry of Music Bandwidth Extension in Latent Spaces of Audio Codecscited by 0
- 2026P2Flow: Phoneme-aware Progressive Flow Matching for Extreme Speech Super-Resolutioncited by 0
- 2026End-to-End Historical Music Restoration in Latent Spacecited by 0
- 2026End-to-End Historical Music Restoration in Latent Space30 Sep 2026
- 2026P2Flow: Phoneme-aware Progressive Flow Matching for Extreme Speech Super-Resolution21 Sep 2026
- 2026AuK Technical Report: An Open-Source Foundational Model for Speech Generation and Editing8 Sep 2026
- 2026On the Geometry of Music Bandwidth Extension in Latent Spaces of Audio Codecs4 Aug 2026
- 2026VeRe-Flow: Guiding Flow Matching toward Clean Speech via Velocity Contrastive Regularization and Representation Alignment for Noise-Robust Bandwidth Expansion28 Jun 2026
- 2026Synthetic Audio Generation Framework for Air Traffic Control Speech Recognition19 Jun 2026
- 2026Stage-adaptive audio diffusion modeling6 May 2026
- 2026LatentFlowSR: High-Fidelity Audio Super-Resolution via Noise-Robust Latent Flow Matching10 Apr 2026
- 2026Fast and Flexible Audio Bandwidth Extension via Vocos7 Mar 2026
- 2026FastWave: Optimized Diffusion Model for Audio Super-Resolution4 Mar 2026
- 2026SIRUP: A diffusion-based virtual upmixer of steering vectors for highly-directive spatialization with first-order ambisonics18 Feb 2026
- 2026Discriminating real and synthetic super-resolved audio samples using embedding-based classifiers6 Jan 2026
27 more
- 2025CogSR: Semantic-Aware Speech Super-Resolution via Chain-of-Thought Guided Flow Matching18 Dec 2025
- 2025HQ-SVC: Towards High-Quality Zero-Shot Singing Voice Conversion in Low-Resource Scenarios11 Nov 2025
- 2025BridgeVoC: Revitalizing Neural Vocoder from a Restoration Perspective10 Nov 2025
- 2025UniverSR: Unified and Versatile Audio Super-Resolution via Vocoder-Free Flow Matching1 Oct 2025
- 2025UniFlow-Audio: Unified Flow Matching for Audio Generation from Omni-Modalities29 Sep 2025
- 2025VoiceBridge: General Speech Restoration with One-step Latent Bridge Models28 Sep 2025
- 2025Audio Super-Resolution with Latent Bridge Models22 Sep 2025
- 2025Multi-Metric Preference Alignment for Generative Speech Restoration24 Aug 2025
- 2025Inference-time Scaling for Diffusion-based Audio Super-resolution4 Aug 2025
- 2025A High-Fidelity Speech Super Resolution Network using a Complex Global Attention Module with Spectro-Temporal Loss30 Jun 2025
- 2025SUBARU: A Practical Approach to Power Saving in Hearables Using SUB-Nyquist Audio Resolution Upsampling27 Jun 2025
- 2025Neural Spectral Band Generation for Audio Coding7 Jun 2025
- 2025Learning to Upsample and Upmix Audio in the Latent Domain31 May 2025
- 2025AnyEnhance: A Unified Generative Model with Prompt-Guidance and Self-Critic for Voice Enhancement26 Jan 2025
- 2025A2SB: Audio-to-Audio Schrodinger Bridges20 Jan 2025
- 2025FlashSR: One-step Versatile Audio Super-resolution via Diffusion Distillation18 Jan 2025
- 2025FLowHigh: Towards Efficient and High-Quality Audio Super-Resolution with Single-Step Flow Matching9 Jan 2025
- 2024Moshi: a speech-text foundation model for real-time dialogue17 Sep 2024
- 2024Wave-U-Mamba: An End-To-End Framework For High-Quality And Efficient Speech Super Resolution14 Sep 2024
- 2024Vector Quantized Diffusion Model Based Speech Bandwidth Extension9 Sep 2024
- 2024Speech Bandwidth Expansion Via High Fidelity Generative Adversarial Networks26 Jul 2024
- 2024Vibravox: A Dataset of French Speech Captured with Body-conduction Audio Sensors16 Jul 2024
- 2024Masked Generative Video-to-Audio Transformers with Enhanced Synchronicity15 Jul 2024
- 2024Taming Data and Transformers for Audio Generation27 Jun 2024
- 2024SoundCTM: Unifying Score-based and Consistency Models for Full-band Text-to-Sound Generation28 May 2024
- 2024SemantiCodec: An Ultra Low Bitrate Semantic Audio Codec for General Sound30 Apr 2024
- 2023HierSpeech++: Bridging the Gap between Semantic and Acoustic Representation of Speech by Hierarchical Variational Inference for Zero-shot Speech Synthesis21 Nov 2023
- 2025FLowHigh: Towards Efficient and High-Quality Audio Super-Resolution with Single-Step Flow Matchingcited by 18
- 2024SoundCTM: Unifying Score-based and Consistency Models for Full-band Text-to-Sound Generationcited by 9
- 2025UniFlow-Audio: Unified Flow Matching for Audio Generation from Omni-Modalitiescited by 6
- 2025FlashSR: One-step Versatile Audio Super-resolution via Diffusion Distillationcited by 5
- 2025Learning to Upsample and Upmix Audio in the Latent Domaincited by 5
- 2024Vector Quantized Diffusion Model Based Speech Bandwidth Extensioncited by 4
- 2025Inference-time Scaling for Diffusion-based Audio Super-resolutioncited by 3
- 2025UniverSR: Unified and Versatile Audio Super-Resolution via Vocoder-Free Flow Matchingcited by 3
- 2026SIRUP: A diffusion-based virtual upmixer of steering vectors for highly-directive spatialization with first-order ambisonicscited by 1
- 2026LatentFlowSR: High-Fidelity Audio Super-Resolution via Noise-Robust Latent Flow Matchingcited by 1
- 2025BridgeVoC: Revitalizing Neural Vocoder from a Restoration Perspectivecited by 0
- 2025CogSR: Semantic-Aware Speech Super-Resolution via Chain-of-Thought Guided Flow Matchingcited by 0
12 most cited of 18 All 18 (JSON)
- 2026P2Flow: Phoneme-aware Progressive Flow Matching for Extreme Speech Super-Resolution21 Sep 2026
- 2026On the Geometry of Music Bandwidth Extension in Latent Spaces of Audio Codecs4 Aug 2026
- 2026VeRe-Flow: Guiding Flow Matching toward Clean Speech via Velocity Contrastive Regularization and Representation Alignment for Noise-Robust Bandwidth Expansion28 Jun 2026
- 2026Stage-adaptive audio diffusion modeling6 May 2026
- 2026LatentFlowSR: High-Fidelity Audio Super-Resolution via Noise-Robust Latent Flow Matching10 Apr 2026
- 2026FastWave: Optimized Diffusion Model for Audio Super-Resolution4 Mar 2026
- 2026SIRUP: A diffusion-based virtual upmixer of steering vectors for highly-directive spatialization with first-order ambisonics18 Feb 2026
- 2026Discriminating real and synthetic super-resolved audio samples using embedding-based classifiers6 Jan 2026
- 2025CogSR: Semantic-Aware Speech Super-Resolution via Chain-of-Thought Guided Flow Matching18 Dec 2025
- 2025BridgeVoC: Revitalizing Neural Vocoder from a Restoration Perspective10 Nov 2025
- 2025UniverSR: Unified and Versatile Audio Super-Resolution via Vocoder-Free Flow Matching1 Oct 2025
- 2025UniFlow-Audio: Unified Flow Matching for Audio Generation from Omni-Modalities29 Sep 2025
12 newest of 18 All 18 (JSON)
- 2024Moshi: a speech-text foundation model for real-time dialoguecited by 568
- 2024SemantiCodec: An Ultra Low Bitrate Semantic Audio Codec for General Soundcited by 45
- 2023HierSpeech++: Bridging the Gap between Semantic and Acoustic Representation of Speech by Hierarchical Variational Inference for Zero-shot Speech Synthesiscited by 35
- 2024Taming Data and Transformers for Audio Generationcited by 28
- 2024Masked Generative Video-to-Audio Transformers with Enhanced Synchronicitycited by 28
- 2025AnyEnhance: A Unified Generative Model with Prompt-Guidance and Self-Critic for Voice Enhancementcited by 23
- 2025Audio Super-Resolution with Latent Bridge Modelscited by 14
- 2025A2SB: Audio-to-Audio Schrodinger Bridgescited by 11
- 2024Vibravox: A Dataset of French Speech Captured with Body-conduction Audio Sensorscited by 5
- 2025VoiceBridge: General Speech Restoration with One-step Latent Bridge Modelscited by 4
- 2025HQ-SVC: Towards High-Quality Zero-Shot Singing Voice Conversion in Low-Resource Scenarioscited by 2
- 2025A High-Fidelity Speech Super Resolution Network using a Complex Global Attention Module with Spectro-Temporal Losscited by 1
12 most cited of 19 All 19 (JSON)
- 2026End-to-End Historical Music Restoration in Latent Space30 Sep 2026
- 2026AuK Technical Report: An Open-Source Foundational Model for Speech Generation and Editing8 Sep 2026
- 2026Synthetic Audio Generation Framework for Air Traffic Control Speech Recognition19 Jun 2026
- 2026Fast and Flexible Audio Bandwidth Extension via Vocos7 Mar 2026
- 2025HQ-SVC: Towards High-Quality Zero-Shot Singing Voice Conversion in Low-Resource Scenarios11 Nov 2025
- 2025VoiceBridge: General Speech Restoration with One-step Latent Bridge Models28 Sep 2025
- 2025Audio Super-Resolution with Latent Bridge Models22 Sep 2025
- 2025A High-Fidelity Speech Super Resolution Network using a Complex Global Attention Module with Spectro-Temporal Loss30 Jun 2025
- 2025SUBARU: A Practical Approach to Power Saving in Hearables Using SUB-Nyquist Audio Resolution Upsampling27 Jun 2025
- 2025Neural Spectral Band Generation for Audio Coding7 Jun 2025
- 2025AnyEnhance: A Unified Generative Model with Prompt-Guidance and Self-Critic for Voice Enhancement26 Jan 2025
- 2025A2SB: Audio-to-Audio Schrodinger Bridges20 Jan 2025
12 newest of 19 All 19 (JSON)
Similar, not cited
Close in wording, no citation either way
- 2025SAGA-SR: Semantically and Acoustically Guided Audio Super-Resolution
- 2026A Survey of Advancing Audio Super-Resolution and Bandwidth Extension from Discriminative to Generative Models
- 2025InspireMusic: Integrating Super Resolution and Large Language Model for High-Fidelity Long-Form Music Generation
- 2024AEROMamba: An efficient architecture for audio super-resolution using generative adversarial networks and state space models
- 2025Audio Generation Through Score-Based Generative Modeling: Design Principles and Implementation
- 2022Conditioning and Sampling in Variational Diffusion Models for Speech Super-Resolution
- 2021CRASH: Raw Audio Score-based Generative Modeling for Controllable High-resolution Drum Sound Synthesis
- 2025Score Distillation Sampling for Audio: Source Separation, Synthesis, and Beyond