mlsanityData to 7 Oct 2026

NU-Wave 2: A General Neural Audio Upsampling Model for Various Sampling Rates

arXiv 2206.08545 ↗First posted 17 Jun 2022eess.AS cs.LGcited by 36

Not on the map. Why?

Abstract (arXiv)

Conventionally, audio super-resolution models fixed the initial and the target sampling rates, which necessitate the model to be trained for each pair of sampling rates. We introduce NU-Wave 2, a diffusion model for neural audio upsampling that enables the generation of 48 kHz audio signals from inputs of various sampling rates with a single model. Based on the architecture of NU-Wave, NU-Wave 2 uses short-time Fourier convolution (STFC) to generate harmonics to resolve the main failure modes of NU-Wave, and incorporates bandwidth spectral feature transform (BSFT) to condition the bandwidths of inputs in the frequency domain. We experimentally demonstrate that NU-Wave 2 produces high-resolution audio regardless of the sampling rate of input while requiring fewer parameters than other models. The official code and the audio samples are available at https://mindslab-ai.github.io/nuwave2.

Key facts. Cited by 36 papers in the map (data through 7 Oct 2026). Builds on 20 of its 30 references that are in the map. First posted on arXiv 17 Jun 2022.

Builds on

20 of 30 references.

References · 20

  1. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  2. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  3. 2020Denoising Diffusion Implicit Modelscited by 9,655
  4. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
  5. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
  6. 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,067
  7. 2021Image Super-Resolution via Iterative Refinementcited by 1,506
  8. 2020DiffWave: A Versatile Diffusion Model for Audio Synthesiscited by 1,339
  9. 2019Semantic Image Synthesis with Spatially-Adaptive Normalizationcited by 1,295
  10. 2021Variational Diffusion Modelscited by 1,145
  11. 2021Resolution-robust Large Mask Inpainting with Fourier Convolutionscited by 730
  12. 2020WaveGrad: Estimating Gradients for Waveform Generationcited by 620
8 more
  1. 2018Recovering Realistic Texture in Image Super-resolution by Deep Spatial Feature Transformcited by 369
  2. 2021NU-Wave: A Diffusion Probabilistic Model for Neural Audio Upsamplingcited by 50
  3. 2021VoiceFixer: Toward General Speech Restoration with Neural Vocodercited by 50
  4. 2019Temporal FiLM: Capturing Long-Range Sequence Dependencies with Feature-Wise Modulationscited by 36
  5. 2017Audio Super Resolution using Neural Networkscited by 26
  6. 2021WSRGlow: A Glow-based Waveform Generative Model for Audio Super-Resolutioncited by 19
  7. 2019Bandwidth Extension on Raw Audio via Generative Adversarial Networkscited by 10
  8. 2021TUNet: A Block-online Bandwidth Extension Model based on Transformers and Self-supervised Pretrainingcited by 8

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2022: 9; 2023: 9; 2024: 5; 2025: 8; 2026: 5.

36 papers.

Sort:

By area:

  1. 2023TRACT: Denoising Diffusion Models with Transitive Closure Time-Distillationcited by 115
  2. 2022StoRM: A Diffusion-based Stochastic Regeneration Model for Speech Enhancement and Dereverberationcited by 105
  3. 2023A Survey on Audio Diffusion Models: Text To Speech Synthesis and Enhancement in Generative AIcited by 68
  4. 2022Solving Audio Inverse Problems with a Diffusion Modelcited by 62
  5. 2022Diffusion-based Generative Speech Source Separationcited by 41
  6. 2023AudioSR: Versatile Audio Super-resolution at Scalecited by 39
  7. 2023DDDM-VC: Decoupled Denoising Diffusion Models with Disentangled Representation and Prior Mixup for Verified Robust Voice Conversioncited by 38
  8. 2023HierSpeech++: Bridging the Gap between Semantic and Acoustic Representation of Speech by Hierarchical Variational Inference for Zero-shot Speech Synthesiscited by 35
  9. 2022Analysing Diffusion-based Generative Approaches versus Discriminative Approaches for Speech Restorationcited by 34
  10. 2023Blind Audio Bandwidth Extension: A Diffusion-Based Zero-Shot Approachcited by 21
  11. 2022Conditioning and Sampling in Variational Diffusion Models for Speech Super-Resolutioncited by 20
  12. 2022Avocodo: Generative Adversarial Network for Artifact-free Vocodercited by 18
24 more
  1. 2025FLowHigh: Towards Efficient and High-Quality Audio Super-Resolution with Single-Step Flow Matchingcited by 18
  2. 2022AERO: Audio Super Resolution in the Spectral Domaincited by 17
  3. 2025Audio Super-Resolution with Latent Bridge Modelscited by 13
  4. 2024PeriodWave: Multi-Period Flow Matching for High-Fidelity Waveform Generationcited by 12
  5. 2024Wave-U-Mamba: An End-To-End Framework For High-Quality And Efficient Speech Super Resolutioncited by 9
  6. 2022PhaseAug: A Differentiable Augmentation for Speech Synthesis to Simulate One-to-Many Mappingcited by 8
  7. 2023mdctGAN: Taming transformer-based GAN for speech super-resolution with Modified DCT spectracited by 6
  8. 2024Vibravox: A Dataset of French Speech Captured with Body-conduction Audio Sensorscited by 5
  9. 2024Vector Quantized Diffusion Model Based Speech Bandwidth Extensioncited by 4
  10. 2025VoiceBridge: General Speech Restoration with One-step Latent Bridge Modelscited by 4
  11. 2024Improving Diffusion Models's Data-Corruption Resistance using Scheduled Pseudo-Huber Losscited by 3
  12. 2025Inference-time Scaling for Diffusion-based Audio Super-resolutioncited by 3
  13. 2025UniverSR: Unified and Versatile Audio Super-Resolution via Vocoder-Free Flow Matchingcited by 3
  14. 2022Nonparallel High-Quality Audio Super Resolution with Domain Adaptation and Resampling CycleGANscited by 2
  15. 2025A High-Fidelity Speech Super Resolution Network using a Complex Global Attention Module with Spectro-Temporal Losscited by 1
  16. 2026CodecFlow: Efficient Bandwidth Extension via Conditional Flow Matching in Neural Codec Latent Spacecited by 1
  17. 2026LatentFlowSR: High-Fidelity Audio Super-Resolution via Noise-Robust Latent Flow Matchingcited by 1
  18. 2023Edge Storage Management Recipe with Zero-Shot Data Compression for Road Anomaly Detectioncited by 0
  19. 2023Progressive distillation diffusion for raw music generationcited by 0
  20. 2025Neural Spectral Band Generation for Audio Codingcited by 0
  21. 2025SUBARU: A Practical Approach to Power Saving in Hearables Using SUB-Nyquist Audio Resolution Upsamplingcited by 0
  22. 2026FastWave: Optimized Diffusion Model for Audio Super-Resolutioncited by 0
  23. 2026VeRe-Flow: Guiding Flow Matching toward Clean Speech via Velocity Contrastive Regularization and Representation Alignment for Noise-Robust Bandwidth Expansioncited by 0
  24. 2026P2Flow: Phoneme-aware Progressive Flow Matching for Extreme Speech Super-Resolutioncited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2025FlashSR: One-step Versatile Audio Super-resolution via Diffusion Distillation
  2. 2026A Survey of Advancing Audio Super-Resolution and Bandwidth Extension from Discriminative to Generative Models
  3. 2025Learning to Upsample and Upmix Audio in the Latent Domain
  4. 2026Discriminating real and synthetic super-resolved audio samples using embedding-based classifiers
  5. 2025SAGA-SR: Semantically and Acoustically Guided Audio Super-Resolution
  6. 2025BridgeVoC: Revitalizing Neural Vocoder from a Restoration Perspective
  7. 2025WaveLLDM: Design and Development of a Lightweight Latent Diffusion Model for Speech Enhancement and Restoration
  8. 2025Score Distillation Sampling for Audio: Source Separation, Synthesis, and Beyond