mlsanityData to 7 Oct 2026

A2SB: Audio-to-Audio Schrodinger Bridges

arXiv 2501.11311 ↗First posted 20 Jan 2025cs.SD cs.LG eess.AScited by 11

Not on the map. Why?

Abstract (arXiv)

Real-world audio is often degraded by numerous factors. This work presents an audio restoration model tailored for high-res music at 44.1kHz. Our model, Audio-to-Audio Schr"odinger Bridges (A2SB), is capable of both bandwidth extension (predicting high-frequency components) and inpainting (re-generating missing segments). Critically, A2SB is end-to-end requiring no vocoder to predict waveform outputs, able to restore hour-long audio inputs, and trained on permissively licensed music data. A2SB is capable of achieving state-of-the-art band-width extension and inpainting quality on several out-of-distribution music test sets.

Key facts. Cited by 11 papers in the map (data through 7 Oct 2026). Builds on 59 of its 75 references that are in the map. First posted on arXiv 20 Jan 2025.

Builds on

59 of 75 references.

References · 59

  1. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  2. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  4. 2022Training language models to follow instructions with human feedbackcited by 15,712
  5. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
  6. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
  7. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
  8. 2022Scalable Diffusion Models with Transformerscited by 5,931
  9. 2022Flow Matching for Generative Modelingcited by 5,426
  10. 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,581
  11. 2022Video Diffusion Modelscited by 2,280
  12. 2021Image Super-Resolution via Iterative Refinementcited by 1,506
38 more
  1. 2022Diffusion Posterior Sampling for General Noisy Inverse Problemscited by 1,375
  2. 2020DiffWave: A Versatile Diffusion Model for Audio Synthesiscited by 1,339
  3. 2022eDiff-I: Text-to-Image Diffusion Models with an Ensemble of Expert Denoiserscited by 921
  4. 2023Stochastic Interpolants: A Unifying Framework for Flows and Diffusionscited by 897
  5. 2022Large-scale Contrastive Language-Audio Pretraining with Feature Fusion and Keyword-to-Caption Augmentationcited by 707
  6. 2024Movie Gen: A Cast of Media Foundation Modelscited by 614
  7. 2021Diffusion Schr"odinger Bridge with Applications to Score-Based Generative Modelingcited by 594
  8. 2023MultiDiffusion: Fusing Diffusion Paths for Controlled Image Generationcited by 529
  9. 2021ByT5: Towards a token-free future with pre-trained byte-to-byte modelscited by 504
  10. 2022Improving Diffusion Models for Inverse Problems using Manifold Constraintscited by 501
  11. 2023MusicLM: Generating Music From Textcited by 442
  12. 2015MUSAN: A Music, Speech, and Noise Corpuscited by 400
  13. 2013A survey of the Schr"odinger problem and some of its connections with optimal transportcited by 286
  14. 2022BigVGAN: A Universal Neural Vocoder with Large-Scale Trainingcited by 245
  15. 2017Neural Audio Synthesis of Musical Notes with WaveNet Autoencoderscited by 222
  16. 2021Likelihood Training of Schr"odinger Bridge using Forward-Backward SDEs Theorycited by 216
  17. 2018Enabling Factorized Piano Music Modeling and Generation with the MAESTRO Datasetcited by 215
  18. 2023I2SB: Image-to-Image Schr"odinger Bridgecited by 214
  19. 2016FMA: A Dataset For Music Analysiscited by 205
  20. 2022Speech Enhancement and Dereverberation with Diffusion-based Generative Modelscited by 195
  21. 2019Cutting Music Source Separation Some Slakh: A Dataset to Study the Impact of Training Data Quality and Quantitycited by 86
  22. 2020An Analysis of SVD for Deep Rotation Estimationcited by 85
  23. 2023AUDIT: Audio Editing by Following Instructions with Latent Diffusion Modelscited by 81
  24. 2020ViSQOL v3: An Open Source Production Ready Objective Speech and Audio Metriccited by 76
  25. 2022Universal Speech Enhancement with Score-based Diffusioncited by 75
  26. 2022Solving Audio Inverse Problems with a Diffusion Modelcited by 62
  27. 2016Learning Features of Music from Scratchcited by 57
  28. 2021NU-Wave: A Diffusion Probabilistic Model for Neural Audio Upsamplingcited by 50
  29. 2021VoiceFixer: Toward General Speech Restoration with Neural Vocodercited by 50
  30. 2023AudioSR: Versatile Audio Super-resolution at Scalecited by 39
  31. 2022Neural Vocoder is All You Need for Speech Super-resolutioncited by 37
  32. 2024Schr"odinger Bridge for Generative Speech Enhancementcited by 27
  33. 2022Conditioning and Sampling in Variational Diffusion Models for Speech Super-Resolutioncited by 20
  34. 2025FLowHigh: Towards Efficient and High-Quality Audio Super-Resolution with Single-Step Flow Matchingcited by 18
  35. 2022SpeechPainter: Text-conditioned Speech Inpaintingcited by 17
  36. 2024ETTA: Elucidating the Design Space of Text-to-Audio Modelscited by 17
  37. 2024Generative Speech Foundation Model Pretraining for High-Quality Speech Extraction and Restorationcited by 16
  38. 2020GACELA -- A generative adversarial context encoder for long audio inpaintingcited by 15

50 most cited of 59 All 59 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 5; 2026: 6.

11 papers.