mlsanityData to 7 Oct 2026

On the Geometry of Music Bandwidth Extension in Latent Spaces of Audio Codecs

arXiv 2608.03721 ↗First posted 4 Aug 2026cs.SDcited by 0

On the map: Diffusion models → Audio, speech and music

Abstract (arXiv)

Recent audio restoration increasingly relies on large-scale conditional latent generative modeling, including diffusion, Schrodinger Bridges, and Flow Matching variants, to invert degradations such as bandwidth limitation or noise. We present an analysis of the performance of various state-of-the-art methods compared to simple arithmetic transformations in the latent spaces of multiple neural codecs for musical bandwidth extension. We show that estimating a single transport vector between the clean and degraded latent centroids on a reference set, and adding it to degraded latents, can yield restoration performance competitive with large diffusion models. This suggests, first, that some neural codec latent spaces exhibit structure aligned with audio bandwidth; and second, that in such cases complex conditional models may offer only limited gains over a simple vector addition. We argue that these findings reveal an interesting avenue for future research whereby models could take advantage of the latent space structure in order to offer greater training and parameter efficiency, and overall better performance. Additionally, we propose to consider this simple arithmetic transformation as a baseline for music bandwidth extension research, as it allows an assessment of the contribution of learnable parameters towards restoration performance.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Audio, speech and music, one of 14 directions in Diffusion models. Builds on 33 of its 43 references that are in the map. First posted on arXiv 4 Aug 2026.

Builds on

33 of 43 references.

Closest ancestors · 8

Same direction, newest first

  1. 2025Learning to Upsample and Upmix Audio in the Latent Domain31 May
  2. 2025FLowHigh: Towards Efficient and High-Quality Audio Super-Resolution with Single-Step Flow Matching9 Jan
  3. 2024High-Resolution Speech Restoration with Latent Diffusion Model17 Sep
  4. 2024Music2Latent: Consistency Autoencoders for Latent Audio Compression12 Aug
  5. 2024Long-form music generation with latent diffusion16 Apr
  6. 2023AUDIT: Audio Editing by Following Instructions with Latent Diffusion Models3 Apr
  7. 2022Solving Audio Inverse Problems with a Diffusion Model27 Oct
  8. 2022Speech Enhancement and Dereverberation with Diffusion-based Generative Models11 Aug

Other references · 25

  1. 2022Flow Matching for Generative Modelingcited by 5,426
  2. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
  3. 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Spacecited by 960
  4. 2022eDiff-I: Text-to-Image Diffusion Models with an Ensemble of Expert Denoiserscited by 921
  5. 2021SoundStream: An End-to-End Neural Audio Codeccited by 756
  6. 2019Interpreting the Latent Space of GANs for Semantic Face Editingcited by 691
  7. 2022High Fidelity Neural Audio Compressioncited by 673
  8. 2020GANSpace: Discovering Interpretable GAN Controlscited by 612
  9. 2021Diffusion Schr"odinger Bridge with Applications to Score-Based Generative Modelingcited by 594
  10. 2023High-Fidelity Audio Compression with Improved RVQGANcited by 423
  11. 2018Enabling Factorized Piano Music Modeling and Generation with the MAESTRO Datasetcited by 215
  12. 2024Stable Audio Opencited by 192
13 more
  1. 2023Diffusion Models for Image Restoration and Enhancement: A Comprehensive Surveycited by 108
  2. 2020ViSQOL v3: An Open Source Production Ready Objective Speech and Audio Metriccited by 76
  3. 2024Codec Does Matter: Exploring the Semantic Shortcoming of Codec for Audio Language Modelcited by 70
  4. 2021VoiceFixer: Toward General Speech Restoration with Neural Vocodercited by 50
  5. 2023AudioSR: Versatile Audio Super-resolution at Scalecited by 39
  6. 2017Audio Super Resolution using Neural Networkscited by 26
  7. 2019Learning Disentangled Representations of Timbre and Pitch for Musical Instrument Sounds Using Gaussian Mixture Variational Autoencoderscited by 21
  8. 2023Blind Audio Bandwidth Extension: A Diffusion-Based Zero-Shot Approachcited by 21
  9. 2024ETTA: Elucidating the Design Space of Text-to-Audio Modelscited by 17
  10. 2025A2SB: Audio-to-Audio Schrodinger Bridgescited by 11
  11. 2025CoDiCodec: Unifying Continuous and Discrete Compressed Representations of Audiocited by 7
  12. 2024MusicHiFi: Fast High-Fidelity Stereo Vocodingcited by 6
  13. 2022Learning and controlling the source-filter representation of speech with a variational autoencodercited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Pitch-class Steering for Diffusion-based Music Generation via Latent-space Probes
  2. 2024Latent Diffusion Bridges for Unsupervised Musical Audio Timbre Transfer
  3. 2024Bass Accompaniment Generation via Latent Diffusion
  4. 2025BridgeVoC: Revitalizing Neural Vocoder from a Restoration Perspective
  5. 2026Diffusion Timbre Transfer Via Mutual Information Guided Inpainting
  6. 2025Re-Bottleneck: Latent Re-Structuring for Neural Audio Autoencoders
  7. 2025Token-Based Audio Inpainting via Discrete Diffusion
  8. 2024Diff-A-Riff: Musical Accompaniment Co-creation via Latent Diffusion Models