Regularized Schr"odinger Bridge via Distortion-Perception Perturbation for High-Fidelity Speech Enhancement
Not on the map. Why?
Abstract (arXiv)
Speech enhancement (SE) requires high-fidelity reconstruction of clean speech that preserves linguistic and paralinguistic cues while maintaining high perceptual quality. Recently, Schr"odinger Bridge (SB), a family of diffusion-based generative models, has advanced SE by bridging degraded and clean speech distributions in a principled formulation, enabling higher-quality reconstructions with fewer sampling steps. However, diffusion-based SE methods still face two challenges: (1) the fidelity-realism tradeoff, where they often prioritize perceptual realism encouraged by the learned speech prior, at the expense of fidelity; and (2) the exposure bias issue, where iterative multi-step sampling causes early-step prediction errors to accumulate along the sampling trajectory and degrade enhanced speech quality. In this paper, we analyze standard SB training and show that it induces a systematic prediction drift, which biases the multi-step trajectory and amplifies error accumulation. To address this, we propose Regularized Schr"odinger Bridge (RSB) for high-fidelity SE, a generative approach that reconciles fidelity and realism while mitigating exposure bias. RSB regularizes training with a Distortion-Perception Perturbation that constructs time-varying targets by interpolating between clean speech and posterior-mean estimates, and trains the network on perturbed intermediate states to correct toward the ground truth progressively. By simulating inference-time prediction errors, this perturbation mitigates the training-inference mismatch and thereby alleviates exposure bias. It also injects posterior-mean estimates as fidelity-preserving guidance, thereby improving reconstruction fidelity.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 39 of its 52 references that are in the map. First posted on arXiv 12 Nov 2025.
Builds on
39 of 52 references.
References · 39
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
- 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 3,972
- 2017The Perception-Distortion Tradeoffcited by 582
- 2018SDR - half-baked or well done?cited by 420
- 2022UTMOS: UTokyo-SaruLab System for VoiceMOS Challenge 2022cited by 381
- 2020Deep Learning Techniques for Inverse Problems in Imagingcited by 290
- 2021Deblurring via Stochastic Refinementcited by 248
- 2020DNSMOS: A Non-Intrusive Perceptual Objective Speech Quality metric to evaluate Noise Suppressorscited by 235
- 2021Likelihood Training of Schr"odinger Bridge using Forward-Backward SDEs Theorycited by 216
- 2023I2SB: Image-to-Image Schr"odinger Bridgecited by 214
27 more
- 2022Speech Enhancement and Dereverberation with Diffusion-based Generative Modelscited by 195
- 2023Denoising Diffusion Bridge Modelscited by 171
- 2019WHAM!: Extending Speech Separation to Noisy Environmentscited by 154
- 2022Conditional Diffusion Probabilistic Model for Speech Enhancementcited by 132
- 2021MetricGAN+: An Improved Version of MetricGAN for Speech Enhancementcited by 114
- 2022StoRM: A Diffusion-based Stochastic Regeneration Model for Speech Enhancement and Dereverberationcited by 105
- 2022Speech Enhancement with Score-Based Generative Models in the Complex STFT Domaincited by 102
- 2023Elucidating the Exposure Bias in Diffusion Modelscited by 98
- 2023Input Perturbation Reduces Exposure Bias in Diffusion Modelscited by 88
- 2023Alleviating Exposure Bias in Diffusion Models through Sampling with Shifted Time Stepscited by 71
- 2022TF-GridNet: Integrating Full- and Sub-Band Modeling for Speech Separationcited by 62
- 2024An Investigation of Incorporating Mamba for Speech Enhancementcited by 61
- 2021A Theory of the Distortion-Perception Tradeoff in Wasserstein Spacecited by 52
- 2021A Study on Speech Enhancement Based on Diffusion Probabilistic Modelcited by 52
- 2022Analysing Diffusion-based Generative Approaches versus Discriminative Approaches for Speech Restorationcited by 34
- 2024Posterior-Mean Rectified Flow: Towards Minimum MSE Photo-Realistic Image Restorationcited by 32
- 2023Schrodinger Bridges Beat Diffusion Models on Text-to-Speech Synthesiscited by 29
- 2024Schr"odinger Bridge for Generative Speech Enhancementcited by 27
- 2024Investigating Training Objectives for Generative Speech Enhancementcited by 20
- 2023Deep Optimal Transport: A Practical Algorithm for Photo-realistic Image Restorationcited by 15
- 2024ICASSP 2024 Speech Signal Improvement Challengecited by 15
- 2023Explicit Estimation of Magnitude and Phase Spectra in Parallel for High-Quality Speech Enhancementcited by 13
- 2022SRTNet: Time Domain Speech Enhancement Via Stochastic Refinementcited by 12
- 2020Self-Progressing Robust Trainingcited by 8
- 2024Controllable Distortion-Perception Tradeoff Through Latent Diffusion for Neural Image Compressioncited by 6
- 2025A Composite Predictive-Generative Approach to Monaural Universal Speech Enhancementcited by 4
- 2025FNSE-SBGAN: Far-field Speech Enhancement with Schrodinger Bridge and Generative Adversarial Networkscited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2024Diffusion-based Speech Enhancement with Schr"odinger Bridge and Symmetric Noise Schedule
- 2026SE-MSB: End-to-End Unpaired Speech Enhancement using Mamba Schr"odinger Bridges
- 2025Schr"odinger Bridge Consistency Trajectory Models for Speech Enhancement
- 2026HybridSB-MoE: Dual-Domain Schr"odinger Bridges with Scene-Adaptive Expert Routing for Speech Enhancement
- 2025Few-step Adversarial Schr"odinger Bridge for Generative Speech Enhancement
- 2026SB-RF: Schr"odinger Bridge Rectified Flow for One-Step Robust Speech Enhancement
- 2026Rethinking Flow and Diffusion Bridge Models for Speech Enhancement
- 2023Unsupervised speech enhancement with diffusion-based generative models