mlsanityData to 14 Oct 2026

Gaussian Flow Bridges for Audio Domain Transfer with Unpaired Data

arXiv 2405.19497 ↗First posted 29 May 2024eess.AS cs.LG cs.SDcited by 3

Not on the map. Why?

Abstract (arXiv)

Audio domain transfer is the process of modifying audio signals to match characteristics of a different domain, while retaining the original content. This paper investigates the potential of Gaussian Flow Bridges, an emerging approach in generative modeling, for this problem. The presented framework addresses the transport problem across different distributions of audio signals through the implementation of a series of two deterministic probability flows. The proposed framework facilitates manipulation of the target distribution properties through a continuous control variable, which defines a certain aspect of the target domain. Notably, this approach does not rely on paired examples for training. To address identified challenges on maintaining the speech content consistent, we recommend a training strategy that incorporates chunk-based minibatch Optimal Transport couplings of data samples and noise. Comparing our unsupervised method with established baselines, we find competitive performance in tasks of reverberation and distortion manipulation. Despite encoutering limitations, the intriguing results obtained in this study underscore potential for further exploration.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 25 of its 39 references that are in the map. First posted on arXiv 29 May 2024.

Builds on

25 of 39 references.

References · 25

  1. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  2. 2022Classifier-Free Diffusion Guidancecited by 5,847
  3. 2022Flow Matching for Generative Modelingcited by 5,702
  4. 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 4,057
  5. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
  6. 2022Null-text Inversion for Editing Real Images using Guided Diffusion Modelscited by 1,179
  7. 2023Improving and generalizing flow-based generative models with minibatch optimal transportcited by 879
  8. 2021Diffusion Schr"odinger Bridge with Applications to Score-Based Generative Modelingcited by 602
  9. 2023Multisample Flow Matching: Straightening Flows with Minibatch Couplingscited by 278
  10. 2020DNSMOS: A Non-Intrusive Perceptual Objective Speech Quality metric to evaluate Noise Suppressorscited by 241
  11. 2022Dual Diffusion Implicit Bridges for Image-to-Image Translationcited by 213
  12. 2021NISQA: A Deep CNN-Self-Attention Model for Multidimensional Speech Quality Prediction with Crowdsourced Datasetscited by 192
13 more
  1. 2022StoRM: A Diffusion-based Stochastic Regeneration Model for Speech Enhancement and Dereverberationcited by 105
  2. 2023Minimizing Trajectory Curvature of ODE-based Generative Modelscited by 89
  3. 2022Solving Audio Inverse Problems with a Diffusion Modelcited by 62
  4. 2024Zero-Shot Unsupervised and Text-Based Audio Editing Using DDPM Inversioncited by 60
  5. 2022Visual Acoustic Matchingcited by 45
  6. 2018Building and Evaluation of a Real Room Impulse Response Datasetcited by 43
  7. 2021MetricGAN-U: Unsupervised speech enhancement/ dereverberation based only on noisy/ reverberated speechcited by 18
  8. 2021dEchorate: a Calibrated Room Impulse Response Database for Echo-aware Signal Processingcited by 10
  9. 2021Unsupervised Speech Enhancement with speech recognition embedding and disentanglement lossescited by 7
  10. 2022Adversarial Guitar Amplifier Modelling With Unpaired Datacited by 5
  11. 2015Sparsity and cosparsity for audio declipping: a flexible non-convex approachcited by 4
  12. 2021Effect of noise suppression losses on speech distortion and ASR performancecited by 4
  13. 2021EfficientTDNN: Efficient Architecture Search for Speaker Recognitioncited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 1; 2025: 1; 2026: 1.

3 papers.