mlsanityData to 7 Oct 2026

An Ordinary Differential Equation Sampler with Stochastic Start for Diffusion Bridge Models

arXiv 2412.19992 ↗First posted 28 Dec 2024cs.CV cs.AIcited by 2

Not on the map. Why?

Abstract (arXiv)

Diffusion bridge models have demonstrated promising performance in conditional image generation tasks, such as image restoration and translation, by initializing the generative process from corrupted images instead of pure Gaussian noise. However, existing diffusion bridge models often rely on Stochastic Differential Equation (SDE) samplers, which result in slower inference speed compared to diffusion models that employ high-order Ordinary Differential Equation (ODE) solvers for acceleration. To mitigate this gap, we propose a high-order ODE sampler with a stochastic start for diffusion bridge models. To overcome the singular behavior of the probability flow ODE (PF-ODE) at the beginning of the reverse process, a posterior sampling approach was introduced at the first reverse step. The sampling was designed to ensure a smooth transition from corrupted images to the generative trajectory while reducing discretization errors. Following this stochastic start, Heun's second-order solver is applied to solve the PF-ODE, achieving high perceptual quality with significantly reduced neural function evaluations (NFEs). Our method is fully compatible with pretrained diffusion bridge models and requires no additional training. Extensive experiments on image restoration and translation tasks, including super-resolution, JPEG restoration, Edges-to-Handbags, and DIODE-Outdoor, demonstrated that our sampler outperforms state-of-the-art methods in both visual quality and Frechet Inception Distance (FID).

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 31 of its 38 references that are in the map. First posted on arXiv 28 Dec 2024.

Builds on

31 of 38 references.

References · 31

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  3. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  4. 2020Denoising Diffusion Implicit Modelscited by 9,655
  5. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
  6. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
  7. 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,510
  8. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,550
  9. 2022Elucidating the Design Space of Diffusion-Based Generative Modelscited by 2,994
  10. 2022DPM-Solver: A Fast ODE Solver for Diffusion Probabilistic Model Sampling in Around 10 Stepscited by 1,961
  11. 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,903
  12. 2023Consistency Modelscited by 1,778
19 more
  1. 2021Image Super-Resolution via Iterative Refinementcited by 1,506
  2. 2022Diffusion Posterior Sampling for General Noisy Inverse Problemscited by 1,375
  3. 2021Palette: Image-to-Image Diffusion Modelscited by 1,296
  4. 2021Real-ESRGAN: Training Real-World Blind Super-Resolution with Pure Synthetic Datacited by 961
  5. 2022Denoising Diffusion Restoration Modelscited by 951
  6. 2022Pseudo Numerical Methods for Diffusion Models on Manifoldscited by 695
  7. 2022Zero-Shot Image Restoration Using Denoising Diffusion Null-Space Modelcited by 574
  8. 2023Analyzing and Improving the Training Dynamics of Diffusion Modelscited by 396
  9. 2019DIODE: A Dense Indoor and Outdoor DEpth Datasetcited by 236
  10. 2018A Note on the Inception Scorecited by 225
  11. 2022Dual Diffusion Implicit Bridges for Image-to-Image Translationcited by 212
  12. 2023Image Restoration with Mean-Reverting Stochastic Differential Equationscited by 182
  13. 2023Denoising Diffusion Bridge Modelscited by 171
  14. 2023Inversion by Direct Iteration: An Alternative to Denoising Diffusion for Image Restorationcited by 164
  15. 2023TRACT: Denoising Diffusion Models with Transitive Closure Time-Distillationcited by 115
  16. 2023Direct Diffusion Bridge using Data Consistency for Inverse Problemscited by 65
  17. 2024Diffusion Bridge Implicit Modelscited by 47
  18. 2022JPEG Artifact Correction using Denoising Diffusion Restoration Modelscited by 45
  19. 2024Consistency Diffusion Bridge Modelscited by 22

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 1; 2026: 1.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Are First-Order Diffusion Samplers Really Slower? A Fast Forward-Value Approach
  2. 2023Fast ODE-based Sampling for Diffusion Models in Around 5 Steps
  3. 2024On the Trajectory Regularity of ODE-based Diffusion Sampling
  4. 2026A Tutorial on Diffusion Theory: From Differential Equations to Diffusion Models
  5. 2025Adaptivity and Convergence of Probability Flow ODEs in Diffusion Generative Models
  6. 2026Colored Noise Diffusion Sampling
  7. 2023Solving Diffusion ODEs with Optimal Boundary Conditions for Better Image Super-Resolution
  8. 2023Exploring the Optimal Choice for Generative Processes in Diffusion Models: Ordinary vs Stochastic Differential Equations