mlsanityData to 14 Oct 2026

DPBridge: Latent Diffusion Bridge for Dense Prediction

arXiv 2412.20506 ↗First posted 29 Dec 2024cs.CVcited by 6

On the map: Diffusion models → Diffusion foundations and sampling

Abstract (arXiv)

Diffusion models demonstrate remarkable capabilities in capturing complex data distributions and have achieved compelling results in many generative tasks. While they have recently been extended to dense prediction tasks such as depth estimation and surface normal prediction, their full potential in this area remains underexplored. As target signal maps and input images are pixel-wise aligned, the conventional noise-to-data generation paradigm is inefficient, and input images can serve as a more informative prior compared to pure noise. Diffusion bridge models, which support data-to-data generation between two general data distributions, offer a promising alternative, but they typically fail to exploit the rich visual priors embedded in large pretrained foundation models. To address these limitations, we integrate diffusion bridge formulation with structured visual priors and introduce DPBridge, the first latent diffusion bridge framework for dense prediction tasks. To resolve the incompatibility between diffusion bridge models and pretrained diffusion backbones, we propose (1) a tractable reverse transition kernel for the diffusion bridge process, enabling maximum likelihood training scheme; (2) finetuning strategies including distribution-aligned normalization and image consistency loss. Experiments across extensive benchmarks validate that our method consistently achieves superior performance, demonstrating its effectiveness and generalization capability under different scenarios.

Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Placed in Diffusion foundations and sampling, one of 14 directions in Diffusion models. Builds on 68 of its 84 references that are in the map. First posted on arXiv 29 Dec 2024.

Builds on

68 of 84 references.

Closest ancestors · 12

Same direction, newest first

  1. 2024Diffusion Bridge Implicit Models24 May
  2. 2023Denoising Diffusion Bridge Models29 Sep
  3. 2023I2SB: Image-to-Image Schr"odinger Bridge12 Feb
  4. 2022Let us Build Bridges: Understanding and Extending Diffusion Generative Models31 Aug
  5. 2022Classifier-Free Diffusion Guidance26 Jul
  6. 2021High-Resolution Image Synthesis with Latent Diffusion Models20 Dec
  7. 2021Conditional Image Generation with Score-Based Diffusion Models26 Nov
  8. 2021Diffusion Schr"odinger Bridge with Applications to Score-Based Generative Modeling1 Jun
  9. 2021Diffusion Models Beat GANs on Image Synthesis11 May
  10. 2020Score-Based Generative Modeling through Stochastic Differential Equations26 Nov
  11. 2020Denoising Diffusion Implicit Models6 Oct
  12. 2020Denoising Diffusion Probabilistic Models19 Jun

Other references · 56

  1. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
  2. 2016The Cityscapes Dataset for Semantic Urban Scene Understandingcited by 4,444
  3. 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,117
  4. 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,611
  5. 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,415
  6. 2021Masked-attention Mask Transformer for Universal Image Segmentationcited by 2,351
  7. 2022Video Diffusion Modelscited by 2,305
  8. 2017Rethinking Atrous Convolution for Semantic Image Segmentationcited by 2,161
  9. 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,937
  10. 2021Vision Transformers for Dense Predictioncited by 1,803
  11. 2019Towards Robust Monocular Depth Estimation: Mixing Datasets for Zero-shot Cross-dataset Transfercited by 1,495
  12. 2024Depth Anything V2cited by 1,422
38 more
  1. 2022Diffusion Posterior Sampling for General Noisy Inverse Problemscited by 1,416
  2. 2020Rethinking Semantic Segmentation from a Sequence-to-Sequence Perspective with Transformerscited by 1,369
  3. 2021Palette: Image-to-Image Diffusion Modelscited by 1,300
  4. 2024Structured 3D Latents for Scalable and Versatile 3D Generationcited by 770
  5. 2019MaskGAN: Towards Diverse and Interactive Facial Image Manipulationcited by 628
  6. 2020Hypersim: A Photorealistic Synthetic Dataset for Holistic Indoor Scene Understandingcited by 604
  7. 2022Improving Diffusion Models for Inverse Problems using Manifold Constraintscited by 508
  8. 2021Label-Efficient Semantic Segmentation with Diffusion Modelscited by 499
  9. 2024CLAY: A Controllable Large-scale Generative Model for Creating High-quality 3D Assetscited by 455
  10. 2024Metric3Dv2: A Versatile Monocular Geometric Foundation Model for Zero-shot Metric Depth and Surface Normal Estimationcited by 395
  11. 2020Virtual KITTI 2cited by 353
  12. 2021Omnidata: A Scalable Pipeline for Making Multi-Task Mid-Level Vision Datasets from 3D Scanscited by 336
  13. 2023Repurposing Diffusion-Based Image Generators for Monocular Depth Estimationcited by 327
  14. 2022Images Speak in Images: A Generalist Painter for In-Context Visual Learningcited by 318
  15. 2023DragDiffusion: Harnessing Diffusion Models for Interactive Point-based Image Editingcited by 294
  16. 2024GeoWizard: Unleashing the Diffusion Priors for 3D Geometry Estimation from a Single Imagecited by 286
  17. 2022FlowFormer: A Transformer Architecture for Optical Flowcited by 275
  18. 2023Unleashing Text-to-Image Diffusion Models for Visual Perceptioncited by 269
  19. 2019DIODE: A Dense Indoor and Outdoor DEpth Datasetcited by 240
  20. 2022BBDM: Image-to-image Translation with Brownian Bridge Diffusion Modelscited by 225
  21. 2023A Variational Perspective on Solving Inverse Problems with Diffusion Modelscited by 222
  22. 2020Learning to Recover 3D Scene Shape from a Single Imagecited by 216
  23. 2022Dual Diffusion Implicit Bridges for Image-to-Image Translationcited by 213
  24. 2022CroCo v2: Improved Cross-view Completion Pre-training for Stereo Matching and Optical Flowcited by 166
  25. 2024StableNormal: Reducing Diffusion Variance for Stable and Sharp Normalcited by 154
  26. 2018Evaluation of CNN-based Single-Image Depth Estimation Methodscited by 138
  27. 2024Rethinking Inductive Biases for Surface Normal Estimationcited by 124
  28. 20223D Common Corruptions and Data Augmentationcited by 119
  29. 2021Estimating and Exploiting the Aleatoric Uncertainty in Surface Normal Estimationcited by 116
  30. 2024Fine-Tuning Image-Conditional Diffusion Models is Easier than You Thinkcited by 83
  31. 2023DiffusionDepth: Diffusion Denoising Approach for Monocular Depth Estimationcited by 82
  32. 2024DepthFM: Fast Monocular Depth Estimation with Flow Matchingcited by 76
  33. 2021STEP: Segmenting and Tracking Every Pixelcited by 73
  34. 2023Direct Diffusion Bridge using Data Consistency for Inverse Problemscited by 66
  35. 2020DiverseDepth: Affine-invariant Depth Prediction Using Diverse Datacited by 61
  36. 2022Hierarchical Normalization for Robust Monocular Depth Estimationcited by 52
  37. 2023Image Restoration Through Generalized Ornstein-Uhlenbeck Bridgecited by 41
  38. 2023Prompting Diffusion Representations for Cross-Domain Semantic Segmentationcited by 30

50 most cited of 56 All 56 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 5; 2026: 1.

6 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Residual Prior Diffusion: A Probabilistic Framework Integrating Coarse Latent Priors with Diffusion Models
  2. 2023Exploiting Diffusion Prior for Generalizable Dense Prediction
  3. 2025D3-Predictor: Noise-Free Deterministic Diffusion for Dense Prediction
  4. 2023DDP: Diffusion Model for Dense Visual Prediction
  5. 2024Diffusion Models Need Visual Priors for Image Generation
  6. 2024Diffusion Models in Low-Level Vision: A Survey
  7. 2024Lotus: Diffusion-based Visual Foundation Model for High-quality Dense Prediction
  8. 2025Accelerating Diffusion Model Training under Minimal Budgets: A Condensation-Based Perspective