DPBridge: Latent Diffusion Bridge for Dense Prediction
On the map: Diffusion models → Diffusion foundations and sampling
Abstract (arXiv)
Diffusion models demonstrate remarkable capabilities in capturing complex data distributions and have achieved compelling results in many generative tasks. While they have recently been extended to dense prediction tasks such as depth estimation and surface normal prediction, their full potential in this area remains underexplored. As target signal maps and input images are pixel-wise aligned, the conventional noise-to-data generation paradigm is inefficient, and input images can serve as a more informative prior compared to pure noise. Diffusion bridge models, which support data-to-data generation between two general data distributions, offer a promising alternative, but they typically fail to exploit the rich visual priors embedded in large pretrained foundation models. To address these limitations, we integrate diffusion bridge formulation with structured visual priors and introduce DPBridge, the first latent diffusion bridge framework for dense prediction tasks. To resolve the incompatibility between diffusion bridge models and pretrained diffusion backbones, we propose (1) a tractable reverse transition kernel for the diffusion bridge process, enabling maximum likelihood training scheme; (2) finetuning strategies including distribution-aligned normalization and image consistency loss. Experiments across extensive benchmarks validate that our method consistently achieves superior performance, demonstrating its effectiveness and generalization capability under different scenarios.
Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Placed in Diffusion foundations and sampling, one of 14 directions in Diffusion models. Builds on 68 of its 84 references that are in the map. First posted on arXiv 29 Dec 2024.
Builds on
68 of 84 references.
Closest ancestors · 12
Same direction, newest first
- 2024Diffusion Bridge Implicit Models24 May
- 2023Denoising Diffusion Bridge Models29 Sep
- 2023I2SB: Image-to-Image Schr"odinger Bridge12 Feb
- 2022Let us Build Bridges: Understanding and Extending Diffusion Generative Models31 Aug
- 2022Classifier-Free Diffusion Guidance26 Jul
- 2021High-Resolution Image Synthesis with Latent Diffusion Models20 Dec
- 2021Conditional Image Generation with Score-Based Diffusion Models26 Nov
- 2021Diffusion Schr"odinger Bridge with Applications to Score-Based Generative Modeling1 Jun
- 2021Diffusion Models Beat GANs on Image Synthesis11 May
- 2020Score-Based Generative Modeling through Stochastic Differential Equations26 Nov
- 2020Denoising Diffusion Implicit Models6 Oct
- 2020Denoising Diffusion Probabilistic Models19 Jun
Other references · 56
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
- 2016The Cityscapes Dataset for Semantic Urban Scene Understandingcited by 4,444
- 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,117
- 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,611
- 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,415
- 2021Masked-attention Mask Transformer for Universal Image Segmentationcited by 2,351
- 2022Video Diffusion Modelscited by 2,305
- 2017Rethinking Atrous Convolution for Semantic Image Segmentationcited by 2,161
- 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,937
- 2021Vision Transformers for Dense Predictioncited by 1,803
- 2019Towards Robust Monocular Depth Estimation: Mixing Datasets for Zero-shot Cross-dataset Transfercited by 1,495
- 2024Depth Anything V2cited by 1,422
38 more
- 2022Diffusion Posterior Sampling for General Noisy Inverse Problemscited by 1,416
- 2020Rethinking Semantic Segmentation from a Sequence-to-Sequence Perspective with Transformerscited by 1,369
- 2021Palette: Image-to-Image Diffusion Modelscited by 1,300
- 2024Structured 3D Latents for Scalable and Versatile 3D Generationcited by 770
- 2019MaskGAN: Towards Diverse and Interactive Facial Image Manipulationcited by 628
- 2020Hypersim: A Photorealistic Synthetic Dataset for Holistic Indoor Scene Understandingcited by 604
- 2022Improving Diffusion Models for Inverse Problems using Manifold Constraintscited by 508
- 2021Label-Efficient Semantic Segmentation with Diffusion Modelscited by 499
- 2024CLAY: A Controllable Large-scale Generative Model for Creating High-quality 3D Assetscited by 455
- 2024Metric3Dv2: A Versatile Monocular Geometric Foundation Model for Zero-shot Metric Depth and Surface Normal Estimationcited by 395
- 2020Virtual KITTI 2cited by 353
- 2021Omnidata: A Scalable Pipeline for Making Multi-Task Mid-Level Vision Datasets from 3D Scanscited by 336
- 2023Repurposing Diffusion-Based Image Generators for Monocular Depth Estimationcited by 327
- 2022Images Speak in Images: A Generalist Painter for In-Context Visual Learningcited by 318
- 2023DragDiffusion: Harnessing Diffusion Models for Interactive Point-based Image Editingcited by 294
- 2024GeoWizard: Unleashing the Diffusion Priors for 3D Geometry Estimation from a Single Imagecited by 286
- 2022FlowFormer: A Transformer Architecture for Optical Flowcited by 275
- 2023Unleashing Text-to-Image Diffusion Models for Visual Perceptioncited by 269
- 2019DIODE: A Dense Indoor and Outdoor DEpth Datasetcited by 240
- 2022BBDM: Image-to-image Translation with Brownian Bridge Diffusion Modelscited by 225
- 2023A Variational Perspective on Solving Inverse Problems with Diffusion Modelscited by 222
- 2020Learning to Recover 3D Scene Shape from a Single Imagecited by 216
- 2022Dual Diffusion Implicit Bridges for Image-to-Image Translationcited by 213
- 2022CroCo v2: Improved Cross-view Completion Pre-training for Stereo Matching and Optical Flowcited by 166
- 2024StableNormal: Reducing Diffusion Variance for Stable and Sharp Normalcited by 154
- 2018Evaluation of CNN-based Single-Image Depth Estimation Methodscited by 138
- 2024Rethinking Inductive Biases for Surface Normal Estimationcited by 124
- 20223D Common Corruptions and Data Augmentationcited by 119
- 2021Estimating and Exploiting the Aleatoric Uncertainty in Surface Normal Estimationcited by 116
- 2024Fine-Tuning Image-Conditional Diffusion Models is Easier than You Thinkcited by 83
- 2023DiffusionDepth: Diffusion Denoising Approach for Monocular Depth Estimationcited by 82
- 2024DepthFM: Fast Monocular Depth Estimation with Flow Matchingcited by 76
- 2021STEP: Segmenting and Tracking Every Pixelcited by 73
- 2023Direct Diffusion Bridge using Data Consistency for Inverse Problemscited by 66
- 2020DiverseDepth: Affine-invariant Depth Prediction Using Diverse Datacited by 61
- 2022Hierarchical Normalization for Robust Monocular Depth Estimationcited by 52
- 2023Image Restoration Through Generalized Ornstein-Uhlenbeck Bridgecited by 41
- 2023Prompting Diffusion Representations for Cross-Domain Semantic Segmentationcited by 30
50 most cited of 56 All 56 (JSON)
Built on by
Citing papers per year: 2025: 5; 2026: 1.
6 papers.
- 2025Audio Super-Resolution with Latent Bridge Modelscited by 14
- 2025VRMDiff: Text-Guided Video Referring Matting Generation of Diffusioncited by 2
- 2025Towards General Modality Translation with Contrastive and Predictive Latent Diffusion Bridgecited by 2
- 2025Vision Bridge Transformer at Scalecited by 2
- 2026FLUX3D: High-Fidelity 3D Gaussian Generation with Diffusion-Aligned Sparse Representationcited by 1
- 2025FreeDNA: Endowing Domain Adaptation of Diffusion-Based Dense Prediction with Training-Free Domain Noise Alignmentcited by 0
- 2026FLUX3D: High-Fidelity 3D Gaussian Generation with Diffusion-Aligned Sparse Representation23 Jun 2026
- 2025Vision Bridge Transformer at Scale28 Nov 2025
- 2025Towards General Modality Translation with Contrastive and Predictive Latent Diffusion Bridge23 Oct 2025
- 2025Audio Super-Resolution with Latent Bridge Models22 Sep 2025
- 2025FreeDNA: Endowing Domain Adaptation of Diffusion-Based Dense Prediction with Training-Free Domain Noise Alignment26 Jun 2025
- 2025VRMDiff: Text-Guided Video Referring Matting Generation of Diffusion11 Mar 2025
Similar, not cited
Close in wording, no citation either way
- 2025Residual Prior Diffusion: A Probabilistic Framework Integrating Coarse Latent Priors with Diffusion Models
- 2023Exploiting Diffusion Prior for Generalizable Dense Prediction
- 2025D3-Predictor: Noise-Free Deterministic Diffusion for Dense Prediction
- 2023DDP: Diffusion Model for Dense Visual Prediction
- 2024Diffusion Models Need Visual Priors for Image Generation
- 2024Diffusion Models in Low-Level Vision: A Survey
- 2024Lotus: Diffusion-based Visual Foundation Model for High-quality Dense Prediction
- 2025Accelerating Diffusion Model Training under Minimal Budgets: A Condensation-Based Perspective