DepthFM: Fast Monocular Depth Estimation with Flow Matching
On the map: Diffusion models → 3D, point cloud and scene generation
Abstract (arXiv)
Current discriminative depth estimation methods often produce blurry artifacts, while generative approaches suffer from slow sampling due to curvatures in the noise-to-depth transport. Our method addresses these challenges by framing depth estimation as a direct transport between image and depth distributions. We are the first to explore flow matching in this field, and we demonstrate that its interpolation trajectories enhance both training and sampling efficiency while preserving high performance. While generative models typically require extensive training data, we mitigate this dependency by integrating external knowledge from a pre-trained image diffusion model, enabling effective transfer even across differing objectives. To further boost our model performance, we employ synthetic data and utilize image-depth pairs generated by a discriminative model on an in-the-wild image dataset. As a generative model, our model can reliably estimate depth confidence, which provides an additional advantage. Our approach achieves competitive zero-shot performance on standard benchmarks of complex natural scenes while improving sampling efficiency and only requiring minimal synthetic data for training.
Key facts. Cited by 76 papers in the map (data through 14 Oct 2026). Placed in 3D, point cloud and scene generation, one of 14 directions in Diffusion models. Builds on 66 of its 77 references that are in the map. First posted on arXiv 20 Mar 2024.
Builds on
66 of 77 references.
Closest ancestors · 4
Same direction, newest first
- 2023Zero-Shot Metric Depth with a Field-of-View Conditioned Diffusion Model20 Dec
- 2023The Surprising Effectiveness of Diffusion Models for Optical Flow and Monocular Depth Estimation2 Jun
- 2023Monocular Depth Estimation using Diffusion Models28 Feb
- 2022Fast Point Cloud Generation with Straight Flows4 Dec
Other references · 62
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
- 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,058
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,585
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
- 2022Flow Matching for Generative Modelingcited by 5,702
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
- 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,101
38 more
- 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,761
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
- 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,614
- 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,611
- 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,431
- 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,937
- 2021Vision Transformers for Dense Predictioncited by 1,803
- 2021Image Super-Resolution via Iterative Refinementcited by 1,511
- 2019Towards Robust Monocular Depth Estimation: Mixing Datasets for Zero-shot Cross-dataset Transfercited by 1,495
- 2021Palette: Image-to-Image Diffusion Modelscited by 1,300
- 2021Cascaded Diffusion Models for High Fidelity Image Generationcited by 1,163
- 2023Improving and generalizing flow-based generative models with minibatch optimal transportcited by 879
- 2018Deep Ordinal Regression Network for Monocular Depth Estimationcited by 723
- 2023ZoeDepth: Zero-shot Transfer by Combining Relative and Metric Depthcited by 657
- 2020Hypersim: A Photorealistic Synthetic Dataset for Holistic Indoor Scene Understandingcited by 604
- 2020AdaBins: Depth Estimation using Adaptive Binscited by 601
- 2022MonoSDF: Exploring Monocular Geometric Cues for Neural Implicit Surface Reconstructioncited by 470
- 20193D Packing for Self-Supervised Monocular Depth Estimationcited by 439
- 2023Metric3D: Towards Zero-shot Metric 3D Prediction from A Single Imagecited by 365
- 2021Omnidata: A Scalable Pipeline for Making Multi-Task Mid-Level Vision Datasets from 3D Scanscited by 336
- 2023Unleashing Text-to-Image Diffusion Models for Visual Perceptioncited by 269
- 2019DIODE: A Dense Indoor and Outdoor DEpth Datasetcited by 240
- 2022Imagen Editor and EditBench: Advancing and Evaluating Text-Guided Image Inpaintingcited by 233
- 2020Learning to Recover 3D Scene Shape from a Single Imagecited by 216
- 2020Non-Local Spatial Propagation Network for Depth Completioncited by 195
- 2022BinsFormer: Revisiting Adaptive Bins for Monocular Depth Estimationcited by 168
- 2023Flow Matching in Latent Spacecited by 160
- 2023DDP: Diffusion Model for Dense Visual Predictioncited by 148
- 2023Stochastic interpolants with data-dependent couplingscited by 100
- 2022A Generalist Framework for Panoptic Segmentation of Images and Videoscited by 99
- 2022LocalBins: Improving Depth Estimation by Learning Local Distributionscited by 94
- 2023CompletionFormer: Depth Completion with Convolutions and Vision Transformerscited by 93
- 2023Minimizing Trajectory Curvature of ODE-based Generative Modelscited by 89
- 2023DiffusionDepth: Diffusion Denoising Approach for Monocular Depth Estimationcited by 82
- 2022Hierarchical Normalization for Robust Monocular Depth Estimationcited by 52
- 2021DIML/CVL RGB-D Dataset: 2M RGB-D Images of Natural Indoor and Outdoor Scenescited by 46
- 2023Boosting Latent Diffusion with Flow Matchingcited by 44
- 2023Motion Flow Matching for Human Motion Synthesis and Editingcited by 38
50 most cited of 62 All 62 (JSON)
Built on by
Citing papers per year: 2024: 26; 2025: 40; 2026: 10.
76 papers.
Sort:
By area:
- 2024Depth Anything V2cited by 1,422
- 2025Qwen-Image Technical Reportcited by 1,044
- 2024Depth Pro: Sharp Monocular Metric Depth in Less Than a Secondcited by 404
- 2024MoGe: Unlocking Accurate Monocular Geometry Estimation for Open-Domain Images with Optimal Training Supervisioncited by 299
- 2025MoGe-2: Accurate Monocular Geometry with Metric Scale and Sharp Detailscited by 261
- 2025Representation Entanglement for Generation: Training Diffusion Transformers Is Much Easier Than You Thinkcited by 102
- 2024Learning Temporally Consistent Video Depth from Video Diffusion Priorscited by 100
- 2024Fine-Tuning Image-Conditional Diffusion Models is Easier than You Thinkcited by 83
- 2025Marigold: Affordable Adaptation of Diffusion-Based Image Generators for Image Analysiscited by 78
- 2024Depth Any Video with Scalable Synthetic Datacited by 57
- 2024Diffusion Models and Representation Learning: A Surveycited by 54
- 2024Marigold-DC: Zero-Shot Monocular Depth Completion with Guided Diffusioncited by 50
38 more
- 2025Dens3R: A Foundation Model for 3D Geometry Predictioncited by 46
- 2025DICEPTION: A Generalist Diffusion Model for Visual Perceptual Taskscited by 39
- 2025GeometryCrafter: Consistent Geometry Estimation for Open-world Videos with Diffusion Priorscited by 37
- 2025LBM: Latent Bridge Matching for Fast Image-to-Image Translationcited by 36
- 2025Decompositional Neural Scene Reconstruction with Generative Diffusion Priorcited by 31
- 2024Video Depth without Video Modelscited by 29
- 2025Diff2Flow: Training Flow Matching Models via Diffusion Model Alignmentcited by 29
- 2024BetterDepth: Plug-and-Play Diffusion Refiner for Zero-Shot Monocular Depth Estimationcited by 28
- 2024DepthLab: From Partial to Completecited by 27
- 2024FlowSDF: Flow Matching for Medical Image Segmentation Using Distance Transformscited by 25
- 2025TREAD: Token Routing for Efficient Architecture-agnostic Diffusion Trainingcited by 21
- 2025Multi-view Reconstruction via SfM-guided Monocular Depth Estimationcited by 20
- 2024DepthCues: Evaluating Monocular Depth Perception in Large Vision Modelscited by 19
- 2024Distillation of Diffusion Features for Semantic Correspondencecited by 17
- 2025Orchid: Image Latent Diffusion for Joint Appearance and Geometry Generationcited by 17
- 2025TIDE : Temporal-Aware Sparse Autoencoders for Interpretable Diffusion Transformers in Image Generationcited by 16
- 2025Ouroboros: Single-step Diffusion Models for Cycle-consistent Forward and Inverse Renderingcited by 16
- 2025Distill Any Depth: Distillation Creates a Stronger Monocular Depth Estimatorcited by 15
- 2025Zero-Shot Novel View and Depth Synthesis with Multi-View Geometric Diffusioncited by 12
- 2025MaskFlow: Discrete Flows For Flexible and Efficient Long Video Generationcited by 12
- 2025Depth Anything at Any Conditioncited by 12
- 2024DiMSUM: Diffusion Mamba -- A Scalable and Unified Spatial-Frequency Method for Image Generationcited by 11
- 2024[MASK] is All You Needcited by 11
- 2025JointDiT: Enhancing RGB-Depth Joint Modeling with Diffusion Transformerscited by 11
- 2024MOVIS: Enhancing Multi-Object Novel View Synthesis for Indoor Scenescited by 10
- 2025TACO: Taming Diffusion for in-the-wild Video Amodal Completioncited by 10
- 2024Towards Robust Monocular Depth Estimation in Non-Lambertian Surfacescited by 9
- 2024SuperMat: Physically Consistent PBR Material Estimation at Interactive Ratescited by 9
- 2025Fast Flow-based Visuomotor Policies via Conditional Optimal Transport Couplingscited by 9
- 2025UniGeo: Taming Video Diffusion for Unified Consistent Geometry Estimationcited by 9
- 2024SPIdepth: Strengthened Pose Information for Self-supervised Monocular Depth Estimationcited by 8
- 2025Symmetrical Flow Matching: Unified Image Generation, Segmentation, and Classification with Score-Based Generative Modelscited by 8
- 2025Color Transfer with Modulated Flowscited by 7
- 2025E3D-Bench: A Benchmark for End-to-End 3D Geometric Foundation Modelscited by 7
- 2024DPBridge: Latent Diffusion Bridge for Dense Predictioncited by 6
- 2025Zero-shot Depth Completion via Test-time Alignment with Affine-invariant Depth Priorcited by 6
- 2025Metric-Solver: Sliding Anchored Metric Depth Estimation from a Single Imagecited by 6
- 2024GeoBench: Benchmarking and Analyzing Monocular Geometry Estimation Modelscited by 5
50 most cited of 76 All 76 (JSON)
- 2026Weather-Conditioned Depth Anything4 Sep 2026
- 2026Contrastive-Augmented Flow Matching for Style-Content Disentanglement14 Jul 2026
- 2026Language-Assisted Super-Resolution from Real-World Low-Resolution Patches30 Jun 2026
- 2026UniGP: Taming Diffusion Transformer for Prior-Preserved Unified Generation and Perception29 Jun 2026
- 2026One Scene, Two Depths: Probing Geometric Ambiguity in Monocular Foundation Models28 Jun 2026
- 2026FLUX3D: High-Fidelity 3D Gaussian Generation with Diffusion-Aligned Sparse Representation23 Jun 2026
- 2026SCOPE: Scale-Consistent One-Pass Estimation of 3D Geometry19 Jun 2026
- 2026UniVidX: A Unified Multimodal Framework for Versatile Video Generation via Diffusion Priors1 May 2026
- 2026OASIS-DC: Generalizable Depth Completion via Output-level Alignment of Sparse-Integrated Monocular Pseudo Depth1 Feb 2026
- 2026GenDet: Painting Colored Bounding Boxes on Images via Diffusion Model for Object Detection12 Jan 2026
- 2025Visual Bridge: Universal Visual Perception Representations Generating11 Nov 2025
- 2025BoRe-Depth: Self-supervised Monocular Depth Estimation with Boundary Refinement for Embedded Systems6 Nov 2025
38 more
- 2025More Than Generation: Unifying Generation and Depth Estimation via Text-to-Image Diffusion Models27 Oct 2025
- 2025GeoDiff: Geometry-Guided Diffusion for Metric Depth Estimation21 Oct 2025
- 2025Ouroboros: Single-step Diffusion Models for Cycle-consistent Forward and Inverse Rendering20 Aug 2025
- 2025SCFlow: Implicitly Learning Style and Content Disentanglement with Flow Models5 Aug 2025
- 2025Qwen-Image Technical Report4 Aug 2025
- 2025Dens3R: A Foundation Model for 3D Geometry Prediction22 Jul 2025
- 2025Region-aware Depth Scale Adaptation with Sparse Measurements20 Jul 2025
- 2025MoGe-2: Accurate Monocular Geometry with Metric Scale and Sharp Details3 Jul 2025
- 2025Depth Anything at Any Condition2 Jul 2025
- 2025Representation Entanglement for Generation: Training Diffusion Transformers Is Much Easier Than You Think2 Jul 2025
- 2025DreamAnywhere: Object-Centric Panoramic 3D Scene Generation25 Jun 2025
- 2025Symmetrical Flow Matching: Unified Image Generation, Segmentation, and Classification with Score-Based Generative Models12 Jun 2025
- 2025StableMTL: Repurposing Latent Diffusion Models for Multi-Task Learning from Partially Annotated Synthetic Datasets9 Jun 2025
- 2025Diff2Flow: Training Flow Matching Models via Diffusion Model Alignment2 Jun 2025
- 2025E3D-Bench: A Benchmark for End-to-End 3D Geometric Foundation Models2 Jun 2025
- 2025UniGeo: Taming Video Diffusion for Unified Consistent Geometry Estimation30 May 2025
- 2025M3Depth: Wavelet-Enhanced Depth Estimation on Mars via Mutual Boosting of Dual-Modal Data20 May 2025
- 2025Marigold: Affordable Adaptation of Diffusion-Based Image Generators for Image Analysis14 May 2025
- 2025Fast Flow-based Visuomotor Policies via Conditional Optimal Transport Couplings2 May 2025
- 2025JointDiT: Enhancing RGB-Depth Joint Modeling with Diffusion Transformers1 May 2025
- 2025Metric-Solver: Sliding Anchored Metric Depth Estimation from a Single Image16 Apr 2025
- 2025GeometryCrafter: Consistent Geometry Estimation for Open-world Videos with Diffusion Priors1 Apr 2025
- 2025Color Transfer with Modulated Flows24 Mar 2025
- 2025Decompositional Neural Scene Reconstruction with Generative Diffusion Prior19 Mar 2025
- 2025Multi-view Reconstruction via SfM-guided Monocular Depth Estimation18 Mar 2025
- 2025Niagara: Normal-Integrated Geometric Affine Field for Scene Reconstruction from a Single View16 Mar 2025
- 2025TACO: Taming Diffusion for in-the-wild Video Amodal Completion15 Mar 2025
- 2025LBM: Latent Bridge Matching for Fast Image-to-Image Translation10 Mar 2025
- 2025TIDE : Temporal-Aware Sparse Autoencoders for Interpretable Diffusion Transformers in Image Generation10 Mar 2025
- 2025Towards Ambiguity-Free Spatial Foundation Model: Rethinking and Decoupling Depth Ambiguity8 Mar 2025
- 2025Distill Any Depth: Distillation Creates a Stronger Monocular Depth Estimator26 Feb 2025
- 2025DICEPTION: A Generalist Diffusion Model for Visual Perceptual Tasks24 Feb 2025
- 2025MaskFlow: Discrete Flows For Flexible and Efficient Long Video Generation16 Feb 2025
- 2025Zero-shot Depth Completion via Test-time Alignment with Affine-invariant Depth Prior10 Feb 2025
- 2025Zero-Shot Novel View and Depth Synthesis with Multi-View Geometric Diffusion30 Jan 2025
- 2025Rethinking Encoder-Decoder Flow Through Shared Structures24 Jan 2025
- 2025Orchid: Image Latent Diffusion for Joint Appearance and Geometry Generation22 Jan 2025
- 2025TREAD: Token Routing for Efficient Architecture-agnostic Diffusion Training8 Jan 2025
50 newest of 76 All 76 (JSON)
- 2025Representation Entanglement for Generation: Training Diffusion Transformers Is Much Easier Than You Thinkcited by 102
- 2024Learning Temporally Consistent Video Depth from Video Diffusion Priorscited by 100
- 2024Fine-Tuning Image-Conditional Diffusion Models is Easier than You Thinkcited by 83
- 2025Marigold: Affordable Adaptation of Diffusion-Based Image Generators for Image Analysiscited by 78
- 2024Depth Any Video with Scalable Synthetic Datacited by 57
- 2024Diffusion Models and Representation Learning: A Surveycited by 54
- 2024Marigold-DC: Zero-Shot Monocular Depth Completion with Guided Diffusioncited by 50
- 2025DICEPTION: A Generalist Diffusion Model for Visual Perceptual Taskscited by 39
- 2025GeometryCrafter: Consistent Geometry Estimation for Open-world Videos with Diffusion Priorscited by 37
- 2025Decompositional Neural Scene Reconstruction with Generative Diffusion Priorcited by 31
- 2025Diff2Flow: Training Flow Matching Models via Diffusion Model Alignmentcited by 29
- 2024FlowSDF: Flow Matching for Medical Image Segmentation Using Distance Transformscited by 25
12 most cited of 39 All 39 (JSON)
- 2026Contrastive-Augmented Flow Matching for Style-Content Disentanglement14 Jul 2026
- 2026UniGP: Taming Diffusion Transformer for Prior-Preserved Unified Generation and Perception29 Jun 2026
- 2026FLUX3D: High-Fidelity 3D Gaussian Generation with Diffusion-Aligned Sparse Representation23 Jun 2026
- 2026UniVidX: A Unified Multimodal Framework for Versatile Video Generation via Diffusion Priors1 May 2026
- 2026GenDet: Painting Colored Bounding Boxes on Images via Diffusion Model for Object Detection12 Jan 2026
- 2025Visual Bridge: Universal Visual Perception Representations Generating11 Nov 2025
- 2025More Than Generation: Unifying Generation and Depth Estimation via Text-to-Image Diffusion Models27 Oct 2025
- 2025GeoDiff: Geometry-Guided Diffusion for Metric Depth Estimation21 Oct 2025
- 2025Ouroboros: Single-step Diffusion Models for Cycle-consistent Forward and Inverse Rendering20 Aug 2025
- 2025SCFlow: Implicitly Learning Style and Content Disentanglement with Flow Models5 Aug 2025
- 2025Representation Entanglement for Generation: Training Diffusion Transformers Is Much Easier Than You Think2 Jul 2025
- 2025Symmetrical Flow Matching: Unified Image Generation, Segmentation, and Classification with Score-Based Generative Models12 Jun 2025
12 newest of 39 All 39 (JSON)
- 2024Depth Anything V2cited by 1,422
- 2025Qwen-Image Technical Reportcited by 1,044
- 2024Depth Pro: Sharp Monocular Metric Depth in Less Than a Secondcited by 404
- 2024MoGe: Unlocking Accurate Monocular Geometry Estimation for Open-Domain Images with Optimal Training Supervisioncited by 299
- 2025MoGe-2: Accurate Monocular Geometry with Metric Scale and Sharp Detailscited by 261
- 2025Dens3R: A Foundation Model for 3D Geometry Predictioncited by 46
- 2025LBM: Latent Bridge Matching for Fast Image-to-Image Translationcited by 36
- 2024Video Depth without Video Modelscited by 29
- 2024BetterDepth: Plug-and-Play Diffusion Refiner for Zero-Shot Monocular Depth Estimationcited by 28
- 2024DepthLab: From Partial to Completecited by 27
- 2025Multi-view Reconstruction via SfM-guided Monocular Depth Estimationcited by 20
- 2024DepthCues: Evaluating Monocular Depth Perception in Large Vision Modelscited by 19
12 most cited of 37 All 37 (JSON)
- 2026Weather-Conditioned Depth Anything4 Sep 2026
- 2026Language-Assisted Super-Resolution from Real-World Low-Resolution Patches30 Jun 2026
- 2026One Scene, Two Depths: Probing Geometric Ambiguity in Monocular Foundation Models28 Jun 2026
- 2026SCOPE: Scale-Consistent One-Pass Estimation of 3D Geometry19 Jun 2026
- 2026OASIS-DC: Generalizable Depth Completion via Output-level Alignment of Sparse-Integrated Monocular Pseudo Depth1 Feb 2026
- 2025BoRe-Depth: Self-supervised Monocular Depth Estimation with Boundary Refinement for Embedded Systems6 Nov 2025
- 2025Qwen-Image Technical Report4 Aug 2025
- 2025Dens3R: A Foundation Model for 3D Geometry Prediction22 Jul 2025
- 2025Region-aware Depth Scale Adaptation with Sparse Measurements20 Jul 2025
- 2025MoGe-2: Accurate Monocular Geometry with Metric Scale and Sharp Details3 Jul 2025
- 2025Depth Anything at Any Condition2 Jul 2025
- 2025DreamAnywhere: Object-Centric Panoramic 3D Scene Generation25 Jun 2025
12 newest of 37 All 37 (JSON)
Similar, not cited
Close in wording, no citation either way
- 2026Marigold V2: Revisiting Diffusion Transformers for Monocular Depth Estimation
- 2024Diffusion Models for Monocular Depth Estimation: Overcoming Challenging Conditions
- 2024Unsupervised Monocular Depth Estimation Based on Hierarchical Feature-Guided Diffusion
- 2025DepthMaster: Taming Diffusion Models for Monocular Depth Estimation
- 2026Iris: Bringing Real-World Priors into Diffusion Model for Monocular Depth Estimation
- 2024DepthART: Monocular Depth Estimation as Autoregressive Refinement Task
- 2023Repurposing Diffusion-Based Image Generators for Monocular Depth Estimation
- 2025Leveraging Stable Diffusion for Monocular Depth Estimation via Image Semantic Encoding