mlsanityData to 14 Oct 2026

DepthFM: Fast Monocular Depth Estimation with Flow Matching

arXiv 2403.13788 ↗First posted 20 Mar 2024cs.CVcited by 76

On the map: Diffusion models → 3D, point cloud and scene generation

Abstract (arXiv)

Current discriminative depth estimation methods often produce blurry artifacts, while generative approaches suffer from slow sampling due to curvatures in the noise-to-depth transport. Our method addresses these challenges by framing depth estimation as a direct transport between image and depth distributions. We are the first to explore flow matching in this field, and we demonstrate that its interpolation trajectories enhance both training and sampling efficiency while preserving high performance. While generative models typically require extensive training data, we mitigate this dependency by integrating external knowledge from a pre-trained image diffusion model, enabling effective transfer even across differing objectives. To further boost our model performance, we employ synthetic data and utilize image-depth pairs generated by a discriminative model on an in-the-wild image dataset. As a generative model, our model can reliably estimate depth confidence, which provides an additional advantage. Our approach achieves competitive zero-shot performance on standard benchmarks of complex natural scenes while improving sampling efficiency and only requiring minimal synthetic data for training.

Key facts. Cited by 76 papers in the map (data through 14 Oct 2026). Placed in 3D, point cloud and scene generation, one of 14 directions in Diffusion models. Builds on 66 of its 77 references that are in the map. First posted on arXiv 20 Mar 2024.

Builds on

66 of 77 references.

Closest ancestors · 4

Same direction, newest first

  1. 2023Zero-Shot Metric Depth with a Field-of-View Conditioned Diffusion Model20 Dec
  2. 2023The Surprising Effectiveness of Diffusion Models for Optical Flow and Monocular Depth Estimation2 Jun
  3. 2023Monocular Depth Estimation using Diffusion Models28 Feb
  4. 2022Fast Point Cloud Generation with Straight Flows4 Dec

Other references · 62

  1. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  2. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  4. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
  5. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
  6. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,058
  7. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,585
  8. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
  9. 2022Flow Matching for Generative Modelingcited by 5,702
  10. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
  11. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
  12. 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,101
38 more
  1. 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,761
  2. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
  3. 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,614
  4. 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,611
  5. 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,431
  6. 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,937
  7. 2021Vision Transformers for Dense Predictioncited by 1,803
  8. 2021Image Super-Resolution via Iterative Refinementcited by 1,511
  9. 2019Towards Robust Monocular Depth Estimation: Mixing Datasets for Zero-shot Cross-dataset Transfercited by 1,495
  10. 2021Palette: Image-to-Image Diffusion Modelscited by 1,300
  11. 2021Cascaded Diffusion Models for High Fidelity Image Generationcited by 1,163
  12. 2023Improving and generalizing flow-based generative models with minibatch optimal transportcited by 879
  13. 2018Deep Ordinal Regression Network for Monocular Depth Estimationcited by 723
  14. 2023ZoeDepth: Zero-shot Transfer by Combining Relative and Metric Depthcited by 657
  15. 2020Hypersim: A Photorealistic Synthetic Dataset for Holistic Indoor Scene Understandingcited by 604
  16. 2020AdaBins: Depth Estimation using Adaptive Binscited by 601
  17. 2022MonoSDF: Exploring Monocular Geometric Cues for Neural Implicit Surface Reconstructioncited by 470
  18. 20193D Packing for Self-Supervised Monocular Depth Estimationcited by 439
  19. 2023Metric3D: Towards Zero-shot Metric 3D Prediction from A Single Imagecited by 365
  20. 2021Omnidata: A Scalable Pipeline for Making Multi-Task Mid-Level Vision Datasets from 3D Scanscited by 336
  21. 2023Unleashing Text-to-Image Diffusion Models for Visual Perceptioncited by 269
  22. 2019DIODE: A Dense Indoor and Outdoor DEpth Datasetcited by 240
  23. 2022Imagen Editor and EditBench: Advancing and Evaluating Text-Guided Image Inpaintingcited by 233
  24. 2020Learning to Recover 3D Scene Shape from a Single Imagecited by 216
  25. 2020Non-Local Spatial Propagation Network for Depth Completioncited by 195
  26. 2022BinsFormer: Revisiting Adaptive Bins for Monocular Depth Estimationcited by 168
  27. 2023Flow Matching in Latent Spacecited by 160
  28. 2023DDP: Diffusion Model for Dense Visual Predictioncited by 148
  29. 2023Stochastic interpolants with data-dependent couplingscited by 100
  30. 2022A Generalist Framework for Panoptic Segmentation of Images and Videoscited by 99
  31. 2022LocalBins: Improving Depth Estimation by Learning Local Distributionscited by 94
  32. 2023CompletionFormer: Depth Completion with Convolutions and Vision Transformerscited by 93
  33. 2023Minimizing Trajectory Curvature of ODE-based Generative Modelscited by 89
  34. 2023DiffusionDepth: Diffusion Denoising Approach for Monocular Depth Estimationcited by 82
  35. 2022Hierarchical Normalization for Robust Monocular Depth Estimationcited by 52
  36. 2021DIML/CVL RGB-D Dataset: 2M RGB-D Images of Natural Indoor and Outdoor Scenescited by 46
  37. 2023Boosting Latent Diffusion with Flow Matchingcited by 44
  38. 2023Motion Flow Matching for Human Motion Synthesis and Editingcited by 38

50 most cited of 62 All 62 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 26; 2025: 40; 2026: 10.

76 papers.

Sort:

By area:

  1. 2024Depth Anything V2cited by 1,422
  2. 2025Qwen-Image Technical Reportcited by 1,044
  3. 2024Depth Pro: Sharp Monocular Metric Depth in Less Than a Secondcited by 404
  4. 2024MoGe: Unlocking Accurate Monocular Geometry Estimation for Open-Domain Images with Optimal Training Supervisioncited by 299
  5. 2025MoGe-2: Accurate Monocular Geometry with Metric Scale and Sharp Detailscited by 261
  6. 2025Representation Entanglement for Generation: Training Diffusion Transformers Is Much Easier Than You Thinkcited by 102
  7. 2024Learning Temporally Consistent Video Depth from Video Diffusion Priorscited by 100
  8. 2024Fine-Tuning Image-Conditional Diffusion Models is Easier than You Thinkcited by 83
  9. 2025Marigold: Affordable Adaptation of Diffusion-Based Image Generators for Image Analysiscited by 78
  10. 2024Depth Any Video with Scalable Synthetic Datacited by 57
  11. 2024Diffusion Models and Representation Learning: A Surveycited by 54
  12. 2024Marigold-DC: Zero-Shot Monocular Depth Completion with Guided Diffusioncited by 50
38 more
  1. 2025Dens3R: A Foundation Model for 3D Geometry Predictioncited by 46
  2. 2025DICEPTION: A Generalist Diffusion Model for Visual Perceptual Taskscited by 39
  3. 2025GeometryCrafter: Consistent Geometry Estimation for Open-world Videos with Diffusion Priorscited by 37
  4. 2025LBM: Latent Bridge Matching for Fast Image-to-Image Translationcited by 36
  5. 2025Decompositional Neural Scene Reconstruction with Generative Diffusion Priorcited by 31
  6. 2024Video Depth without Video Modelscited by 29
  7. 2025Diff2Flow: Training Flow Matching Models via Diffusion Model Alignmentcited by 29
  8. 2024BetterDepth: Plug-and-Play Diffusion Refiner for Zero-Shot Monocular Depth Estimationcited by 28
  9. 2024DepthLab: From Partial to Completecited by 27
  10. 2024FlowSDF: Flow Matching for Medical Image Segmentation Using Distance Transformscited by 25
  11. 2025TREAD: Token Routing for Efficient Architecture-agnostic Diffusion Trainingcited by 21
  12. 2025Multi-view Reconstruction via SfM-guided Monocular Depth Estimationcited by 20
  13. 2024DepthCues: Evaluating Monocular Depth Perception in Large Vision Modelscited by 19
  14. 2024Distillation of Diffusion Features for Semantic Correspondencecited by 17
  15. 2025Orchid: Image Latent Diffusion for Joint Appearance and Geometry Generationcited by 17
  16. 2025TIDE : Temporal-Aware Sparse Autoencoders for Interpretable Diffusion Transformers in Image Generationcited by 16
  17. 2025Ouroboros: Single-step Diffusion Models for Cycle-consistent Forward and Inverse Renderingcited by 16
  18. 2025Distill Any Depth: Distillation Creates a Stronger Monocular Depth Estimatorcited by 15
  19. 2025Zero-Shot Novel View and Depth Synthesis with Multi-View Geometric Diffusioncited by 12
  20. 2025MaskFlow: Discrete Flows For Flexible and Efficient Long Video Generationcited by 12
  21. 2025Depth Anything at Any Conditioncited by 12
  22. 2024DiMSUM: Diffusion Mamba -- A Scalable and Unified Spatial-Frequency Method for Image Generationcited by 11
  23. 2024[MASK] is All You Needcited by 11
  24. 2025JointDiT: Enhancing RGB-Depth Joint Modeling with Diffusion Transformerscited by 11
  25. 2024MOVIS: Enhancing Multi-Object Novel View Synthesis for Indoor Scenescited by 10
  26. 2025TACO: Taming Diffusion for in-the-wild Video Amodal Completioncited by 10
  27. 2024Towards Robust Monocular Depth Estimation in Non-Lambertian Surfacescited by 9
  28. 2024SuperMat: Physically Consistent PBR Material Estimation at Interactive Ratescited by 9
  29. 2025Fast Flow-based Visuomotor Policies via Conditional Optimal Transport Couplingscited by 9
  30. 2025UniGeo: Taming Video Diffusion for Unified Consistent Geometry Estimationcited by 9
  31. 2024SPIdepth: Strengthened Pose Information for Self-supervised Monocular Depth Estimationcited by 8
  32. 2025Symmetrical Flow Matching: Unified Image Generation, Segmentation, and Classification with Score-Based Generative Modelscited by 8
  33. 2025Color Transfer with Modulated Flowscited by 7
  34. 2025E3D-Bench: A Benchmark for End-to-End 3D Geometric Foundation Modelscited by 7
  35. 2024DPBridge: Latent Diffusion Bridge for Dense Predictioncited by 6
  36. 2025Zero-shot Depth Completion via Test-time Alignment with Affine-invariant Depth Priorcited by 6
  37. 2025Metric-Solver: Sliding Anchored Metric Depth Estimation from a Single Imagecited by 6
  38. 2024GeoBench: Benchmarking and Analyzing Monocular Geometry Estimation Modelscited by 5

50 most cited of 76 All 76 (JSON)

Similar, not cited

Close in wording, no citation either way

  1. 2026Marigold V2: Revisiting Diffusion Transformers for Monocular Depth Estimation
  2. 2024Diffusion Models for Monocular Depth Estimation: Overcoming Challenging Conditions
  3. 2024Unsupervised Monocular Depth Estimation Based on Hierarchical Feature-Guided Diffusion
  4. 2025DepthMaster: Taming Diffusion Models for Monocular Depth Estimation
  5. 2026Iris: Bringing Real-World Priors into Diffusion Model for Monocular Depth Estimation
  6. 2024DepthART: Monocular Depth Estimation as Autoregressive Refinement Task
  7. 2023Repurposing Diffusion-Based Image Generators for Monocular Depth Estimation
  8. 2025Leveraging Stable Diffusion for Monocular Depth Estimation via Image Semantic Encoding