mlsanityData to 14 Oct 2026

Towards Depth Foundation Model: Recent Trends in Vision-Based Depth Estimation

arXiv 2507.11540 ↗First posted 15 Jul 2025cs.CVcited by 2

Not on the map. Why?

Abstract (arXiv)

Depth estimation is a fundamental task in 3D computer vision, crucial for applications such as 3D reconstruction, free-viewpoint rendering, robotics, autonomous driving, and AR/VR technologies. Traditional methods relying on hardware sensors like LiDAR are often limited by high costs, low resolution, and environmental sensitivity, limiting their applicability in real-world scenarios. Recent advances in vision-based methods offer a promising alternative, yet they face challenges in generalization and stability due to either the low-capacity model architectures or the reliance on domain-specific and small-scale datasets. The emergence of scaling laws and foundation models in other domains has inspired the development of "depth foundation models": deep neural networks trained on large datasets with strong zero-shot generalization capabilities. This paper surveys the evolution of deep learning architectures and paradigms for depth estimation across the monocular, stereo, multi-view, and monocular video settings. We explore the potential of these models to address existing challenges and provide a comprehensive overview of large-scale datasets that can facilitate their development. By identifying key architectures and training strategies, we aim to highlight the path towards robust depth foundation models, offering insights into their future research and applications.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 172 of its 222 references that are in the map. First posted on arXiv 15 Jul 2025.

Builds on

172 of 222 references.

References · 172

  1. 2017Attention Is All You Needcited by 60,361
  2. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  3. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  4. 2020Language Models are Few-Shot Learnerscited by 32,419
  5. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  6. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  7. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  8. 2023Segment Anythingcited by 8,234
  9. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
  10. 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,403
  11. 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
  12. 2016Densely Connected Convolutional Networkscited by 6,720
38 more
  1. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
  2. 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,523
  3. 2016The Cityscapes Dataset for Semantic Urban Scene Understandingcited by 4,444
  4. 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,117
  5. 2024SAM 2: Segment Anything in Images and Videoscited by 2,863
  6. 2019Scalability in Perception for Autonomous Driving: Waymo Open Datasetcited by 2,451
  7. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
  8. 2021Vision Transformers for Dense Predictioncited by 1,803
  9. 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,567
  10. 2025VGGT: Visual Geometry Grounded Transformercited by 1,539
  11. 2019Towards Robust Monocular Depth Estimation: Mixing Datasets for Zero-shot Cross-dataset Transfercited by 1,495
  12. 2024Depth Anything V2cited by 1,422
  13. 2017Matterport3D: Learning from RGB-D Data in Indoor Environmentscited by 1,376
  14. 2024Depth Anything: Unleashing the Power of Large-Scale Unlabeled Datacited by 1,360
  15. 2014Depth Map Prediction from a Single Image using a Multi-Scale Deep Networkcited by 1,274
  16. 2022CogVideo: Large-scale Pretraining for Text-to-Video Generation via Transformerscited by 985
  17. 2024Grounding Image Matching in 3D with MASt3Rcited by 983
  18. 2019The Replica Dataset: A Digital Replica of Indoor Spacescited by 904
  19. 2015A Large Dataset to Train Convolutional Networks for Disparity, Optical Flow, and Scene Flow Estimationcited by 881
  20. 2024WorldSimBench: Towards Video Generation Models as World Simulatorscited by 881
  21. 2016Unsupervised Monocular Depth Estimation with Left-Right Consistencycited by 820
  22. 2018MVSNet: Depth Inference for Unstructured Multi-view Stereocited by 788
  23. 2023ScanNet++: A High-Fidelity Dataset of 3D Indoor Scenescited by 764
  24. 2018MegaDepth: Learning Single-View Depth Prediction from Internet Photoscited by 737
  25. 2019Argoverse: 3D Tracking and Forecasting with Rich Mapscited by 732
  26. 2018Deep Ordinal Regression Network for Monocular Depth Estimationcited by 723
  27. 2023Argoverse 2: Next Generation Datasets for Self-Driving Perception and Forecastingcited by 707
  28. 2023ZoeDepth: Zero-shot Transfer by Combining Relative and Metric Depthcited by 657
  29. 2018Taskonomy: Disentangling Task Transfer Learningcited by 634
  30. 2020AdaBins: Depth Estimation using Adaptive Binscited by 601
  31. 2021Habitat-Matterport 3D Dataset (HM3D): 1000 Large-scale 3D Environments for Embodied AIcited by 592
  32. 2025Continuous 3D Perception Model with Persistent Statecited by 548
  33. 2020TartanAir: A Dataset to Push the Limits of Visual SLAMcited by 506
  34. 2019BlendedMVS: A Large-scale Dataset for Generalized Multi-view Stereo Networkscited by 490
  35. 2018Pyramid Stereo Matching Networkcited by 489
  36. 2014Predicting Depth, Surface Normals and Semantic Labels with a Common Multi-Scale Convolutional Architecturecited by 483
  37. 2022MonoSDF: Exploring Monocular Geometric Cues for Neural Implicit Surface Reconstructioncited by 470
  38. 2021ARKitScenes: A Diverse Real-World Dataset For 3D Indoor Scene Understanding Using Mobile RGB-D Datacited by 454

50 most cited of 172 All 172 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 1.

2 papers.