Towards Depth Foundation Model: Recent Trends in Vision-Based Depth Estimation
Not on the map. Why?
Abstract (arXiv)
Depth estimation is a fundamental task in 3D computer vision, crucial for applications such as 3D reconstruction, free-viewpoint rendering, robotics, autonomous driving, and AR/VR technologies. Traditional methods relying on hardware sensors like LiDAR are often limited by high costs, low resolution, and environmental sensitivity, limiting their applicability in real-world scenarios. Recent advances in vision-based methods offer a promising alternative, yet they face challenges in generalization and stability due to either the low-capacity model architectures or the reliance on domain-specific and small-scale datasets. The emergence of scaling laws and foundation models in other domains has inspired the development of "depth foundation models": deep neural networks trained on large datasets with strong zero-shot generalization capabilities. This paper surveys the evolution of deep learning architectures and paradigms for depth estimation across the monocular, stereo, multi-view, and monocular video settings. We explore the potential of these models to address existing challenges and provide a comprehensive overview of large-scale datasets that can facilitate their development. By identifying key architectures and training strategies, we aim to highlight the path towards robust depth foundation models, offering insights into their future research and applications.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 172 of its 222 references that are in the map. First posted on arXiv 15 Jul 2025.
Builds on
172 of 222 references.
References · 172
- 2017Attention Is All You Needcited by 60,361
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2023Segment Anythingcited by 8,234
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,403
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
- 2016Densely Connected Convolutional Networkscited by 6,720
38 more
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
- 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,523
- 2016The Cityscapes Dataset for Semantic Urban Scene Understandingcited by 4,444
- 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,117
- 2024SAM 2: Segment Anything in Images and Videoscited by 2,863
- 2019Scalability in Perception for Autonomous Driving: Waymo Open Datasetcited by 2,451
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
- 2021Vision Transformers for Dense Predictioncited by 1,803
- 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,567
- 2025VGGT: Visual Geometry Grounded Transformercited by 1,539
- 2019Towards Robust Monocular Depth Estimation: Mixing Datasets for Zero-shot Cross-dataset Transfercited by 1,495
- 2024Depth Anything V2cited by 1,422
- 2017Matterport3D: Learning from RGB-D Data in Indoor Environmentscited by 1,376
- 2024Depth Anything: Unleashing the Power of Large-Scale Unlabeled Datacited by 1,360
- 2014Depth Map Prediction from a Single Image using a Multi-Scale Deep Networkcited by 1,274
- 2022CogVideo: Large-scale Pretraining for Text-to-Video Generation via Transformerscited by 985
- 2024Grounding Image Matching in 3D with MASt3Rcited by 983
- 2019The Replica Dataset: A Digital Replica of Indoor Spacescited by 904
- 2015A Large Dataset to Train Convolutional Networks for Disparity, Optical Flow, and Scene Flow Estimationcited by 881
- 2024WorldSimBench: Towards Video Generation Models as World Simulatorscited by 881
- 2016Unsupervised Monocular Depth Estimation with Left-Right Consistencycited by 820
- 2018MVSNet: Depth Inference for Unstructured Multi-view Stereocited by 788
- 2023ScanNet++: A High-Fidelity Dataset of 3D Indoor Scenescited by 764
- 2018MegaDepth: Learning Single-View Depth Prediction from Internet Photoscited by 737
- 2019Argoverse: 3D Tracking and Forecasting with Rich Mapscited by 732
- 2018Deep Ordinal Regression Network for Monocular Depth Estimationcited by 723
- 2023Argoverse 2: Next Generation Datasets for Self-Driving Perception and Forecastingcited by 707
- 2023ZoeDepth: Zero-shot Transfer by Combining Relative and Metric Depthcited by 657
- 2018Taskonomy: Disentangling Task Transfer Learningcited by 634
- 2020AdaBins: Depth Estimation using Adaptive Binscited by 601
- 2021Habitat-Matterport 3D Dataset (HM3D): 1000 Large-scale 3D Environments for Embodied AIcited by 592
- 2025Continuous 3D Perception Model with Persistent Statecited by 548
- 2020TartanAir: A Dataset to Push the Limits of Visual SLAMcited by 506
- 2019BlendedMVS: A Large-scale Dataset for Generalized Multi-view Stereo Networkscited by 490
- 2018Pyramid Stereo Matching Networkcited by 489
- 2014Predicting Depth, Surface Normals and Semantic Labels with a Common Multi-Scale Convolutional Architecturecited by 483
- 2022MonoSDF: Exploring Monocular Geometric Cues for Neural Implicit Surface Reconstructioncited by 470
- 2021ARKitScenes: A Diverse Real-World Dataset For 3D Indoor Scene Understanding Using Mobile RGB-D Datacited by 454
50 most cited of 172 All 172 (JSON)
Built on by
Citing papers per year: 2025: 1; 2026: 1.
2 papers.