AnyDepth: Depth Estimation Made Easy
Not on the map. Why?
Abstract (arXiv)
Monocular depth estimation aims to recover the depth information of 3D scenes from 2D images. Recent work has made significant progress, but its reliance on large-scale datasets and complex decoders has limited its efficiency and generalization ability. In this paper, we propose a lightweight and data-centric framework for zero-shot monocular depth estimation. We first adopt DINOv3 as the visual encoder to obtain high-quality dense features. Secondly, to address the inherent drawbacks of the complex structure of the DPT, we design the Simple Depth Transformer (SDT), a compact transformer-based decoder. Compared to the DPT, it uses a single-path feature fusion and upsampling process to reduce the computational overhead of cross-scale feature fusion, achieving higher accuracy while reducing the number of parameters by approximately 85%-89%. Furthermore, we propose a quality-based filtering strategy to filter out harmful samples, thereby reducing dataset size while improving overall training quality. Extensive experiments on five benchmarks demonstrate that our framework surpasses the DPT in accuracy. This work highlights the importance of balancing model design and data quality for achieving efficient and generalizable zero-shot depth estimation. Code: https://github.com/AIGeeksGroup/AnyDepth. Website: https://aigeeksgroup.github.io/AnyDepth.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 62 of its 72 references that are in the map. First posted on arXiv 6 Jan 2026.
Builds on
62 of 72 references.
References · 62
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
- 2016Feature Pyramid Networks for Object Detectioncited by 5,021
- 2016Gaussian Error Linear Units (GELUs)cited by 3,431
- 2018Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentationcited by 3,210
- 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,088
- 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,006
- 2021BEiT: BERT Pre-Training of Image Transformerscited by 2,360
- 2021Pyramid Vision Transformer: A Versatile Backbone for Dense Prediction without Convolutionscited by 1,960
38 more
- 2021Vision Transformers for Dense Predictioncited by 1,789
- 2019Towards Robust Monocular Depth Estimation: Mixing Datasets for Zero-shot Cross-dataset Transfercited by 1,484
- 2024Depth Anything V2cited by 1,385
- 2024Depth Anything: Unleashing the Power of Large-Scale Unlabeled Datacited by 1,346
- 2025DINOv3cited by 1,297
- 2019EfficientDet: Scalable and Efficient Object Detectioncited by 1,018
- 2021Uformer: A General U-Shaped Transformer for Image Restorationcited by 864
- 2016Unsupervised Monocular Depth Estimation with Left-Right Consistencycited by 819
- 2018Path Aggregation Network for Instance Segmentationcited by 796
- 2023ZoeDepth: Zero-shot Transfer by Combining Relative and Metric Depthcited by 646
- 2020AdaBins: Depth Estimation using Adaptive Binscited by 596
- 2020Hypersim: A Photorealistic Synthetic Dataset for Holistic Indoor Scene Understandingcited by 593
- 2020TartanAir: A Dataset to Push the Limits of Visual SLAMcited by 494
- 2019BlendedMVS: A Large-scale Dataset for Generalized Multi-view Stereo Networkscited by 487
- 2014Predicting Depth, Surface Normals and Semantic Labels with a Common Multi-Scale Convolutional Architecturecited by 483
- 2019From Big to Small: Multi-Scale Local Planar Guidance for Monocular Depth Estimationcited by 379
- 2024UniDepth: Universal Monocular Metric Depth Estimationcited by 375
- 2020Virtual KITTI 2cited by 345
- 2021Omnidata: A Scalable Pipeline for Making Multi-Task Mid-Level Vision Datasets from 3D Scanscited by 336
- 2023Repurposing Diffusion-Based Image Generators for Monocular Depth Estimationcited by 323
- 2023FreeNeRF: Improving Few-shot Neural Rendering with Free Frequency Regularizationcited by 310
- 2019NAS-FPN: Learning Scalable Feature Pyramid Architecture for Object Detectioncited by 289
- 2024GeoWizard: Unleashing the Diffusion Priors for 3D Geometry Estimation from a Single Imagecited by 283
- 2024DNGaussian: Optimizing Sparse-View 3D Gaussian Radiance Fields with Global-Local Depth Normalizationcited by 256
- 2019DIODE: A Dense Indoor and Outdoor DEpth Datasetcited by 236
- 2020Learning to Recover 3D Scene Shape from a Single Imagecited by 214
- 2023Data-centric Artificial Intelligence: A Surveycited by 202
- 2016Single-Image Depth Perception in the Wildcited by 179
- 2023MiDaS v3.1 -- A Model Zoo for Robust Monocular Relative Depth Estimationcited by 173
- 2021Pixel Difference Networks for Efficient Edge Detectioncited by 167
- 2024Lotus: Diffusion-based Visual Foundation Model for High-quality Dense Predictioncited by 163
- 2022DepthFormer: Exploiting Long-Range Correlation and Local Information for Accurate Monocular Depth Estimationcited by 116
- 2024What Matters When Repurposing Diffusion Models for General Dense Perception Tasks?cited by 74
- 2019Bi-Directional Cascade Network for Perceptual Edge Detectioncited by 71
- 2020OASIS: A Large-Scale Dataset for Single Image 3D in the Wildcited by 62
- 2020DiverseDepth: Affine-invariant Depth Prediction Using Diverse Datacited by 60
- 2023Learning to Upsample by Learning to Samplecited by 57
- 20253D-R1: Enhancing Reasoning in 3D VLMs for Unified Scene Understandingcited by 47
50 most cited of 62 All 62 (JSON)
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026ColonSplat: Reconstruction of Peristaltic Motion in Colonoscopy with Dynamic Gaussian Splattingcited by 2
- 2026StereoAdapter-2: Globally Structure-Consistent Underwater Stereo Depth Estimationcited by 0
- 2026Last-Layer-Centric Feature Recombination: Unleashing 3D Geometric Knowledge in DINOv3 for Monocular Depth Estimationcited by 0
- 2026Monocular Depth Estimation from a Single Image: Progress and Opportunitiescited by 0
- 2026Monocular Depth Estimation from a Single Image: Progress and Opportunities1 Sep 2026
- 2026Last-Layer-Centric Feature Recombination: Unleashing 3D Geometric Knowledge in DINOv3 for Monocular Depth Estimation29 Apr 2026
- 2026ColonSplat: Reconstruction of Peristaltic Motion in Colonoscopy with Dynamic Gaussian Splatting6 Mar 2026
- 2026StereoAdapter-2: Globally Structure-Consistent Underwater Stereo Depth Estimation18 Feb 2026