The Midas Touch for Metric Depth
Not on the map. Why?
Abstract (arXiv)
Recent advances have markedly improved the cross-scene generalization of relative depth estimation, yet its practical applicability remains limited by the absence of metric scale, local inconsistencies, and low computational efficiency. To address these issues, we present emphMidas Touch for Depth (MTD), a mathematically interpretable approach that converts relative depth into metric depth using only extremely sparse 3D data. To eliminate local scale inconsistencies, it applies a segment-wise recovery strategy via sparse graph optimization, followed by a pixel-wise refinement strategy using a discontinuity-aware geodesic cost. MTD exhibits strong generalization and achieves substantial accuracy improvements over previous depth completion and depth estimation methods. Moreover, its lightweight, plug-and-play design facilitates deployment and integration on diverse downstream 3D tasks. Project page is available at https://mias.group/MTD.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 64 of its 81 references that are in the map. First posted on arXiv 12 May 2026.
Builds on
64 of 81 references.
References · 64
- 2023Segment Anythingcited by 8,234
- 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,523
- 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,117
- 2021Vision Transformers for Dense Predictioncited by 1,803
- 2020pixelNeRF: Neural Radiance Fields from One or Few Imagescited by 1,584
- 2025VGGT: Visual Geometry Grounded Transformercited by 1,539
- 2019Towards Robust Monocular Depth Estimation: Mixing Datasets for Zero-shot Cross-dataset Transfercited by 1,495
- 2024Depth Anything V2cited by 1,422
- 2024Depth Anything: Unleashing the Power of Large-Scale Unlabeled Datacited by 1,360
- 2014Depth Map Prediction from a Single Image using a Multi-Scale Deep Networkcited by 1,274
- 2021LoFTR: Detector-Free Local Feature Matching with Transformerscited by 984
- 2016Unsupervised Monocular Depth Estimation with Left-Right Consistencycited by 820
38 more
- 2021DROID-SLAM: Deep Visual SLAM for Monocular, Stereo, and RGB-D Camerascited by 687
- 2020Hypersim: A Photorealistic Synthetic Dataset for Holistic Indoor Scene Understandingcited by 604
- 2020TartanAir: A Dataset to Push the Limits of Visual SLAMcited by 506
- 20193D Packing for Self-Supervised Monocular Depth Estimationcited by 439
- 2024Depth Pro: Sharp Monocular Metric Depth in Less Than a Secondcited by 404
- 2024Metric3Dv2: A Versatile Monocular Geometric Foundation Model for Zero-shot Metric Depth and Surface Normal Estimationcited by 395
- 2024UniDepth: Universal Monocular Metric Depth Estimationcited by 382
- 2023Metric3D: Towards Zero-shot Metric 3D Prediction from A Single Imagecited by 365
- 2020Virtual KITTI 2cited by 353
- 2021RAFT-Stereo: Multilevel Recurrent Field Transforms for Stereo Matchingcited by 353
- 2023Faster Segment Anything: Towards Lightweight SAM for Mobile Applicationscited by 352
- 2021Omnidata: A Scalable Pipeline for Making Multi-Task Mid-Level Vision Datasets from 3D Scanscited by 336
- 2023Repurposing Diffusion-Based Image Generators for Monocular Depth Estimationcited by 327
- 2024GeoWizard: Unleashing the Diffusion Priors for 3D Geometry Estimation from a Single Imagecited by 286
- 2019DIODE: A Dense Indoor and Outdoor DEpth Datasetcited by 240
- 2022TinyViT: Fast Pretraining Distillation for Small Vision Transformerscited by 234
- 2020Learning to Recover 3D Scene Shape from a Single Imagecited by 216
- 2020Non-Local Spatial Propagation Network for Depth Completioncited by 195
- 2023Iterative Geometry Encoding Volume for Stereo Matchingcited by 190
- 2023EfficientSAM: Leveraged Masked Image Pretraining for Efficient Segment Anythingcited by 188
- 2023MiDaS v3.1 -- A Model Zoo for Robust Monocular Relative Depth Estimationcited by 174
- 2025UniDepthV2: Universal Monocular Metric Depth Estimation Made Simplercited by 173
- 2023EfficientViT: Memory Efficient Vision Transformer with Cascaded Group Attentioncited by 172
- 2024Lotus: Diffusion-based Visual Foundation Model for High-quality Dense Predictioncited by 166
- 2018Depth Estimation via Affinity Learned with Convolutional Spatial Propagation Networkcited by 110
- 2019Domain-invariant Stereo Matching Networkscited by 109
- 2022Lite-Mono: A Lightweight CNN and Transformer Architecture for Self-Supervised Monocular Depth Estimationcited by 100
- 2024Selective-Stereo: Adaptive Frequency Information Selection for Stereo Matchingcited by 99
- 2023CompletionFormer: Depth Completion with Convolutions and Vision Transformerscited by 93
- 2019Unsupervised Depth Completion from Visual Inertial Odometrycited by 89
- 2024Prompting Depth Anything for 4K Resolution Accurate Metric Depth Estimationcited by 74
- 2022Dynamic Spatial Propagation Network for Depth Completioncited by 71
- 2023Behind the Scenes: Density Fields for Single View Reconstructioncited by 63
- 2020DiverseDepth: Affine-invariant Depth Prediction Using Diverse Datacited by 61
- 2024Bilateral Propagation Network for Depth Completioncited by 60
- 2024IGEV++: Iterative Multi-range Geometry Encoding Volumes for Stereo Matchingcited by 59
- 2022Hierarchical Normalization for Robust Monocular Depth Estimationcited by 52
- 2024Marigold-DC: Zero-Shot Monocular Depth Completion with Guided Diffusioncited by 50
50 most cited of 64 All 64 (JSON)
Built on by
Citing papers per year: 2026: 2.
2 papers.