Accuracy Does Not Guarantee Human-Likeness: Cross-Domain Human-Centered Benchmark in Monocular Depth Estimation
Not on the map. Why?
Abstract (arXiv)
Deep neural networks (DNNs) are increasingly used as functional models of human vision, yet standard monocular depth estimation (MDE) benchmarks largely evaluate physical accuracy rather than behavioral alignment with humans. We introduce a cross-domain behavioral benchmark that aligns newly collected human absolute-distance judgments, physical ground truth, and model predictions at 16 locations in each of 652 KITTI and 654 NYU Depth V2 scenes. Human-model similarity was measured image-wise by partial correlation between scale-and-shift-aligned estimates while controlling for physical depth, and reference results were obtained for 69 diverse MDE models. Human error patterns were highly reliable, and most models showed positive but substantially lower similarity to humans. Human similarity, however, did not increase monotonically with metric accuracy: within each dataset, high-accuracy models converged toward similar residual error structures that remained distinct from humans, while both human-similarity scores and error-space organization were only weakly preserved across datasets. Thus, physical accuracy and human-like behavior are complementary, domain-sensitive dimensions of MDE performance. Our benchmark will provide a reusable basis for assessing future models along both dimensions.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 34 of its 57 references that are in the map. First posted on arXiv 9 Dec 2025.
Builds on
34 of 57 references.
References · 34
- 2021Vision Transformers for Dense Predictioncited by 1,803
- 2019Towards Robust Monocular Depth Estimation: Mixing Datasets for Zero-shot Cross-dataset Transfercited by 1,495
- 2018ImageNet-trained CNNs are biased towards texture; increasing shape bias improves accuracy and robustnesscited by 1,432
- 2024Depth Anything: Unleashing the Power of Large-Scale Unlabeled Datacited by 1,360
- 2014Depth Map Prediction from a Single Image using a Multi-Scale Deep Networkcited by 1,274
- 2023Scaling Vision Transformers to 22 Billion Parameterscited by 694
- 2023ZoeDepth: Zero-shot Transfer by Combining Relative and Metric Depthcited by 657
- 2020AdaBins: Depth Estimation using Adaptive Binscited by 601
- 20193D Packing for Self-Supervised Monocular Depth Estimationcited by 439
- 2019From Big to Small: Multi-Scale Local Planar Guidance for Monocular Depth Estimationcited by 382
- 2023Metric3D: Towards Zero-shot Metric 3D Prediction from A Single Imagecited by 365
- 2021Omnidata: A Scalable Pipeline for Making Multi-Task Mid-Level Vision Datasets from 3D Scanscited by 336
22 more
- 2017Sparsity Invariant CNNscited by 326
- 2018Generalisation in humans and deep neural networkscited by 237
- 2019ReFusion: 3D Reconstruction in Dynamic Environments for RGB-D Cameras Exploiting Residualscited by 181
- 2016Single-Image Depth Perception in the Wildcited by 180
- 2023MiDaS v3.1 -- A Model Zoo for Robust Monocular Relative Depth Estimationcited by 174
- 2021Transformer-Based Attention Networks for Continuous Pixel-Wise Predictioncited by 125
- 2022Revealing the Dark Secrets of Masked Image Modelingcited by 117
- 2020Towards Better Generalization: Joint Depth-Pose Learning without PoseNetcited by 85
- 2021Unsupervised Scale-consistent Depth Learning from Videocited by 69
- 2022Global-Local Path Networks for Monocular Depth Estimation with Vertical CutDepthcited by 58
- 2022SC-DepthV3: Robust Self-supervised Monocular Depth Estimation for Dynamic Scenescited by 52
- 2021Toward Practical Monocular Indoor Depth Estimationcited by 42
- 2020P2Net: Patch-match and Plane-regularization for Unsupervised Indoor Depth Estimationcited by 41
- 2020Auto-Rectify Network for Unsupervised Indoor Depth Estimationcited by 39
- 2021StructDepth: Leveraging the structural regularities for self-supervised indoor depth estimationcited by 36
- 2022Do better ImageNet classifiers assess perceptual similarity better?cited by 34
- 2021Instance-wise Occlusion and Depth Orders in Natural Scenescited by 31
- 2024Deep Learning-based Depth Estimation Methods from Monocular Image and Videos: A Comprehensive Surveycited by 15
- 2023GasMono: Geometry-Aided Self-Supervised Monocular Depth Estimation for Indoor Scenescited by 13
- 2024Evaluating Multiview Object Consistency in Humans and Image Modelscited by 13
- 2023Deeper into Self-Supervised Monocular Indoor Depth Estimationcited by 7
- 2025Do Vision Transformers See Like Humans? Evaluating their Perceptual Alignmentcited by 2
Built on by
Not cited yet.