mlsanityData to 14 Oct 2026

ViewpointDepth: A New Dataset for Monocular Depth Estimation Under Viewpoint Shifts

arXiv 2409.17851 ↗First posted 26 Sep 2024cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Monocular depth estimation is a critical task for autonomous driving and many other computer vision applications. While significant progress has been made in this field, the effects of viewpoint shifts on depth estimation models remain largely underexplored. This paper introduces a novel dataset and evaluation methodology to quantify the impact of different camera positions and orientations on monocular depth estimation performance. We propose a ground truth strategy based on homography estimation and object detection, eliminating the need for expensive LIDAR sensors. We collect a diverse dataset of road scenes from multiple viewpoints and use it to assess the robustness of a modern depth estimation model to geometric shifts. After assessing the validity of our strategy on a public dataset, we provide valuable insights into the limitations of current models and highlight the importance of considering viewpoint variations in real-world applications.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 18 of its 28 references that are in the map. First posted on arXiv 26 Sep 2024.

Builds on

18 of 28 references.

References · 18

  1. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  2. 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,523
  3. 2019Scalability in Perception for Autonomous Driving: Waymo Open Datasetcited by 2,451
  4. 2015Spatial Transformer Networkscited by 1,429
  5. 2018BDD100K: A Diverse Driving Dataset for Heterogeneous Multitask Learningcited by 1,288
  6. 2014Depth Map Prediction from a Single Image using a Multi-Scale Deep Networkcited by 1,274
  7. 2017Unsupervised Learning of Depth and Ego-Motion from Videocited by 782
  8. 2019WoodScape: A multi-task, multi-camera fisheye dataset for autonomous drivingcited by 144
  9. 2022MonoViT: Self-Supervised Monocular Depth Estimation with a Vision Transformercited by 136
  10. 2021MPViT: Multi-Path Vision Transformer for Dense Predictioncited by 122
  11. 2023Towards Zero-Shot Scale-Aware Monocular Depth Estimationcited by 101
  12. 2019How do neural networks see depth in single images?cited by 82
6 more
  1. 2021Regularizing Nighttime Weirdness: Efficient Self-supervised Monocular Depth Estimation in the Darkcited by 58
  2. 2023RoboDepth: Robust Out-of-Distribution Depth Estimation under Corruptionscited by 49
  3. 2023Self-supervised Monocular Depth Estimation: Let's Talk About The Weathercited by 34
  4. 2022Sim-to-Real Domain Adaptation for Lane Detection and Classification in Autonomous Drivingcited by 20
  5. 2023Towards Viewpoint Robustness in Bird's Eye View Segmentationcited by 13
  6. 2023Learning Transformations To Reduce the Geometric Shift in Object Detectioncited by 2

Built on by

Not cited yet.