Versatile Depth Estimator Based on Common Relative Depth Estimation and Camera-Specific Relative-to-Metric Depth Conversion
Not on the map. Why?
Abstract (arXiv)
A typical monocular depth estimator is trained for a single camera, so its performance drops severely on images taken with different cameras. To address this issue, we propose a versatile depth estimator (VDE), composed of a common relative depth estimator (CRDE) and multiple relative-to-metric converters (R2MCs). The CRDE extracts relative depth information, and each R2MC converts the relative information to predict metric depths for a specific camera. The proposed VDE can cope with diverse scenes, including both indoor and outdoor scenes, with only a 1.12% parameter increase per camera. Experimental results demonstrate that VDE supports multiple cameras effectively and efficiently and also achieves state-of-the-art performance in the conventional single-camera scenario.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 39 of its 57 references that are in the map. First posted on arXiv 20 Mar 2023.
Builds on
39 of 57 references.
References · 39
- 2017Attention Is All You Needcited by 60,361
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
- 2020End-to-End Object Detection with Transformerscited by 7,414
- 2016Layer Normalizationcited by 5,669
- 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,117
- 2016Pyramid Scene Parsing Networkcited by 2,479
- 2021Vision Transformers for Dense Predictioncited by 1,803
- 2019Towards Robust Monocular Depth Estimation: Mixing Datasets for Zero-shot Cross-dataset Transfercited by 1,495
27 more
- 2014Depth Map Prediction from a Single Image using a Multi-Scale Deep Networkcited by 1,274
- 2021Per-Pixel Classification is Not All You Need for Semantic Segmentationcited by 1,152
- 2018MegaDepth: Learning Single-View Depth Prediction from Internet Photoscited by 737
- 2018Deep Ordinal Regression Network for Monocular Depth Estimationcited by 723
- 2020AdaBins: Depth Estimation using Adaptive Binscited by 601
- 2014Predicting Depth, Surface Normals and Semantic Labels with a Common Multi-Scale Convolutional Architecturecited by 483
- 2016Deeper Depth Prediction with Fully Convolutional Residual Networkscited by 403
- 2019From Big to Small: Multi-Scale Local Planar Guidance for Monocular Depth Estimationcited by 382
- 2019DIODE: A Dense Indoor and Outdoor DEpth Datasetcited by 240
- 2019Enforcing geometric constraints of virtual normal for depth predictioncited by 234
- 20203D Photography using Context-aware Layered Depth Inpaintingcited by 206
- 2016Single-Image Depth Perception in the Wildcited by 180
- 2018Revisiting Single Image Depth Estimation: Toward Higher Resolution Maps with Accurate Object Boundariescited by 145
- 2021RegionViT: Regional-to-Local Attention for Vision Transformerscited by 127
- 2021Transformer-Based Attention Networks for Continuous Pixel-Wise Predictioncited by 125
- 2019Learning the Depths of Moving People by Watching Frozen Peoplecited by 120
- 2022P3Depth: Monocular Depth Estimation with a Piecewise Planarity Priorcited by 107
- 2022Attention Attention Everywhere: Monocular Depth Prediction with Skip Attentioncited by 93
- 2020Guiding Monocular Depth Estimation Using Depth-Attention Volumecited by 82
- 2019Web Stereo Video Supervision for Depth Prediction from Dynamic Scenescited by 73
- 2017Multi-Scale Continuous CRFs as Sequential Deep Networks for Monocular Depth Estimationcited by 70
- 2019SharpNet: Fast and Accurate Recovery of Occluding Contours in Monocular Depth Estimationcited by 59
- 2019Structure-Aware Residual Pyramid Network for Monocular Depth Estimationcited by 49
- 2021MSG-Transformer: Exchanging Local Spatial Information by Manipulating Messenger Tokenscited by 46
- 2018Detail Preserving Depth Estimation from a Single Image Using Attention Guided Networkscited by 31
- 2022Depth Map Decomposition for Monocular Depth Estimationcited by 16
- 2020Monocular Depth Estimation via Listwise Ranking using the Plackett-Luce Modelcited by 12
Built on by
Citing papers per year: 2024: 1.
1 paper.