Distortion-Aware Self-Supervised 360deg Depth Estimation from A Single Equirectangular Projection Image
Not on the map. Why?
Abstract (arXiv)
360deg images are widely available over the last few years. This paper proposes a new technique for single 360deg image depth prediction under open environments. Depth prediction from a 360deg single image is not easy for two reasons. One is the limitation of supervision datasets - the currently available dataset is limited to indoor scenes. The other is the problems caused by Equirectangular Projection Format (ERP), commonly used for 360deg images, that are coordinate and distortion. There is only one method existing that uses cube map projection to produce six perspective images and apply self-supervised learning using motion pictures for perspective depth prediction to deal with these problems. Different from the existing method, we directly use the ERP format. We propose a framework of direct use of ERP with coordinate conversion of correspondences and distortion-aware upsampling module to deal with the ERP related problems and extend a self-supervised learning method for open environments. For the experiments, we firstly built a dataset for the evaluation, and quantitatively evaluate the depth prediction in outdoor scenes. We show that it outperforms the state-of-the-art technique
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 22 of its 36 references that are in the map. First posted on arXiv 3 Apr 2022.
Builds on
22 of 36 references.
References · 22
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2017Squeeze-and-Excitation Networkscited by 4,763
- 2014Depth Map Prediction from a Single Image using a Multi-Scale Deep Networkcited by 1,264
- 2017Unsupervised Learning of Depth and Ego-Motion from Videocited by 778
- 2018Deep Ordinal Regression Network for Monocular Depth Estimationcited by 721
- 2014Predicting Depth, Surface Normals and Semantic Labels with a Common Multi-Scale Convolutional Architecturecited by 483
- 2016Deeper Depth Prediction with Fully Convolutional Residual Networkscited by 402
- 2018PAD-Net: Multi-Tasks Guided Prediction-and-Distillation Network for Simultaneous Depth Estimation and Scene Parsingcited by 224
- 2020Novel View Synthesis of Dynamic Scenes with Globally Coherent Depths from a Monocular Cameracited by 166
10 more
- 2019Pattern-Affinitive Propagation across Depth, Surface Normal and Semantic Segmentationcited by 141
- 2019Learning the Depths of Moving People by Watching Frozen Peoplecited by 120
- 2018OmniDepth: Dense Depth Estimation for Indoors Spherical Panoramascited by 98
- 2019Spherical CNNs on Unstructured Gridscited by 76
- 2019Orientation-aware Semantic Segmentation on Icosahedron Spherescited by 52
- 2018Self-Supervised Learning of Depth and Camera Motion from 360deg Videoscited by 40
- 2018Object Detection in Equirectangular Panoramacited by 20
- 2019Super-resolution of Omnidirectional Images Using Adversarial Learningcited by 18
- 2020Unsupervised Learning of Depth and Ego-Motion from Cylindrical Panoramic Video with Applications for Virtual Realitycited by 4
- 2020Building Movie Map -- A Tool for Exploring Areas in a City -- and its Evaluationcited by 4
Built on by
Not cited yet.