Panoramic Depth Estimation via Supervised and Unsupervised Learning in Indoor Scenes
Not on the map. Why?
Abstract (arXiv)
Depth estimation, as a necessary clue to convert 2D images into the 3D space, has been applied in many machine vision areas. However, to achieve an entire surrounding 360-degree geometric sensing, traditional stereo matching algorithms for depth estimation are limited due to large noise, low accuracy, and strict requirements for multi-camera calibration. In this work, for a unified surrounding perception, we introduce panoramic images to obtain larger field of view. We extend PADENet first appeared in our previous conference work for outdoor scene understanding, to perform panoramic monocular depth estimation with a focus for indoor scenes. At the same time, we improve the training process of the neural network adapted to the characteristics of panoramic images. In addition, we fuse traditional stereo matching algorithm with deep learning methods and further improve the accuracy of depth predictions. With a comprehensive variety of experiments, this research demonstrates the effectiveness of our schemes aiming for indoor scene perception.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 32 of its 47 references that are in the map. First posted on arXiv 18 Aug 2021.
Builds on
32 of 47 references.
References · 32
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,364
- 2016Densely Connected Convolutional Networkscited by 6,720
- 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,523
- 2016The Cityscapes Dataset for Semantic Urban Scene Understandingcited by 4,444
- 2016Pyramid Scene Parsing Networkcited by 2,479
- 2017Rethinking Atrous Convolution for Semantic Image Segmentationcited by 2,161
- 2017Matterport3D: Learning from RGB-D Data in Indoor Environmentscited by 1,376
- 2014Depth Map Prediction from a Single Image using a Multi-Scale Deep Networkcited by 1,274
- 2016Unsupervised Monocular Depth Estimation with Left-Right Consistencycited by 820
20 more
- 2018Deep Ordinal Regression Network for Monocular Depth Estimationcited by 723
- 2016Semantic Scene Completion from a Single Depth Imagecited by 472
- 2017Joint 2D-3D-Semantic Data for Indoor Scene Understandingcited by 406
- 2016Deeper Depth Prediction with Fully Convolutional Residual Networkscited by 403
- 2018Unsupervised Learning of Monocular Depth Estimation and Visual Odometry with Deep Feature Reconstructioncited by 159
- 2019ACNet: Attention Based Network to Exploit Complementary Features for RGBD Semantic Segmentationcited by 107
- 2020HoHoNet: 360 Indoor Holistic Understanding with Latent Horizontal Featurescited by 105
- 2018OmniDepth: Dense Depth Estimation for Indoors Spherical Panoramascited by 99
- 2021UniFuse: Unidirectional Fusion for 360circ Panorama Depth Estimationcited by 92
- 2018StereoNet: Guided Hierarchical Refinement for Real-Time Edge-Aware Depth Predictioncited by 88
- 2019Spherical View Synthesis for Self-Supervised 360 Depth Estimationcited by 51
- 2021Capturing Omni-Range Context for Omnidirectional Segmentationcited by 50
- 2018Single View Stereo Matchingcited by 39
- 2020Real-time Fusion Network for RGB-D Semantic Segmentation Incorporating Unexpected Obstacle Detection for Road-driving Imagescited by 36
- 2018Eliminating the Blind Spot: Adapting 3D Object Detection and Monocular Depth Estimation to 360deg Panoramic Imagerycited by 35
- 2020Unsupervised Monocular Depth Estimation for Night-time Images using Adversarial Domain Feature Adaptationcited by 35
- 2021Trans4Trans: Efficient Transformer for Transparent Object Segmentation to Help Visually Impaired People Navigate in the Real Worldcited by 30
- 2020Polarization-driven Semantic Segmentation via Efficient Attention-bridged Fusioncited by 24
- 2020ODE-CNN: Omnidirectional Depth Extension Networkscited by 18
- 2018Fusion of stereo and still monocular depth estimates in a self-supervised learning contextcited by 10
Built on by
Citing papers per year: 2022: 2.
2 papers.