Deeper into Self-Supervised Monocular Indoor Depth Estimation
Not on the map. Why?
Abstract (arXiv)
Monocular depth estimation using Convolutional Neural Networks (CNNs) has shown impressive performance in outdoor driving scenes. However, self-supervised learning of indoor depth from monocular sequences is quite challenging for researchers because of the following two main reasons. One is the large areas of low-texture regions and the other is the complex ego-motion on indoor training datasets. In this work, our proposed method, named IndoorDepth, consists of two innovations. In particular, we first propose a novel photometric loss with improved structural similarity (SSIM) function to tackle the challenge from low-texture regions. Moreover, in order to further mitigate the issue of inaccurate ego-motion prediction, multiple photometric losses at different stages are used to train a deeper pose network with two residual pose blocks. Subsequent ablation study can validate the effectiveness of each new idea. Experiments on the NYUv2 benchmark demonstrate that our IndoorDepth outperforms the previous state-of-the-art methods by a large margin. In addition, we also validate the generalization ability of our method on ScanNet dataset. Code is availabe at https://github.com/fcntes/IndoorDepth.
Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). Builds on 39 of its 58 references that are in the map. First posted on arXiv 3 Dec 2023.
Builds on
39 of 58 references.
References · 39
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,485
- 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,088
- 2014Depth Map Prediction from a Single Image using a Multi-Scale Deep Networkcited by 1,264
- 2016Unsupervised Monocular Depth Estimation with Left-Right Consistencycited by 819
- 2017Unsupervised Learning of Depth and Ego-Motion from Videocited by 778
- 2018Deep Ordinal Regression Network for Monocular Depth Estimationcited by 721
- 2014Predicting Depth, Surface Normals and Semantic Labels with a Common Multi-Scale Convolutional Architecturecited by 483
- 20193D Packing for Self-Supervised Monocular Depth Estimationcited by 437
- 2016Deeper Depth Prediction with Fully Convolutional Residual Networkscited by 402
- 2019Enforcing geometric constraints of virtual normal for depth predictioncited by 233
- 2021The Temporal Opportunist: Self-Supervised Multi-Frame Monocular Depthcited by 190
27 more
- 2017Octree Generating Networks: Efficient Convolutional Architectures for High-resolution 3D Outputscited by 189
- 2018DeepV2D: Video to Depth with Differentiable Structure from Motioncited by 185
- 2015Learning Depth from Single Monocular Images Using Deep Convolutional Neural Fieldscited by 169
- 2019Stereo R-CNN based 3D Object Detection for Autonomous Drivingcited by 163
- 2018Revisiting Single Image Depth Estimation: Toward Higher Resolution Maps with Accurate Object Boundariescited by 144
- 2020Feature-metric Loss for Self-supervised Learning of Depth and Egomotioncited by 140
- 2020Semantically-Guided Representation Learning for Self-Supervised Monocular Depthcited by 134
- 2020Self-supervised Monocular Trained Depth Estimation using Self-attention and Discrete Disparity Volumecited by 116
- 2020HR-Depth: High Resolution Self-Supervised Monocular Depth Estimationcited by 115
- 2016Estimating Depth from Monocular Images as Classification Using Deep Fully Convolutional Residual Networkscited by 91
- 2020Towards Better Generalization: Joint Depth-Pose Learning without PoseNetcited by 85
- 2020Unsupervised Monocular Depth Learning in Dynamic Scenescited by 84
- 2020Don't Forget The Past: Recurrent Depth Estimation from Monocular Videocited by 71
- 2017Multi-Scale Continuous CRFs as Sequential Deep Networks for Monocular Depth Estimationcited by 70
- 2021Unsupervised Scale-consistent Depth Learning from Videocited by 69
- 2019DepthTransfer: Depth Extraction from Video Using Non-parametric Samplingcited by 60
- 2018ApolloCar3D: A Large 3D Car Instance Understanding Benchmark for Autonomous Drivingcited by 59
- 2021Fine-grained Semantics-aware Representation Enhancement for Self-supervised Monocular Depth Estimationcited by 55
- 2021Toward Practical Monocular Indoor Depth Estimationcited by 42
- 2020P2Net: Patch-match and Plane-regularization for Unsupervised Indoor Depth Estimationcited by 41
- 2020Auto-Rectify Network for Unsupervised Indoor Depth Estimationcited by 39
- 2021MonoIndoor: Towards Good Practice of Self-Supervised Monocular Depth Estimation for Indoor Environmentscited by 38
- 2021StructDepth: Leveraging the structural regularities for self-supervised indoor depth estimationcited by 36
- 2019Moving Indoor: Unsupervised Video Depth Learning in Challenging Environmentscited by 31
- 2016Depth from a Single Image by Harmonizing Overcomplete Local Network Predictionscited by 16
- 2021PLNet: Plane and Line Priors for Unsupervised Indoor Depth Estimationcited by 12
- 2022MonoIndoor++:Towards Better Practice of Self-Supervised Monocular Depth Estimation for Indoor Environmentscited by 12
Built on by
Citing papers per year: 2024: 1; 2025: 2; 2026: 4.
7 papers.
- 2024EmbodiedOcc: Embodied 3D Occupancy Prediction for Vision-based Online Scene Understandingcited by 43
- 20253D Scene Understanding Through Local Random Access Sequence Modelingcited by 5
- 2026Unified 3D Scene Understanding Through Physical World Modelingcited by 2
- 2026SS3D: End2End Self-Supervised 3D from Web Videoscited by 1
- 2026Improved monocular depth prediction using distance transform over pre-semantic contours with self-supervised neural networkscited by 1
- 2025Accuracy Does Not Guarantee Human-Likeness: Cross-Domain Human-Centered Benchmark in Monocular Depth Estimationcited by 0
- 2026VLRC: Vision-Language Reprojection Consistency as a scalable signal for better feed-forward 3D pretrainingcited by 0
- 2026VLRC: Vision-Language Reprojection Consistency as a scalable signal for better feed-forward 3D pretraining2 Jul 2026
- 2026Unified 3D Scene Understanding Through Physical World Modeling23 May 2026
- 2026Improved monocular depth prediction using distance transform over pre-semantic contours with self-supervised neural networks8 May 2026
- 2026SS3D: End2End Self-Supervised 3D from Web Videos24 Apr 2026
- 2025Accuracy Does Not Guarantee Human-Likeness: Cross-Domain Human-Centered Benchmark in Monocular Depth Estimation9 Dec 2025
- 20253D Scene Understanding Through Local Random Access Sequence Modeling4 Apr 2025
- 2024EmbodiedOcc: Embodied 3D Occupancy Prediction for Vision-based Online Scene Understanding5 Dec 2024