Enhanced Encoder-Decoder Architecture for Accurate Monocular Depth Estimation
Not on the map. Why?
Abstract (arXiv)
Estimating depth from a single 2D image is a challenging task due to the lack of stereo or multi-view data, which are typically required for depth perception. In state-of-the-art architectures, the main challenge is to efficiently capture complex objects and fine-grained details, which are often difficult to predict. This paper introduces a novel deep learning-based approach using an enhanced encoder-decoder architecture, where the Inception-ResNet-v2 model serves as the encoder. This is the first instance of utilizing Inception-ResNet-v2 as an encoder for monocular depth estimation, demonstrating improved performance over previous models. It incorporates multi-scale feature extraction to enhance depth prediction accuracy across various object sizes and distances. We propose a composite loss function comprising depth loss, gradient edge loss, and Structural Similarity Index Measure (SSIM) loss, with fine-tuned weights to optimize the weighted sum, ensuring a balance across different aspects of depth estimation. Experimental results on the KITTI dataset show that our model achieves a significantly faster inference time of 0.019 seconds, outperforming vision transformers in efficiency while maintaining good accuracy. On the NYU Depth V2 dataset, the model establishes state-of-the-art performance, with an Absolute Relative Error (ARE) of 0.064, a Root Mean Square Error (RMSE) of 0.228, and an accuracy of 89.3% for δ < 1.25. These metrics demonstrate that our model can accurately and efficiently predict depth even in challenging scenarios, providing a practical solution for real-time applications.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 19 of its 58 references that are in the map. First posted on arXiv 15 Oct 2024.
Builds on
19 of 58 references.
References · 19
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2016Densely Connected Convolutional Networkscited by 6,720
- 2022Generative Adversarial Networkscited by 5,627
- 2016The Cityscapes Dataset for Semantic Urban Scene Understandingcited by 4,444
- 2016Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learningcited by 1,512
- 2015Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcastingcited by 1,436
- 2024Depth Anything: Unleashing the Power of Large-Scale Unlabeled Datacited by 1,360
- 2019On the Convergence of Adam and Beyondcited by 841
- 2023MiDaS v3.1 -- A Model Zoo for Robust Monocular Relative Depth Estimationcited by 174
- 2022BinsFormer: Revisiting Adaptive Bins for Monocular Depth Estimationcited by 168
- 2018High Quality Monocular Depth Estimation via Transfer Learningcited by 133
7 more
- 2018Structured Attention Guided Convolutional Neural Fields for Monocular Depth Estimationcited by 78
- 2022Lightweight Monocular Depth Estimation through Guided Decodingcited by 14
- 2023Edit Temporal-Consistent Videos with Image Diffusion Modelcited by 12
- 2023Joint Self-supervised Depth and Optical Flow Estimation towards Dynamic Objectscited by 8
- 2024Self-supervised Monocular Depth Estimation on Water Scenes via Specular Reflection Priorcited by 7
- 2019SGANVO: Unsupervised Deep Visual Odometry and Depth Estimation with Stacked Generative Adversarial Networkscited by 5
- 2023Depth Super-Resolution from Explicit and Implicit High-Frequency Featurescited by 5
Built on by
Not cited yet.