A Practical Approach to Underwater Depth and Surface Normals Estimation
Not on the map. Why?
Abstract (arXiv)
Monocular Depth and Surface Normals Estimation (MDSNE) is crucial for tasks such as 3D reconstruction, autonomous navigation, and underwater exploration. Current methods rely either on discriminative models, which struggle with transparent or reflective surfaces, or generative models, which, while accurate, are computationally expensive. This paper presents a novel deep learning model for MDSNE, specifically tailored for underwater environments, using a hybrid architecture that integrates Convolutional Neural Networks (CNNs) with Transformers, leveraging the strengths of both approaches. Training effective MDSNE models is often hampered by noisy real-world datasets and the limited generalization of synthetic datasets. To address this, we generate pseudo-labeled real data using multiple pre-trained MDSNE models. To ensure the quality of this data, we propose the Depth Normal Evaluation and Selection Algorithm (DNESA), which evaluates and selects the most reliable pseudo-labeled samples using domain-specific metrics. A lightweight student model is then trained on this curated dataset. Our model reduces parameters by 90% and training costs by 80%, allowing real-time 3D perception on resource-constrained devices. Key contributions include: a novel and efficient MDSNE model, the DNESA algorithm, a domain-specific data pipeline, and a focus on real-time performance and scalability. Designed for real-world underwater applications, our model facilitates low-cost deployments in underwater robots and autonomous vehicles, bridging the gap between research and practical implementation.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 22 of its 30 references that are in the map. First posted on arXiv 2 Oct 2024.
Builds on
22 of 30 references.
References · 22
- 2019Towards Robust Monocular Depth Estimation: Mixing Datasets for Zero-shot Cross-dataset Transfercited by 1,484
- 2024Depth Anything V2cited by 1,385
- 2023ZoeDepth: Zero-shot Transfer by Combining Relative and Metric Depthcited by 646
- 2020AdaBins: Depth Estimation using Adaptive Binscited by 596
- 2024Metric3Dv2: A Versatile Monocular Geometric Foundation Model for Zero-shot Metric Depth and Surface Normal Estimationcited by 389
- 2019From Big to Small: Multi-Scale Local Planar Guidance for Monocular Depth Estimationcited by 379
- 2023Metric3D: Towards Zero-shot Metric 3D Prediction from A Single Imagecited by 357
- 2021Omnidata: A Scalable Pipeline for Making Multi-Task Mid-Level Vision Datasets from 3D Scanscited by 336
- 2019Enforcing geometric constraints of virtual normal for depth predictioncited by 233
- 2018Evaluation of CNN-based Single-Image Depth Estimation Methodscited by 137
- 2018High Quality Monocular Depth Estimation via Transfer Learningcited by 133
- 2021Transformer-Based Attention Networks for Continuous Pixel-Wise Predictioncited by 125
10 more
- 2018Underwater Single Image Color Restoration Using Haze-Lines and a New Quantitative Datasetcited by 90
- 2020A Realistic Fish-Habitat Dataset to Evaluate Algorithms for Underwater Visual Analysiscited by 57
- 2023Learning Depth Estimation for Transparent and Mirror Surfacescited by 34
- 2022IronDepth: Iterative Refinement of Single-View Depth using Surface Normal and its Uncertaintycited by 30
- 2023Atlantis: Enabling Underwater Depth Estimation with Stable Diffusioncited by 28
- 2022UDepth: Fast Monocular Depth Estimation for Visually-guided Underwater Robotscited by 27
- 2024The AI Community Building the Future? A Quantitative Analysis of Development Activity on Hugging Face Hubcited by 18
- 2019Unsupervised Single Image Underwater Depth Estimationcited by 16
- 2024PrimeDepth: Efficient Monocular Depth Estimation with a Stable Diffusion Preimagecited by 11
- 2024UMono: Physical Model Informed Hybrid CNN-Transformer Framework for Underwater Monocular Depth Estimationcited by 1
Built on by
Not cited yet.