UDepth: Fast Monocular Depth Estimation for Visually-guided Underwater Robots
Not on the map. Why?
Abstract (arXiv)
In this paper, we present a fast monocular depth estimation method for enabling 3D perception capabilities of low-cost underwater robots. We formulate a novel end-to-end deep visual learning pipeline named UDepth, which incorporates domain knowledge of image formation characteristics of natural underwater scenes. First, we adapt a new input space from raw RGB image space by exploiting underwater light attenuation prior, and then devise a least-squared formulation for coarse pixel-wise depth prediction. Subsequently, we extend this into a domain projection loss that guides the end-to-end learning of UDepth on over 9K RGB-D training samples. UDepth is designed with a computationally light MobileNetV2 backbone and a Transformer-based optimizer for ensuring fast inference rates on embedded systems. By domain-aware design choices and through comprehensive experimental analyses, we demonstrate that it is possible to achieve state-of-the-art depth estimation performance while ensuring a small computational footprint. Specifically, with 70%-80% less network parameters than existing benchmarks, UDepth achieves comparable and often better depth estimation performance. While the full model offers over 66 FPS (13 FPS) inference rates on a single GPU (CPU core), our domain projection for coarse depth prediction runs at 51.5 FPS rates on single-board NVIDIA Jetson TX2s. The inference pipelines are available at https://github.com/uf-robopi/UDepth.
Key facts. Cited by 27 papers in the map (data through 7 Oct 2026). Builds on 40 of its 85 references that are in the map. First posted on arXiv 26 Sep 2022.
Builds on
40 of 85 references.
References · 40
- 2017Attention Is All You Needcited by 59,932
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
- 2018MobileNetV2: Inverted Residuals and Linear Bottleneckscited by 4,773
- 2021Vision Transformers for Dense Predictioncited by 1,789
- 2019Towards Robust Monocular Depth Estimation: Mixing Datasets for Zero-shot Cross-dataset Transfercited by 1,484
- 2014Depth Map Prediction from a Single Image using a Multi-Scale Deep Networkcited by 1,264
- 2016Unsupervised Monocular Depth Estimation with Left-Right Consistencycited by 819
- 2017Unsupervised Learning of Depth and Ego-Motion from Videocited by 778
28 more
- 2018Deep Ordinal Regression Network for Monocular Depth Estimationcited by 721
- 2020AdaBins: Depth Estimation using Adaptive Binscited by 596
- 2014Predicting Depth, Surface Normals and Semantic Labels with a Common Multi-Scale Convolutional Architecturecited by 483
- 20193D Packing for Self-Supervised Monocular Depth Estimationcited by 437
- 2016Deeper Depth Prediction with Fully Convolutional Residual Networkscited by 402
- 2016Unsupervised CNN for Single View Depth Estimation: Geometry to the Rescuecited by 368
- 2019An Underwater Image Enhancement Benchmark Dataset and Beyondcited by 250
- 2019Cascaded Partial Decoder for Fast and Accurate Salient Object Detectioncited by 216
- 2019Fast Underwater Image Enhancement for Improved Visual Perceptioncited by 181
- 2018Unsupervised Learning of Monocular Depth Estimation and Visual Odometry with Deep Feature Reconstructioncited by 159
- 2018High Quality Monocular Depth Estimation via Transfer Learningcited by 133
- 2019Self-Supervised Monocular Depth Hintscited by 127
- 2017Semi-Supervised Deep Learning for Monocular Depth Map Predictioncited by 109
- 2020ViP-DeepLab: Learning Visual Perception with Depth-aware Video Panoptic Segmentationcited by 95
- 2016Estimating Depth from Monocular Images as Classification Using Deep Fully Convolutional Residual Networkscited by 91
- 2018Deep Virtual Stereo Odometry: Leveraging Deep Depth Prediction for Monocular Direct Sparse Odometrycited by 85
- 2020Monocular Depth Estimation Based On Deep Learning: An Overviewcited by 68
- 2018Learning Monocular Depth by Distilling Cross-domain Stereo Networkscited by 64
- 2018Single View Stereo Matchingcited by 39
- 2018Learning monocular depth estimation with unsupervised trinocular assumptionscited by 36
- 2021Unsupervised Monocular Depth Estimation in Highly Complex Environmentscited by 28
- 2019Semi-Supervised Monocular Depth Estimation with Left-Right Consistency Using Deep Neural Networkcited by 21
- 2020SVAM: Saliency-guided Visual Attention Modeling by Autonomous Underwater Robotscited by 20
- 2018SVIn2: An Underwater SLAM System using Sonar, Visual, Inertial, and Depth Sensorcited by 16
- 2019Unsupervised Single Image Underwater Depth Estimationcited by 16
- 2019Navigation in the Presence of Obstacles for an Agile Autonomous Underwater Vehiclecited by 11
- 2022Semi-Supervised Learning with Mutual Distillation for Monocular Depth Estimationcited by 10
- 2019Robot-to-Robot Relative Pose Estimation using Humans as Markerscited by 2
Built on by
Citing papers per year: 2023: 5; 2024: 7; 2025: 10; 2026: 5.
27 papers.
Sort:
By area:
- 2023Atlantis: Enabling Underwater Depth Estimation with Stable Diffusioncited by 28
- 2024Event3DGS: Event-Based 3D Gaussian Splatting for High-Speed Robot Egomotioncited by 22
- 2023Metrically Scaled Monocular Depth Estimation through Sparse Priors for Underwater Robotscited by 8
- 2024Gaussian Splashing: Direct Volumetric Rendering Underwatercited by 7
- 2023Investigation of the Challenges of Underwater-Visual-Monocular-SLAMcited by 6
- 2023Model-Based Underwater 6D Pose Estimation from RGBcited by 3
- 2024MARVIS: Motion & Geometry Aware Real and Virtual Image Segmentationcited by 3
- 2025UVLM: Benchmarking Video Language Model for Underwater World Understandingcited by 3
- 2023Detecting Olives with Synthetic or Real Data? Olive the Abovecited by 2
- 2024AquaFuse: Waterbody Fusion for Physics Guided View Synthesis of Underwater Scenescited by 2
- 2025ER-LoRA: Effective-Rank Guided Adaptation for Weather-Generalized Depth Estimationcited by 2
- 2024LU2Net: A Lightweight Network for Real-time Underwater Image Enhancementcited by 1
15 more
- 2024UMono: Physical Model Informed Hybrid CNN-Transformer Framework for Underwater Monocular Depth Estimationcited by 1
- 2025UStyle: Waterbody Style Transfer of Underwater Scenes by Depth-Guided Feature Synthesiscited by 1
- 2025NeoARCADE: Robust Calibration for Distance Estimation to Support Assistive Drones for the Visually Impairedcited by 1
- 2025DUViN: Diffusion-Based Underwater Visual Navigation via Knowledge-Transferred Depth Featurescited by 1
- 2026Wat3R: Underwater 3D Geometry Learning without Annotationscited by 1
- 2026WAT3R: Feedforward Underwater 3D Reconstructioncited by 1
- 2024A Practical Approach to Underwater Depth and Surface Normals Estimationcited by 0
- 2025Dense Geometry Supervision for Underwater Depth Estimationcited by 0
- 2025Underwater Monocular Metric Depth Estimation: Real-World Benchmarks and Synthetic Fine-Tuning with Vision Foundation Modelscited by 0
- 2025Tree-Mamba: A Tree-Aware Mamba for Underwater Monocular Depth Estimationcited by 0
- 2025BoRe-Depth: Self-supervised Monocular Depth Estimation with Boundary Refinement for Embedded Systemscited by 0
- 2025MANTA: Physics-Informed Generalized Underwater Object Trackingcited by 0
- 2026PTC-Depth: Pose-Refined Monocular Depth Estimation with Temporal Consistencycited by 0
- 2026Learning Spatially Adaptive Structural Coordination for Underwater Salient Object Detectioncited by 0
- 2026WaterGen: Decoupling Scene and Medium in Underwater Image Generationcited by 0
- 2026WAT3R: Feedforward Underwater 3D Reconstruction23 Jul 2026
- 2026Wat3R: Underwater 3D Geometry Learning without Annotations9 Jul 2026
- 2026WaterGen: Decoupling Scene and Medium in Underwater Image Generation30 Jun 2026
- 2026Learning Spatially Adaptive Structural Coordination for Underwater Salient Object Detection15 May 2026
- 2026PTC-Depth: Pose-Refined Monocular Depth Estimation with Temporal Consistency2 Apr 2026
- 2025MANTA: Physics-Informed Generalized Underwater Object Tracking28 Nov 2025
- 2025BoRe-Depth: Self-supervised Monocular Depth Estimation with Boundary Refinement for Embedded Systems6 Nov 2025
- 2025DUViN: Diffusion-Based Underwater Visual Navigation via Knowledge-Transferred Depth Features3 Sep 2025
- 2025ER-LoRA: Effective-Rank Guided Adaptation for Weather-Generalized Depth Estimation31 Aug 2025
- 2025Tree-Mamba: A Tree-Aware Mamba for Underwater Monocular Depth Estimation10 Jul 2025
- 2025UVLM: Benchmarking Video Language Model for Underwater World Understanding3 Jul 2025
- 2025Underwater Monocular Metric Depth Estimation: Real-World Benchmarks and Synthetic Fine-Tuning with Vision Foundation Models2 Jul 2025
15 more
- 2025Dense Geometry Supervision for Underwater Depth Estimation25 Apr 2025
- 2025NeoARCADE: Robust Calibration for Distance Estimation to Support Assistive Drones for the Visually Impaired31 Mar 2025
- 2025UStyle: Waterbody Style Transfer of Underwater Scenes by Depth-Guided Feature Synthesis14 Mar 2025
- 2024Gaussian Splashing: Direct Volumetric Rendering Underwater29 Nov 2024
- 2024AquaFuse: Waterbody Fusion for Physics Guided View Synthesis of Underwater Scenes2 Nov 2024
- 2024A Practical Approach to Underwater Depth and Surface Normals Estimation2 Oct 2024
- 2024UMono: Physical Model Informed Hybrid CNN-Transformer Framework for Underwater Monocular Depth Estimation25 Jul 2024
- 2024LU2Net: A Lightweight Network for Real-time Underwater Image Enhancement21 Jun 2024
- 2024Event3DGS: Event-Based 3D Gaussian Splatting for High-Speed Robot Egomotion5 Jun 2024
- 2024MARVIS: Motion & Geometry Aware Real and Virtual Image Segmentation14 Mar 2024
- 2023Atlantis: Enabling Underwater Depth Estimation with Stable Diffusion19 Dec 2023
- 2023Metrically Scaled Monocular Depth Estimation through Sparse Priors for Underwater Robots25 Oct 2023
- 2023Detecting Olives with Synthetic or Real Data? Olive the Above16 Aug 2023
- 2023Investigation of the Challenges of Underwater-Visual-Monocular-SLAM14 Jun 2023
- 2023Model-Based Underwater 6D Pose Estimation from RGB14 Feb 2023
- 2024Event3DGS: Event-Based 3D Gaussian Splatting for High-Speed Robot Egomotioncited by 22
- 2023Metrically Scaled Monocular Depth Estimation through Sparse Priors for Underwater Robotscited by 8
- 2024Gaussian Splashing: Direct Volumetric Rendering Underwatercited by 7
- 2023Investigation of the Challenges of Underwater-Visual-Monocular-SLAMcited by 6
- 2023Model-Based Underwater 6D Pose Estimation from RGBcited by 3
- 2024MARVIS: Motion & Geometry Aware Real and Virtual Image Segmentationcited by 3
- 2025UVLM: Benchmarking Video Language Model for Underwater World Understandingcited by 3
- 2023Detecting Olives with Synthetic or Real Data? Olive the Abovecited by 2
- 2024AquaFuse: Waterbody Fusion for Physics Guided View Synthesis of Underwater Scenescited by 2
- 2025ER-LoRA: Effective-Rank Guided Adaptation for Weather-Generalized Depth Estimationcited by 2
- 2024LU2Net: A Lightweight Network for Real-time Underwater Image Enhancementcited by 1
- 2024UMono: Physical Model Informed Hybrid CNN-Transformer Framework for Underwater Monocular Depth Estimationcited by 1
12 most cited of 24 All 24 (JSON)
- 2026WAT3R: Feedforward Underwater 3D Reconstruction23 Jul 2026
- 2026Wat3R: Underwater 3D Geometry Learning without Annotations9 Jul 2026
- 2026Learning Spatially Adaptive Structural Coordination for Underwater Salient Object Detection15 May 2026
- 2026PTC-Depth: Pose-Refined Monocular Depth Estimation with Temporal Consistency2 Apr 2026
- 2025MANTA: Physics-Informed Generalized Underwater Object Tracking28 Nov 2025
- 2025BoRe-Depth: Self-supervised Monocular Depth Estimation with Boundary Refinement for Embedded Systems6 Nov 2025
- 2025DUViN: Diffusion-Based Underwater Visual Navigation via Knowledge-Transferred Depth Features3 Sep 2025
- 2025ER-LoRA: Effective-Rank Guided Adaptation for Weather-Generalized Depth Estimation31 Aug 2025
- 2025UVLM: Benchmarking Video Language Model for Underwater World Understanding3 Jul 2025
- 2025Underwater Monocular Metric Depth Estimation: Real-World Benchmarks and Synthetic Fine-Tuning with Vision Foundation Models2 Jul 2025
- 2025Dense Geometry Supervision for Underwater Depth Estimation25 Apr 2025
- 2025NeoARCADE: Robust Calibration for Distance Estimation to Support Assistive Drones for the Visually Impaired31 Mar 2025
12 newest of 24 All 24 (JSON)