# A Physical Model-Guided Framework for Underwater Image Enhancement and Depth Estimation

arXiv: https://arxiv.org/abs/2407.04230 · HTML: https://mlsanity.com/paper/2407.04230/

## Key facts

- Cited by 9 papers in the map (data through 14 Oct 2026).
- Builds on 27 of its 72 references that are in the map.
- First posted on arXiv 5 Jul 2024.

## Builds on (most cited first, 27 of 27)

- [An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale](https://mlsanity.com/paper/2010.11929/) (2020)
- [U-Net: Convolutional Networks for Biomedical Image Segmentation](https://mlsanity.com/paper/1505.04597/) (2015)
- [DINOv2: Learning Robust Visual Features without Supervision](https://mlsanity.com/paper/2304.07193/) (2023)
- [Layer Normalization](https://mlsanity.com/paper/1607.06450/) (2016)
- [A ConvNet for the 2020s](https://mlsanity.com/paper/2201.03545/) (2022)
- [Vision Transformers for Dense Prediction](https://mlsanity.com/paper/2103.13413/) (2021)
- [Towards Robust Monocular Depth Estimation: Mixing Datasets for Zero-shot Cross-dataset Transfer](https://mlsanity.com/paper/1907.01341/) (2019)
- [Depth Anything: Unleashing the Power of Large-Scale Unlabeled Data](https://mlsanity.com/paper/2401.10891/) (2024)
- [Instance Normalization: The Missing Ingredient for Fast Stylization](https://mlsanity.com/paper/1607.08022/) (2016)
- [YOLO-World: Real-Time Open-Vocabulary Object Detection](https://mlsanity.com/paper/2401.17270/) (2024)
- [An Underwater Image Enhancement Benchmark Dataset and Beyond](https://mlsanity.com/paper/1901.05495/) (2019)
- [Fast Underwater Image Enhancement for Improved Visual Perception](https://mlsanity.com/paper/1903.09766/) (2019)
- [Underwater Image Enhancement via Medium Transmission-Guided Multi-Color Space Embedding](https://mlsanity.com/paper/2104.13015/) (2021)
- [U-shape Transformer for Underwater Image Enhancement](https://mlsanity.com/paper/2111.11843/) (2021)
- [Enhancing Underwater Imagery using Generative Adversarial Networks](https://mlsanity.com/paper/1801.04011/) (2018)
- [Underwater Single Image Color Restoration Using Haze-Lines and a New Quantitative Dataset](https://mlsanity.com/paper/1811.01343/) (2018)
- [Underwater Ranker: Learn Which Is Better and How to Be Better](https://mlsanity.com/paper/2208.06857/) (2022)
- [PUGAN: Physical Model-Guided Underwater Image Enhancement Using GAN with Dual-Discriminators](https://mlsanity.com/paper/2306.08918/) (2023)
- [UIEC^2-Net: CNN-based Underwater Image Enhancement Using Two Color Space](https://mlsanity.com/paper/2103.07138/) (2021)
- [Atlantis: Enabling Underwater Depth Estimation with Stable Diffusion](https://mlsanity.com/paper/2312.12471/) (2023)
- [Five A+ Network: You Only Need 9K Parameters for Underwater Image Enhancement](https://mlsanity.com/paper/2305.08824/) (2023)
- [Unsupervised Single Image Underwater Depth Estimation](https://mlsanity.com/paper/1905.10595/) (2019)
- [A Generalized Physical-knowledge-guided Dynamic Model for Underwater Image Enhancement](https://mlsanity.com/paper/2308.05447/) (2023)
- [L^2UWE: A Framework for the Efficient Enhancement of Low-Light Underwater Images Using Local Contrast and Multi-Scale Fusion](https://mlsanity.com/paper/2005.13736/) (2020)
- [FDCE-Net: Underwater Image Enhancement with Embedding Frequency and Dual Color Encoder](https://mlsanity.com/paper/2404.17936/) (2024)
- [HybrUR: A Hybrid Physical-Neural Solution for Unsupervised Underwater Image Restoration](https://mlsanity.com/paper/2107.02660/) (2021)
- [End-To-End Underwater Video Enhancement: Dataset and Model](https://mlsanity.com/paper/2403.11506/) (2024)

## Built on by (most cited first, 9 of 9)

- [UWBench: A Comprehensive Vision-Language Benchmark for Underwater Understanding](https://mlsanity.com/paper/2510.18262/) (2025)
- [DPF-Net: Physical Imaging Model Embedded Data-Driven Underwater Image Enhancement](https://mlsanity.com/paper/2503.12470/) (2025)
- [Underwater Image Enhancement by Convolutional Spiking Neural Networks](https://mlsanity.com/paper/2503.20485/) (2025)
- [Underwater Diffusion Attention Network with Contrastive Language-Image Joint Learning for Underwater Image Enhancement](https://mlsanity.com/paper/2505.19895/) (2025)
- [snnTrans-DHZ: A Lightweight Spiking Neural Network Architecture for Underwater Image Dehazing](https://mlsanity.com/paper/2504.11482/) (2025)
- [TIDE: Two-Stage Inverse Degradation Estimation with Guided Prior Disentanglement for Underwater Image Restoration](https://mlsanity.com/paper/2512.07171/) (2025)
- [DY-LUT: Depth-Aware YCbCr Lookup Tables for Real-Time Underwater Image Enhancement](https://mlsanity.com/paper/2607.22801/) (2026)
- [PIC-UIE: Predicting Image-Adaptive Corrections for Lightweight Underwater Image Enhancement](https://mlsanity.com/paper/2609.33318/) (2026)
- [PolUR: Polarization Aware Multimodal Degradation Perception for Underwater Image Restoration](https://mlsanity.com/paper/2610.17991/) (2026)

## Abstract (arXiv)

Due to the selective absorption and scattering of light by diverse aquatic media, underwater images usually suffer from various visual degradations. Existing underwater image enhancement (UIE) approaches that combine underwater physical imaging models with neural networks often fail to accurately estimate imaging model parameters such as depth and veiling light, resulting in poor performance in certain scenarios. To address this issue, we propose a physical model-guided framework for jointly training a Deep Degradation Model (DDM) with any advanced UIE model. DDM includes three well-designed sub-networks to accurately estimate various imaging parameters: a veiling light estimation sub-network, a factors estimation sub-network, and a depth estimation sub-network. Based on the estimated parameters and the underwater physical imaging model, we impose physical constraints on the enhancement process by modeling the relationship between underwater images and desired clean images, i.e., outputs of the UIE model. Moreover, while our framework is compatible with any UIE model, we design a simple yet effective fully convolutional UIE model, termed UIEConv. UIEConv utilizes both global and local features for image enhancement through a dual-branch structure. UIEConv trained within our framework achieves remarkable enhancement results across diverse underwater scenes. Furthermore, as a byproduct of UIE, the trained depth estimation sub-network enables accurate underwater scene depth estimation. Extensive experiments conducted in various real underwater imaging scenarios, including deep-sea environments with artificial light sources, validate the effectiveness of our framework and the UIEConv model.
