# Physics Informed Capsule Enhanced Variational AutoEncoder for Underwater Image Enhancement

arXiv: https://arxiv.org/abs/2506.04753 · HTML: https://mlsanity.com/paper/2506.04753/

## Key facts

- No citing papers in the map yet (data through 14 Oct 2026).
- Builds on 16 of its 55 references that are in the map.
- First posted on arXiv 5 Jun 2025.

## Builds on (most cited first, 16 of 16)

- [U-Net: Convolutional Networks for Biomedical Image Segmentation](https://mlsanity.com/paper/1505.04597/) (2015)
- [The Unreasonable Effectiveness of Deep Features as a Perceptual Metric](https://mlsanity.com/paper/1801.03924/) (2018)
- [Taming Transformers for High-Resolution Image Synthesis](https://mlsanity.com/paper/2012.09841/) (2020)
- [Exploring CLIP for Assessing the Look and Feel of Images](https://mlsanity.com/paper/2207.12396/) (2022)
- [Dynamic Routing Between Capsules](https://mlsanity.com/paper/1710.09829/) (2017)
- [An Underwater Image Enhancement Benchmark Dataset and Beyond](https://mlsanity.com/paper/1901.05495/) (2019)
- [Fast Underwater Image Enhancement for Improved Visual Perception](https://mlsanity.com/paper/1903.09766/) (2019)
- [U-shape Transformer for Underwater Image Enhancement](https://mlsanity.com/paper/2111.11843/) (2021)
- [Enhancing Underwater Imagery using Generative Adversarial Networks](https://mlsanity.com/paper/1801.04011/) (2018)
- [Underwater Single Image Color Restoration Using Haze-Lines and a New Quantitative Dataset](https://mlsanity.com/paper/1811.01343/) (2018)
- [Real-world Underwater Enhancement: Challenges, Benchmarks, and Solutions](https://mlsanity.com/paper/1901.05320/) (2019)
- [Wavelet-based Fourier Information Interaction with Frequency Diffusion Adjustment for Underwater Image Restoration](https://mlsanity.com/paper/2311.16845/) (2023)
- [Simultaneous Enhancement and Super-Resolution of Underwater Imagery for Improved Visual Perception](https://mlsanity.com/paper/2002.01155/) (2020)
- [Underwater Image Enhancement by Transformer-based Diffusion Model with Non-uniform Sampling for Skip Strategy](https://mlsanity.com/paper/2309.03445/) (2023)
- [Learning A Physical-aware Diffusion Model Based on Transformer for Underwater Image Enhancement](https://mlsanity.com/paper/2403.01497/) (2024)
- [CE-VAE: Capsule Enhanced Variational AutoEncoder for Underwater Image Enhancement](https://mlsanity.com/paper/2406.01294/) (2024)

## Abstract (arXiv)

We present a novel dual-stream architecture that achieves state-of-the-art underwater image enhancement by explicitly integrating the Jaffe-McGlamery physical model with capsule clustering-based feature representation learning. Our method simultaneously estimates transmission maps and spatially-varying background light through a dedicated physics estimator while extracting entity-level features via capsule clustering in a parallel stream. This physics-guided approach enables parameter-free enhancement that respects underwater formation constraints while preserving semantic structures and fine-grained details. Our approach also features a novel optimization objective ensuring both physical adherence and perceptual quality across multiple spatial frequencies. To validate our approach, we conducted extensive experiments across six challenging benchmarks. Results demonstrate consistent improvements of +0.5dB PSNR over the best existing methods while requiring only one-third of their computational complexity (FLOPs), or alternatively, more than +1dB PSNR improvement when compared to methods with similar computational budgets. Code and data textitwill be available at https://github.com/iN1k1/.