# RSFDM-Net: Real-time Spatial and Frequency Domains Modulation Network for Underwater Image Enhancement

arXiv: https://arxiv.org/abs/2302.12186 · HTML: https://mlsanity.com/paper/2302.12186/

## Key facts

- Cited by 3 papers in the map (data through 14 Oct 2026).
- Builds on 11 of its 36 references that are in the map.
- First posted on arXiv 23 Feb 2023.

## Builds on (most cited first, 11 of 11)

- [Very Deep Convolutional Networks for Large-Scale Image Recognition](https://mlsanity.com/paper/1409.1556/) (2014)
- [An Underwater Image Enhancement Benchmark Dataset and Beyond](https://mlsanity.com/paper/1901.05495/) (2019)
- [Underwater Image Enhancement via Medium Transmission-Guided Multi-Color Space Embedding](https://mlsanity.com/paper/2104.13015/) (2021)
- [Conditional Sequential Modulation for Efficient Global Image Retouching](https://mlsanity.com/paper/2009.10390/) (2020)
- [Uncertainty Inspired Underwater Image Enhancement](https://mlsanity.com/paper/2207.09689/) (2022)
- [MSP-Former: Multi-Scale Projection Transformer for Single Image Desnowing](https://mlsanity.com/paper/2207.05621/) (2022)
- [Shallow-UWnet : Compressed Model for Underwater Image Enhancement](https://mlsanity.com/paper/2101.02073/) (2021)
- [UIEC^2-Net: CNN-based Underwater Image Enhancement Using Two Color Space](https://mlsanity.com/paper/2103.07138/) (2021)
- [Enhancement of Underwater Images with Statistical Model of Background Light and Optimization of Transmission Map](https://mlsanity.com/paper/1906.08673/) (2019)
- [Underwater Image Restoration via Contrastive Learning and a Real-world Dataset](https://mlsanity.com/paper/2106.10718/) (2021)
- [Towards Real-time High-Definition Image Snow Removal: Efficient Pyramid Network with Asymmetrical Encoder-decoder Architecture](https://mlsanity.com/paper/2207.05605/) (2022)

## Built on by (most cited first, 3 of 3)

- [Five A+ Network: You Only Need 9K Parameters for Underwater Image Enhancement](https://mlsanity.com/paper/2305.08824/) (2023)
- [NightHazeFormer: Single Nighttime Haze Removal Using Prior Query Transformer](https://mlsanity.com/paper/2305.09533/) (2023)
- [Integrating View Conditions for Image Synthesis](https://mlsanity.com/paper/2310.16002/) (2023)

## Abstract (arXiv)

Underwater images typically experience mixed degradations of brightness and structure caused by the absorption and scattering of light by suspended particles. To address this issue, we propose a Real-time Spatial and Frequency Domains Modulation Network (RSFDM-Net) for the efficient enhancement of colors and details in underwater images. Specifically, our proposed conditional network is designed with Adaptive Fourier Gating Mechanism (AFGM) and Multiscale Convolutional Attention Module (MCAM) to generate vectors carrying low-frequency background information and high-frequency detail features, which effectively promote the network to model global background information and local texture details. To more precisely correct the color cast and low saturation of the image, we introduce a Three-branch Feature Extraction (TFE) block in the primary net that processes images pixel by pixel to integrate the color information extended by the same channel (R, G, or B). This block consists of three small branches, each of which has its own weights. Extensive experiments demonstrate that our network significantly outperforms over state-of-the-art methods in both visual quality and quantitative metrics.
