# A Spatio-temporal Aligned SUNet Model for Low-light Video Enhancement

arXiv: https://arxiv.org/abs/2403.02408 · HTML: https://mlsanity.com/paper/2403.02408/

## Key facts

- Cited by 8 papers in the map (data through 14 Oct 2026).
- Builds on 14 of its 25 references that are in the map.
- First posted on arXiv 4 Mar 2024.

## Builds on (most cited first, 14 of 14)

- [Attention Is All You Need](https://mlsanity.com/paper/1706.03762/) (2017)
- [Deep Residual Learning for Image Recognition](https://mlsanity.com/paper/1512.03385/) (2015)
- [U-Net: Convolutional Networks for Biomedical Image Segmentation](https://mlsanity.com/paper/1505.04597/) (2015)
- [Swin Transformer: Hierarchical Vision Transformer using Shifted Windows](https://mlsanity.com/paper/2103.14030/) (2021)
- [Deformable Convolutional Networks](https://mlsanity.com/paper/1703.06211/) (2017)
- [Real-Time Single Image and Video Super-Resolution Using an Efficient Sub-Pixel Convolutional Neural Network](https://mlsanity.com/paper/1609.05158/) (2016)
- [EDVR: Video Restoration with Enhanced Deformable Convolutional Networks](https://mlsanity.com/paper/1905.02716/) (2019)
- [Learning to See in the Dark](https://mlsanity.com/paper/1805.01934/) (2018)
- [LLNet: A Deep Autoencoder Approach to Natural Low-light Image Enhancement](https://mlsanity.com/paper/1511.03995/) (2015)
- [Low-Light Image and Video Enhancement Using Deep Learning: A Survey](https://mlsanity.com/paper/2104.10729/) (2021)
- [SUNet: Swin Transformer UNet for Image Denoising](https://mlsanity.com/paper/2202.14009/) (2022)
- [Low Light Video Enhancement using Synthetic Data Produced with an Intermediate Domain Mapping](https://mlsanity.com/paper/2007.09187/) (2020)
- [Contextual colorization and denoising for low-light ultra high resolution sequences](https://mlsanity.com/paper/2101.01597/) (2021)
- [A Comprehensive Study of Object Tracking in Low-Light Environments](https://mlsanity.com/paper/2312.16250/) (2023)

## Built on by (most cited first, 8 of 8)

- [BVI-RLV: A Fully Registered Dataset for Low-Light Video Enhancement](https://mlsanity.com/paper/2407.03535/) (2024)
- [DeTurb: Atmospheric Turbulence Mitigation with Deformable 3D Convolutions and 3D Swin Transformers](https://mlsanity.com/paper/2407.20855/) (2024)
- [Zero-TIG: Temporal Consistency-Aware Zero-Shot Illumination-Guided Low-light Video Enhancement](https://mlsanity.com/paper/2503.11175/) (2025)
- [Towards a General-Purpose Zero-Shot Synthetic Low-Light Image and Video Pipeline](https://mlsanity.com/paper/2504.12169/) (2025)
- [BVI-Mamba: Video Enhancement Using a Visual State-Space Model for Low-Light and Underwater Environments](https://mlsanity.com/paper/2604.23655/) (2026)
- [A review of advancements in low-light image enhancement using deep learning](https://mlsanity.com/paper/2505.05759/) (2025)
- [Dynamic Weight-based Temporal Aggregation for Low-light Video Enhancement Under Extreme Noise](https://mlsanity.com/paper/2510.09450/) (2025)
- [Low-Light Video Enhancement with An Effective Spatial-Temporal Decomposition Paradigm](https://mlsanity.com/paper/2602.08699/) (2026)

## Abstract (arXiv)

Distortions caused by low-light conditions are not only visually unpleasant but also degrade the performance of computer vision tasks. The restoration and enhancement have proven to be highly beneficial. However, there are only a limited number of enhancement methods explicitly designed for videos acquired in low-light conditions. We propose a Spatio-Temporal Aligned SUNet (STA-SUNet) model using a Swin Transformer as a backbone to capture low light video features and exploit their spatio-temporal correlations. The STA-SUNet model is trained on a novel, fully registered dataset (BVI), which comprises dynamic scenes captured under varying light conditions. It is further analysed comparatively against various other models over three test datasets. The model demonstrates superior adaptivity across all datasets, obtaining the highest PSNR and SSIM values. It is particularly effective in extreme low-light conditions, yielding fairly good visualisation results.
