Uncertainty-Guided Adverse Weather Restoration via Gated Transformer Network
Not on the map. Why?
Abstract (arXiv)
Restoring images degraded by adverse weather remains challenging due to spatially heterogeneous degradations. Many existing weather-specific restoration models rely on weather-agnostic global aggregation, naive cross-scale fusion, and deterministic objectives, which struggle to handle heterogeneous degradations in all-in-one adverse-weather settings. To address these limitations, we propose an Uncertainty-guided Adverse-weather Restoration Network (UAR-Net), a weather-specific AiO framework that integrates a gated transformer with balanced multi-scale skip connections. Specifically, we employ Gated Dual-scale Transformer Blocks (GDTB) to jointly model selective global interactions and multi-scale local structures, a progressive Balanced Multi-scale Skip Connection (BMSC) for balanced multi-scale feature integration, and an Uncertainty-Aware Refinement Head (URH) that performs artifact removal, detail enhancement, and predictive uncertainty estimation. The model is supervised by a Brightness-Aware Energy Loss (BAE-Loss) to encourage accurate reconstruction with well-calibrated uncertainty. Extensive experiments demonstrate that our method achieves state-of-the-art performance across multiple adverse-weather benchmarks. The codes will open source upon acceptance.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 40 of its 63 references that are in the map. First posted on arXiv 2 Sep 2026.
Builds on
40 of 63 references.
References · 40
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,617
- 2020End-to-End Object Detection with Transformerscited by 7,384
- 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,510
- 2017Non-local Neural Networkscited by 2,290
- 2020Transformers are RNNs: Fast Autoregressive Transformers with Linear Attentioncited by 1,979
- 2021Restormer: Efficient Transformer for High-Resolution Image Restorationcited by 1,618
- 2021MUSIQ: Multi-scale Image Quality Transformercited by 1,058
- 2021Multi-Stage Progressive Image Restorationcited by 813
- 2022Simple Baselines for Image Restorationcited by 701
- 2023Q-Align: Teaching LMMs for Visual Scoring via Discrete Text-Defined Levelscited by 489
- 2022MAXIM: Multi-Axis MLP for Image Processingcited by 301
28 more
- 2025Gated Attention for Large Language Models: Non-linearity, Sparsity, and Attention-Sink-Freecited by 266
- 2020Multi-Scale Progressive Fusion Network for Single Image Derainingcited by 259
- 2019Libra R-CNN: Towards Balanced Learning for Object Detectioncited by 255
- 2021TransWeather: Transformer-based Restoration of Images Degraded by Adverse Weather Conditionscited by 243
- 2021Contrastive Learning for Compact Single Image Dehazingcited by 219
- 2022Restoring Vision in Adverse Weather Conditions with Patch-Based Denoising Diffusion Modelscited by 215
- 2022cosFormer: Rethinking Softmax in Attentioncited by 212
- 2018Recurrent Squeeze-and-Excitation Context Aggregation Net for Single Image Derainingcited by 205
- 2017Attentive Generative Adversarial Network for Raindrop Removal from a Single Imagecited by 204
- 2023Learning A Sparse Transformer Network for Effective Image Derainingcited by 204
- 2017DesnowNet: Context-Aware Deep Network for Snow Removalcited by 200
- 2019Spatial Attentive Single-Image Deraining with a High Quality Real Rain Datasetcited by 192
- 2019Heavy Rain Image Restoration: Integrating Physics Model and Conditional Adversarial Learningcited by 157
- 2022Deep Generalized Unfolding Networks for Image Restorationcited by 119
- 2019Uncertainty Guided Multi-Scale Residual Learning-using a Cycle Spinning CNN for Single Image De-Rainingcited by 117
- 2021Deep Dense Multi-scale Network for Snow Removal Using Semantic and Geometric Priorscited by 82
- 2019Dual Residual Networks Leveraging the Potential of Paired Operations for Image Restorationcited by 73
- 2024Selective Hourglass Mapping for Universal Image Restoration Based on Diffusion Modelcited by 73
- 2024Restoring Images in Adverse Weather Conditions via Histogram Transformercited by 73
- 2018Robust Video Content Alignment and Compensation for Rain Removal in a CNN Frameworkcited by 53
- 2024MWFormer: Multi-Weather Image Restoration Using Degradation-Aware Transformerscited by 24
- 2024You Only Look Around: Learning Illumination Invariant Feature for Low-light Object Detectioncited by 9
- 2022FogAdapt: Self-Supervised Domain Adaptation for Semantic Segmentation of Foggy Imagescited by 7
- 2024Building Vision Models upon Heat Conductioncited by 7
- 2025MODEM: A Morton-Order Degradation Estimation Mechanism for Adverse Weather Image Recoverycited by 6
- 2025GT-Mean Loss: A Simple Yet Effective Solution for Brightness Mismatch in Low-Light Image Enhancementcited by 5
- 2025URNet: Uncertainty-aware Refinement Network for Event-based Stereo Depth Estimationcited by 4
- 2025FuseUNet: A Multi-Scale Feature Fusion Method for U-like Networkscited by 3
Built on by
Not cited yet.