mlsanityData to 7 Oct 2026

Uncertainty-Guided Adverse Weather Restoration via Gated Transformer Network

arXiv 2609.02434 ↗First posted 2 Sep 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Restoring images degraded by adverse weather remains challenging due to spatially heterogeneous degradations. Many existing weather-specific restoration models rely on weather-agnostic global aggregation, naive cross-scale fusion, and deterministic objectives, which struggle to handle heterogeneous degradations in all-in-one adverse-weather settings. To address these limitations, we propose an Uncertainty-guided Adverse-weather Restoration Network (UAR-Net), a weather-specific AiO framework that integrates a gated transformer with balanced multi-scale skip connections. Specifically, we employ Gated Dual-scale Transformer Blocks (GDTB) to jointly model selective global interactions and multi-scale local structures, a progressive Balanced Multi-scale Skip Connection (BMSC) for balanced multi-scale feature integration, and an Uncertainty-Aware Refinement Head (URH) that performs artifact removal, detail enhancement, and predictive uncertainty estimation. The model is supervised by a Brightness-Aware Energy Loss (BAE-Loss) to encourage accurate reconstruction with well-calibrated uncertainty. Extensive experiments demonstrate that our method achieves state-of-the-art performance across multiple adverse-weather benchmarks. The codes will open source upon acceptance.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 40 of its 63 references that are in the map. First posted on arXiv 2 Sep 2026.

Builds on

40 of 63 references.

References · 40

  1. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  2. 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,617
  3. 2020End-to-End Object Detection with Transformerscited by 7,384
  4. 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,510
  5. 2017Non-local Neural Networkscited by 2,290
  6. 2020Transformers are RNNs: Fast Autoregressive Transformers with Linear Attentioncited by 1,979
  7. 2021Restormer: Efficient Transformer for High-Resolution Image Restorationcited by 1,618
  8. 2021MUSIQ: Multi-scale Image Quality Transformercited by 1,058
  9. 2021Multi-Stage Progressive Image Restorationcited by 813
  10. 2022Simple Baselines for Image Restorationcited by 701
  11. 2023Q-Align: Teaching LMMs for Visual Scoring via Discrete Text-Defined Levelscited by 489
  12. 2022MAXIM: Multi-Axis MLP for Image Processingcited by 301
28 more
  1. 2025Gated Attention for Large Language Models: Non-linearity, Sparsity, and Attention-Sink-Freecited by 266
  2. 2020Multi-Scale Progressive Fusion Network for Single Image Derainingcited by 259
  3. 2019Libra R-CNN: Towards Balanced Learning for Object Detectioncited by 255
  4. 2021TransWeather: Transformer-based Restoration of Images Degraded by Adverse Weather Conditionscited by 243
  5. 2021Contrastive Learning for Compact Single Image Dehazingcited by 219
  6. 2022Restoring Vision in Adverse Weather Conditions with Patch-Based Denoising Diffusion Modelscited by 215
  7. 2022cosFormer: Rethinking Softmax in Attentioncited by 212
  8. 2018Recurrent Squeeze-and-Excitation Context Aggregation Net for Single Image Derainingcited by 205
  9. 2017Attentive Generative Adversarial Network for Raindrop Removal from a Single Imagecited by 204
  10. 2023Learning A Sparse Transformer Network for Effective Image Derainingcited by 204
  11. 2017DesnowNet: Context-Aware Deep Network for Snow Removalcited by 200
  12. 2019Spatial Attentive Single-Image Deraining with a High Quality Real Rain Datasetcited by 192
  13. 2019Heavy Rain Image Restoration: Integrating Physics Model and Conditional Adversarial Learningcited by 157
  14. 2022Deep Generalized Unfolding Networks for Image Restorationcited by 119
  15. 2019Uncertainty Guided Multi-Scale Residual Learning-using a Cycle Spinning CNN for Single Image De-Rainingcited by 117
  16. 2021Deep Dense Multi-scale Network for Snow Removal Using Semantic and Geometric Priorscited by 82
  17. 2019Dual Residual Networks Leveraging the Potential of Paired Operations for Image Restorationcited by 73
  18. 2024Selective Hourglass Mapping for Universal Image Restoration Based on Diffusion Modelcited by 73
  19. 2024Restoring Images in Adverse Weather Conditions via Histogram Transformercited by 73
  20. 2018Robust Video Content Alignment and Compensation for Rain Removal in a CNN Frameworkcited by 53
  21. 2024MWFormer: Multi-Weather Image Restoration Using Degradation-Aware Transformerscited by 24
  22. 2024You Only Look Around: Learning Illumination Invariant Feature for Low-light Object Detectioncited by 9
  23. 2022FogAdapt: Self-Supervised Domain Adaptation for Semantic Segmentation of Foggy Imagescited by 7
  24. 2024Building Vision Models upon Heat Conductioncited by 7
  25. 2025MODEM: A Morton-Order Degradation Estimation Mechanism for Adverse Weather Image Recoverycited by 6
  26. 2025GT-Mean Loss: A Simple Yet Effective Solution for Brightness Mismatch in Low-Light Image Enhancementcited by 5
  27. 2025URNet: Uncertainty-aware Refinement Network for Event-based Stereo Depth Estimationcited by 4
  28. 2025FuseUNet: A Multi-Scale Feature Fusion Method for U-like Networkscited by 3

Built on by

Not cited yet.