mlsanityData to 7 Oct 2026

TransWeather: Transformer-based Restoration of Images Degraded by Adverse Weather Conditions

arXiv 2111.14813 ↗First posted 29 Nov 2021cs.CVcited by 243

Not on the map. Why?

Cited by 28 in Diffusion models, but placed by its own abstract, which didn’t fit.

Abstract (arXiv)

Removing adverse weather conditions like rain, fog, and snow from images is an important problem in many applications. Most methods proposed in the literature have been designed to deal with just removing one type of degradation. Recently, a CNN-based method using neural architecture search (All-in-One) was proposed to remove all the weather conditions at once. However, it has a large number of parameters as it uses multiple encoders to cater to each weather removal task and still has scope for improvement in its performance. In this work, we focus on developing an efficient solution for the all adverse weather removal problem. To this end, we propose TransWeather, a transformer-based end-to-end model with just a single encoder and a decoder that can restore an image degraded by any weather condition. Specifically, we utilize a novel transformer encoder using intra-patch transformer blocks to enhance attention inside the patches to effectively remove smaller weather degradations. We also introduce a transformer decoder with learnable weather type embeddings to adjust to the weather degradation at hand. TransWeather achieves improvements across multiple test datasets over both All-in-One network as well as methods fine-tuned for specific tasks. TransWeather is also validated on real world test images and found to be more effective than previous methods. Implementation code can be accessed at https://github.com/jeya-maria-jose/TransWeather .

Key facts. Cited by 243 papers in the map (data through 7 Oct 2026). Builds on 49 of its 76 references that are in the map. First posted on arXiv 29 Nov 2021.

Builds on

49 of 76 references.

References · 49

  1. 2017Attention Is All You Needcited by 59,932
  2. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  3. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  4. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
  5. 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
  6. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
  7. 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,617
  8. 2020End-to-End Object Detection with Transformerscited by 7,384
  9. 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,510
  10. 2016Gaussian Error Linear Units (GELUs)cited by 3,431
  11. 2018Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentationcited by 3,210
  12. 2021SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformerscited by 2,923
37 more
  1. 2016Xception: Deep Learning with Depthwise Separable Convolutionscited by 2,320
  2. 2021Pyramid Vision Transformer: A Versatile Backbone for Dense Prediction without Convolutionscited by 1,960
  3. 2021SwinIR: Image Restoration Using Swin Transformercited by 1,869
  4. 2020Rethinking Semantic Segmentation from a Sequence-to-Sequence Perspective with Transformerscited by 1,368
  5. 2021Video Swin Transformercited by 1,090
  6. 2021CvT: Introducing Convolutions to Vision Transformerscited by 946
  7. 2020Pre-Trained Image Processing Transformercited by 891
  8. 2021Uformer: A General U-Shaped Transformer for Image Restorationcited by 864
  9. 2021Multi-Stage Progressive Image Restorationcited by 813
  10. 2020PCT: Point cloud transformercited by 730
  11. 2017Frustum PointNets for 3D Object Detection from RGB-D Datacited by 640
  12. 2021Multi-Modal Fusion Transformer for End-to-End Autonomous Drivingcited by 372
  13. 2021Medical Transformer: Gated Axial-Attention for Medical Image Segmentationcited by 319
  14. 2016DehazeNet: An End-to-End System for Single Image Haze Removalcited by 313
  15. 2020Deep Continuous Fusion for Multi-Sensor 3D Object Detectioncited by 263
  16. 2018Density-aware Single Image De-raining using a Multi-stream Dense Networkcited by 248
  17. 2020Multi-Scale Boosted Dehazing Network with Dense Feature Fusioncited by 229
  18. 2021LocalViT: Analyzing Locality in Vision Transformerscited by 228
  19. 2021Contrastive Learning for Compact Single Image Dehazingcited by 219
  20. 2018Recurrent Squeeze-and-Excitation Context Aggregation Net for Single Image Derainingcited by 205
  21. 2017Attentive Generative Adversarial Network for Raindrop Removal from a Single Imagecited by 204
  22. 2017DesnowNet: Context-Aware Deep Network for Snow Removalcited by 200
  23. 2017Image De-raining Using a Conditional Generative Adversarial Networkcited by 197
  24. 2019Spatial Attentive Single-Image Deraining with a High Quality Real Rain Datasetcited by 192
  25. 2019Heavy Rain Image Restoration: Integrating Physics Model and Conditional Adversarial Learningcited by 157
  26. 2018Densely Connected Pyramid Dehazing Networkcited by 145
  27. 2018Gated Fusion Network for Single Image Dehazingcited by 133
  28. 2020TransPose: Keypoint Localization via Transformercited by 126
  29. 2020A Model-driven Deep Neural Network for Single Image Rain Removalcited by 125
  30. 2019Uncertainty Guided Multi-Scale Residual Learning-using a Cycle Spinning CNN for Single Image De-Rainingcited by 117
  31. 2021Deep Dense Multi-scale Network for Snow Removal Using Semantic and Geometric Priorscited by 82
  32. 2019Single Image Deraining: From Model-Based to Data-Driven and Beyondcited by 77
  33. 2020Syn2Real Transfer Learning for Image Deraining using Gaussian Processescited by 62
  34. 2019UAV-GESTURE: A Dataset for UAV Control and Gesture Recognitioncited by 19
  35. 2017Joint Transmission Map Estimation and Dehazing using Deep Networkscited by 16
  36. 2020Exploring Overcomplete Representations for Single Image Deraining using CNNscited by 11
  37. 2021SDNet: mutil-branch for single image deraining using swincited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2022: 15; 2023: 43; 2024: 73; 2025: 62; 2026: 50.

243 papers.

Sort:

By area:

  1. 2022Vision Transformers for Single Image Dehazingcited by 255
  2. 2022Restoring Vision in Adverse Weather Conditions with Patch-Based Denoising Diffusion Modelscited by 215
  3. 2024InstructIR: High-Quality Image Restoration Following Human Instructionscited by 139
  4. 2023PromptIR: Prompting for All-in-One Blind Image Restorationcited by 113
  5. 2024AdaIR: Adaptive All-in-One Image Restoration via Frequency Mining and Modulationcited by 108
  6. 2023AutoDIR: Automatic All-in-One Image Restoration with Latent Diffusioncited by 98
  7. 2024OneRestore: A Universal Restoration Framework for Composite Degradationcited by 91
  8. 2022You Only Need 90K Parameters to Adapt Light: A Light Weight Transformer for Image Enhancement and Exposure Correctioncited by 81
  9. 2024Selective Hourglass Mapping for Universal Image Restoration Based on Diffusion Modelcited by 73
  10. 2024Restoring Images in Adverse Weather Conditions via Histogram Transformercited by 73
  11. 2024Complexity Experts are Task-Discriminative Learners for Any Image Restorationcited by 72
  12. 2023GridFormer: Residual Dense Transformer with Grid Structure for Image Restoration in Adverse Weather Conditionscited by 62
38 more
  1. 2024Perceive-IR: Learning to Perceive Degradation Better for All-in-One Image Restorationcited by 60
  2. 2024A Survey on All-in-One Image Restoration: Taxonomy, Evaluation and Future Trendscited by 58
  3. 2023WaveDM: Wavelet-Based Diffusion Models for Image Restorationcited by 46
  4. 2023Neural Degradation Representation Learning for All-In-One Image Restorationcited by 46
  5. 2023Sparse Sampling Transformer with Uncertainty-Driven Ranking for Unified Removal of Raindrops and Rain Streakscited by 45
  6. 2024An Intelligent Agentic System for Complex Image Restoration Problemscited by 41
  7. 2022MSP-Former: Multi-Scale Projection Transformer for Single Image Desnowingcited by 39
  8. 2023From Sky to the Ground: A Large-scale Benchmark and Simple Baseline Towards Real Rain Removalcited by 39
  9. 2025UniRestore: Unified Perceptual and Task-Oriented Image Restoration Model Using Diffusion Priorcited by 39
  10. 2025Degradation-Aware Feature Perturbation for All-in-One Image Restorationcited by 39
  11. 2024FoundIR: Unleashing Million-scale Training Data to Advance Foundation Models for Image Restorationcited by 37
  12. 2025Vision-Language Gradient Descent-driven All-in-One Deep Unfolding Networkscited by 37
  13. 2023Language-driven All-in-one Adverse Weather Removalcited by 36
  14. 2023Towards Unified Deep Image Deraining: A Survey and A New Benchmarkcited by 34
  15. 2024FourierMamba: Fourier Learning Integration with State Space Models for Image Derainingcited by 32
  16. 2024DocRes: A Generalist Model Toward Unifying Document Image Restoration Taskscited by 27
  17. 2025Visual-Instructed Degradation Diffusion for All-in-One Image Restorationcited by 26
  18. 2024Teaching Tailored to Talent: Adverse Weather Restoration via Prompt Pool and Depth-Anything Constraintcited by 24
  19. 2024MWFormer: Multi-Weather Image Restoration Using Degradation-Aware Transformerscited by 24
  20. 2023Prompt-based Ingredient-Oriented All-in-One Image Restorationcited by 22
  21. 2024UniProcessor: A Text-induced Unified Low-level Image Processorcited by 22
  22. 2025NTIRE 2025 Challenge on Day and Night Raindrop Removal for Dual-Focused Images: Methods and Resultscited by 22
  23. 2023All-in-one Multi-degradation Image Restoration Network via Hierarchical Degradation Representationcited by 21
  24. 2023Video Adverse-Weather-Component Suppression Network via Weather Messenger and Adversarial Backpropagationcited by 21
  25. 2024Degradation-Aware Residual-Conditioned Optimal Transport for Unified Image Restorationcited by 21
  26. 2022Self-Calibrated Efficient Transformer for Lightweight Super-Resolutioncited by 20
  27. 2025WeatherBench: A Real-World Benchmark Dataset for All-in-One Adverse Weather Image Restorationcited by 20
  28. 2023NightHazeFormer: Single Nighttime Haze Removal Using Prior Query Transformercited by 19
  29. 2023MixDehazeNet : Mix Structure Block For Image Dehazing Networkcited by 18
  30. 2024Seeing the Unseen: A Frequency Prompt Guided Transformer for Image Restorationcited by 18
  31. 2024Multi-Expert Adaptive Selection: Task-Balancing for All-in-One Image Restorationcited by 18
  32. 2024LoRA-IR: Taming Low-Rank Experts for Efficient All-in-One Image Restorationcited by 18
  33. 2023HQ-50K: A Large-scale, High-quality Dataset for Image Restorationcited by 15
  34. 2024Diff-Restorer: Unleashing Visual Prompts for Diffusion-based Universal Image Restorationcited by 15
  35. 2024Phaseformer: Phase-based Attention Mechanism for Underwater Image Restoration and Beyondcited by 15
  36. 2025RestoreVAR: Visual Autoregressive Generation for All-in-One Image Restorationcited by 15
  37. 2022MIPI 2022 Challenge on Under-Display Camera Image Restoration: Methods and Resultscited by 14
  38. 2023Counting Crowds in Bad Weathercited by 14

50 most cited of 243 All 243 (JSON)