mlsanityData to 14 Oct 2026

GridFormer: Residual Dense Transformer with Grid Structure for Image Restoration in Adverse Weather Conditions

arXiv 2305.17863 ↗First posted 29 May 2023cs.CVcited by 62

Not on the map. Why?

Abstract (arXiv)

Image restoration in adverse weather conditions is a difficult task in computer vision. In this paper, we propose a novel transformer-based framework called GridFormer which serves as a backbone for image restoration under adverse weather conditions. GridFormer is designed in a grid structure using a residual dense transformer block, and it introduces two core designs. First, it uses an enhanced attention mechanism in the transformer layer. The mechanism includes stages of the sampler and compact self-attention to improve efficiency, and a local enhancement stage to strengthen local information. Second, we introduce a residual dense transformer block (RDTB) as the final GridFormer layer. This design further improves the network's ability to learn effective features from both preceding and current local features. The GridFormer framework achieves state-of-the-art results on five diverse image restoration tasks in adverse weather conditions, including image deraining, dehazing, deraining & dehazing, desnowing, and multi-weather restoration. The source code and pre-trained models are available at https://github.com/TaoWangzj/GridFormer.

Key facts. Cited by 62 papers in the map (data through 14 Oct 2026). Builds on 56 of its 104 references that are in the map. First posted on arXiv 29 May 2023.

Builds on

56 of 104 references.

References · 56

  1. 2017Attention Is All You Needcited by 60,361
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  3. 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,364
  4. 2023Segment Anythingcited by 8,234
  5. 2020End-to-End Object Detection with Transformerscited by 7,414
  6. 2016Densely Connected Convolutional Networkscited by 6,720
  7. 2016SGDR: Stochastic Gradient Descent with Warm Restartscited by 5,045
  8. 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,527
  9. 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,322
  10. 2016Perceptual Losses for Real-Time Style Transfer and Super-Resolutioncited by 2,694
  11. 2021SwinIR: Image Restoration Using Swin Transformercited by 1,887
  12. 2021Restormer: Efficient Transformer for High-Resolution Image Restorationcited by 1,627
38 more
  1. 2019Deep High-Resolution Representation Learning for Visual Recognitioncited by 1,420
  2. 2018ESRGAN: Enhanced Super-Resolution Generative Adversarial Networkscited by 1,254
  3. 2016Real-Time Single Image and Video Super-Resolution Using an Efficient Sub-Pixel Convolutional Neural Networkcited by 1,204
  4. 2020Pre-Trained Image Processing Transformercited by 893
  5. 2021Uformer: A General U-Shaped Transformer for Image Restorationcited by 866
  6. 2021Multi-Stage Progressive Image Restorationcited by 816
  7. 2018Residual Dense Network for Image Super-Resolutioncited by 799
  8. 2017Benchmarking Single Image Dehazing and Beyondcited by 447
  9. 2016Deep Joint Rain Detection and Removal from a Single Imagecited by 352
  10. 2021Rethinking Coarse-to-Fine Approach in Single Image Deblurringcited by 326
  11. 2016DehazeNet: An End-to-End System for Single Image Haze Removalcited by 314
  12. 2019FFA-Net: Feature Fusion Attention Network for Single Image Dehazingcited by 307
  13. 2022MAXIM: Multi-Axis MLP for Image Processingcited by 302
  14. 2020Multi-Scale Progressive Fusion Network for Single Image Derainingcited by 260
  15. 2022Vision Transformers for Single Image Dehazingcited by 260
  16. 2018Density-aware Single Image De-raining using a Multi-stream Dense Networkcited by 248
  17. 2021TransWeather: Transformer-based Restoration of Images Degraded by Adverse Weather Conditionscited by 244
  18. 2020Multi-Scale Boosted Dehazing Network with Dense Feature Fusioncited by 230
  19. 2019GridDehazeNet: Attention-Based Multi-Scale Network for Image Dehazingcited by 227
  20. 2021Contrastive Learning for Compact Single Image Dehazingcited by 219
  21. 2022Restoring Vision in Adverse Weather Conditions with Patch-Based Denoising Diffusion Modelscited by 215
  22. 2018Recurrent Squeeze-and-Excitation Context Aggregation Net for Single Image Derainingcited by 205
  23. 2017Attentive Generative Adversarial Network for Raindrop Removal from a Single Imagecited by 204
  24. 2017DesnowNet: Context-Aware Deep Network for Snow Removalcited by 200
  25. 2017Image De-raining Using a Conditional Generative Adversarial Networkcited by 197
  26. 2019Spatial Attentive Single-Image Deraining with a High Quality Real Rain Datasetcited by 192
  27. 2022Ultra-High-Definition Low-Light Image Enhancement: A Benchmark and Transformer-Based Methodcited by 174
  28. 2019Heavy Rain Image Restoration: Integrating Physics Model and Conditional Adversarial Learningcited by 157
  29. 2018Densely Connected Pyramid Dehazing Networkcited by 145
  30. 2016Clearing the Skies: A deep network architecture for single-image rain removalcited by 136
  31. 2018Gated Fusion Network for Single Image Dehazingcited by 133
  32. 2020A Model-driven Deep Neural Network for Single Image Rain Removalcited by 125
  33. 2018Gated Context Aggregation Network for Image Dehazing and Derainingcited by 89
  34. 2021Deep Dense Multi-scale Network for Snow Removal Using Semantic and Geometric Priorscited by 82
  35. 2021U-Net Transformer: Self and Cross Attention for Medical Image Segmentationcited by 81
  36. 2019Dual Residual Networks Leveraging the Potential of Paired Operations for Image Restorationcited by 73
  37. 2021From Synthetic to Real: Image Dehazing Collaborating with Unlabeled Real Datacited by 68
  38. 2022Reversible Column Networkscited by 32

50 most cited of 56 All 56 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2023: 5; 2024: 13; 2025: 29; 2026: 15.

62 papers.

Sort:

By area:

  1. 2024AdaIR: Adaptive All-in-One Image Restoration via Frequency Mining and Modulationcited by 111
  2. 2023MB-TaylorFormer: Multi-branch Efficient Transformer Expanded by Taylor Formula for Image Dehazingcited by 81
  3. 2024Complexity Experts are Task-Discriminative Learners for Any Image Restorationcited by 77
  4. 2024Restoring Images in Adverse Weather Conditions via Histogram Transformercited by 73
  5. 2024Perceive-IR: Learning to Perceive Degradation Better for All-in-One Image Restorationcited by 62
  6. 2024A Survey on All-in-One Image Restoration: Taxonomy, Evaluation and Future Trendscited by 60
  7. 2025Vision-Language Gradient Descent-driven All-in-One Deep Unfolding Networkscited by 37
  8. 2025MB-TaylorFormer V2: Improved Multi-branch Linear Transformer Expanded by Taylor Formula for Image Restorationcited by 36
  9. 2024Learning A Physical-aware Diffusion Model Based on Transformer for Underwater Image Enhancementcited by 25
  10. 2025From Zero to Detail: Deconstructing Ultra-High-Definition Image Restoration from Progressive Spectral Perspectivecited by 23
  11. 2023Always Clear Days: Degradation Type and Severity Aware All-In-One Adverse Weather Removalcited by 12
  12. 2024RepQuant: Towards Accurate Post-Training Quantization of Large Transformer Models via Scale Reparameterizationcited by 10
38 more
  1. 2024CFMW: Cross-modality Fusion Mamba for Robust Object Detection under Adverse Weathercited by 8
  2. 2025Efficient Degradation-agnostic Image Restoration via Channel-Wise Functional Decomposition and Manifold Regularizationcited by 8
  3. 2025DSwinIR: Rethinking Window-based Attention for Image Restorationcited by 7
  4. 2025M2Restore: Mixture-of-Experts-based Mamba-CNN Fusion Framework for All-in-One Image Restorationcited by 7
  5. 2025EvoIR: Towards All-in-One Image Restoration via Evolutionary Frequency Modulationcited by 7
  6. 2023EGVD: Event-Guided Video Derainingcited by 6
  7. 2025Beyond Degradation Redundancy: Contrastive Prompt Learning for All-in-One Image Restorationcited by 6
  8. 2024Learning Efficient and Effective Trajectories for Differential Equation-based Image Restorationcited by 5
  9. 2025ClusIR: Towards Cluster-Guided All-in-One Image Restorationcited by 5
  10. 2023Robust Physics-based Deep MRI Reconstruction Via Diffusion Purificationcited by 4
  11. 2025Prompt to Restore, Restore to Prompt: Cyclic Prompting for Universal Adverse Weather Removalcited by 4
  12. 2025Learning Where and What to Restore for Composite Image Restorationcited by 4
  13. 2025SoftHGNN: Soft Hypergraph Neural Networks for General Visual Recognitioncited by 4
  14. 2023Benchmarking Ultra-High-Definition Image Reflection Removalcited by 3
  15. 2025Latent Harmony: Synergistic Unified UHD Image Restoration via Latent Space Regularization and Controllable Refinementcited by 3
  16. 2026UDPNet: Unleashing Depth-based Priors for Robust Image Dehazingcited by 3
  17. 2026PaAgent: Portrait-Aware Image Restoration Agent via Subjective-Objective Reinforcement Learningcited by 3
  18. 2026A Unified Foundation Model for All-in-One Multi-Modal Remote Sensing Image Restoration and Fusion with Language Promptingcited by 3
  19. 2025Decouple to Reconstruct: High Quality UHD Restoration via Active Feature Disentanglement and Reversible Fusioncited by 2
  20. 2025Efficient Dual-domain Image Dehazing with Haze Prior Perceptioncited by 2
  21. 2025IRPO: Boosting Image Restoration via Post-training GRPOcited by 2
  22. 2025Fourier-RWKV: A Multi-State Perception Network for Efficient Image Dehazingcited by 2
  23. 2024CorrAdaptor: Adaptive Local Context Learning for Correspondence Pruningcited by 1
  24. 2024SemiDDM-Weather: A Semi-supervised Learning Framework for All-in-one Adverse Weather Removalcited by 1
  25. 2024Joint multi-dimensional dynamic attention and transformer for general image restorationcited by 1
  26. 2025SpikeDerain: Unveiling Clear Videos from Rainy Sequences Using Color Spike Streamscited by 1
  27. 2025WDMamba: When Wavelet Degradation Prior Meets Vision Mamba for Image Dehazingcited by 1
  28. 2025Boosting All-in-One Image Restoration via Self-Improved Privilege Learningcited by 1
  29. 2025CLIP-driven rain perception: Adaptive deraining with pattern-aware network routing and mask-guided cross-attentioncited by 1
  30. 2025MoCHA-former: Moir'e-Conditioned Hybrid Adaptive Transformer for Video Demoir'eingcited by 1
  31. 2025RAM++: Robust Representation Learning via Adaptive Mask for All-in-One Image Restorationcited by 1
  32. 2025Clear Roads, Clear Vision: Advancements in Multi-Weather Restoration for Smart Transportationcited by 1
  33. 2025UHDRes: Ultra-High-Definition Image Restoration via Dual-Domain Decoupled Spectral Modulationcited by 1
  34. 2026DRNet: All-in-One Image Restoration via Prior-Guided Dynamic Reparameterizationcited by 1
  35. 2026ATT-CR: Adaptive Triangular Transformer for Cloud Removalcited by 1
  36. 2026Pixel Ignores, Superpixel Sees: Adverse Weather Image Restoration via Semantic-Center SSMcited by 1
  37. 2026Bend the Basics: Degradation-Aware Deformable Tokenization for All-in-One Image Restorationcited by 1
  38. 2026Degradation-Aware Prompt Learning with Cross-Modal Compensation for Adverse Weather Removalcited by 1

50 most cited of 62 All 62 (JSON)