mlsanityData to 7 Oct 2026

Restore Anything with Masks: Leveraging Mask Image Modeling for Blind All-in-One Image Restoration

arXiv 2409.19403 ↗First posted 28 Sep 2024cs.CVcited by 20

Not on the map. Why?

Abstract (arXiv)

All-in-one image restoration aims to handle multiple degradation types using one model. This paper proposes a simple pipeline for all-in-one blind image restoration to Restore Anything with Masks (RAM). We focus on the image content by utilizing Mask Image Modeling to extract intrinsic image information rather than distinguishing degradation types like other methods. Our pipeline consists of two stages: masked image pre-training and fine-tuning with mask attribute conductance. We design a straightforward masking pre-training approach specifically tailored for all-in-one image restoration. This approach enhances networks to prioritize the extraction of image content priors from various degradations, resulting in a more balanced performance across different restoration tasks and achieving stronger overall results. To bridge the gap of input integrity while preserving learned image priors as much as possible, we selectively fine-tuned a small portion of the layers. Specifically, the importance of each layer is ranked by the proposed Mask Attribute Conductance (MAC), and the layers with higher contributions are selected for finetuning. Extensive experiments demonstrate that our method achieves state-of-the-art performance. Our code and model will be released at hrefhttps://github.com/Dragonisss/RAMhttps://github.com/Dragonisss/RAM.

Key facts. Cited by 20 papers in the map (data through 7 Oct 2026). Builds on 38 of its 62 references that are in the map. First posted on arXiv 28 Sep 2024.

Builds on

38 of 62 references.

References · 38

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
  3. 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
  4. 2017Axiomatic Attribution for Deep Networkscited by 3,350
  5. 2021SwinIR: Image Restoration Using Swin Transformercited by 1,869
  6. 2021Restormer: Efficient Transformer for High-Resolution Image Restorationcited by 1,618
  7. 2021SimMIM: A Simple Framework for Masked Image Modelingcited by 1,147
  8. 2020Pre-Trained Image Processing Transformercited by 891
  9. 2021Uformer: A General U-Shaped Transformer for Image Restorationcited by 864
  10. 2016Deep Multi-scale Convolutional Neural Network for Dynamic Scene Deblurringcited by 722
  11. 2018Deep Retinex Decomposition for Low-Light Enhancementcited by 720
  12. 2022Simple Baselines for Image Restorationcited by 701
26 more
  1. 2020Zero-Reference Deep Curve Estimation for Low-Light Image Enhancementcited by 541
  2. 2017Benchmarking Single Image Dehazing and Beyondcited by 445
  3. 2016Deep Joint Rain Detection and Removal from a Single Imagecited by 351
  4. 2022Images Speak in Images: A Generalist Painter for In-Context Visual Learningcited by 317
  5. 2018Density-aware Single Image De-raining using a Multi-stream Dense Networkcited by 248
  6. 2018Recurrent Squeeze-and-Excitation Context Aggregation Net for Single Image Derainingcited by 205
  7. 2017Image De-raining Using a Conditional Generative Adversarial Networkcited by 197
  8. 2016Clearing the Skies: A deep network architecture for single-image rain removalcited by 136
  9. 2020Interpreting Super-Resolution Networks with Local Attribution Mapscited by 136
  10. 2023Embedding Fourier for Ultra-High-Definition Low-Light Image Enhancementcited by 86
  11. 2019Single Image Deraining: From Model-Based to Data-Driven and Beyondcited by 77
  12. 2018How Important Is a Neuron?cited by 73
  13. 2023RIDCP: Revitalizing Real Image Dehazing via High-Quality Codebook Priorscited by 73
  14. 2019A General Decoupled Learning Framework for Parameterized Image Operatorscited by 72
  15. 2023Masked Image Training for Generalizable Deep Image Denoisingcited by 57
  16. 2022TAPE: Task-Agnostic Prior Embedding for Image Restorationcited by 54
  17. 2020MPRNet: Multi-Path Residual Network for Lightweight Image Super Resolutioncited by 38
  18. 2022Learning Degradation Representations for Image Deblurringcited by 35
  19. 2016Gradients of Counterfactualscited by 31
  20. 2018Influence-Directed Explanations for Deep Convolutional Networkscited by 31
  21. 2023Unsupervised Image Denoising in Real-World Scenarios via Self-Collaboration Parallel Generative Adversarial Branchescited by 29
  22. 2021Finding Discriminative Filters for Specific Degradations in Blind Super-Resolutioncited by 26
  23. 2023Empowering Low-Light Image Enhancer through Customized Learnable Priorscited by 22
  24. 2023All-in-one Multi-degradation Image Restoration Network via Hierarchical Degradation Representationcited by 21
  25. 2021Discovering Distinctive "Semantics" in Super-Resolution Networkscited by 20
  26. 2018Computationally Efficient Measures of Internal Neuron Importancecited by 19

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 2; 2025: 13; 2026: 5.

20 papers.

Sort:

By area:

  1. 2024A Survey on All-in-One Image Restoration: Taxonomy, Evaluation and Future Trendscited by 58
  2. 2025Visual-Instructed Degradation Diffusion for All-in-One Image Restorationcited by 26
  3. 2025From Zero to Detail: Deconstructing Ultra-High-Definition Image Restoration from Progressive Spectral Perspectivecited by 22
  4. 2025Beyond Degradation Redundancy: Contrastive Prompt Learning for All-in-One Image Restorationcited by 6
  5. 2025UniRes: Universal Image Restoration for Complex Degradationscited by 5
  6. 2025Universal Image Restoration Pre-training via Masked Degradation Classificationcited by 4
  7. 2024Adaptive Blind All-in-One Image Restorationcited by 3
  8. 2025Elucidating and Endowing the Diffusion Training Paradigm for General Image Restorationcited by 3
  9. 2025EndoIR: Degradation-Agnostic All-in-One Endoscopic Image Restoration via Noise-Aware Routing Diffusioncited by 2
  10. 2026PaAgent: Portrait-Aware Image Restoration Agent via Subjective-Objective Reinforcement Learningcited by 2
  11. 2025Boosting All-in-One Image Restoration via Self-Improved Privilege Learningcited by 1
  12. 2025GPSMamba: A Global Phase and Spectral Prompt-guided Mamba for Infrared Image Super-Resolutioncited by 1
8 more
  1. 2025RAM++: Robust Representation Learning via Adaptive Mask for All-in-One Image Restorationcited by 1
  2. 2025RouteWinFormer: A Route-Window Transformer for Middle-range Attention in Image Restorationcited by 0
  3. 2025RealRep: Generalized SDR-to-HDR Conversion via Attribute-Disentangled Representation Learningcited by 0
  4. 2025MaskAnyNet: Rethinking Masked Image Regions as Valuable Information in Supervised Learningcited by 0
  5. 2026Bridging Degradation Discrimination and Generation for Universal Image Restorationcited by 0
  6. 2026SLER-IR: Spherical Layer-wise Expert Routing for All-in-One Image Restorationcited by 0
  7. 2026DVANet: Degradation-aware Visual-prior Alignment Network for Image Restorationcited by 0
  8. 2026Restoring Without Forgetting: Continual Learning Across Image Degradationscited by 0