Restore Anything with Masks: Leveraging Mask Image Modeling for Blind All-in-One Image Restoration
Not on the map. Why?
Abstract (arXiv)
All-in-one image restoration aims to handle multiple degradation types using one model. This paper proposes a simple pipeline for all-in-one blind image restoration to Restore Anything with Masks (RAM). We focus on the image content by utilizing Mask Image Modeling to extract intrinsic image information rather than distinguishing degradation types like other methods. Our pipeline consists of two stages: masked image pre-training and fine-tuning with mask attribute conductance. We design a straightforward masking pre-training approach specifically tailored for all-in-one image restoration. This approach enhances networks to prioritize the extraction of image content priors from various degradations, resulting in a more balanced performance across different restoration tasks and achieving stronger overall results. To bridge the gap of input integrity while preserving learned image priors as much as possible, we selectively fine-tuned a small portion of the layers. Specifically, the importance of each layer is ranked by the proposed Mask Attribute Conductance (MAC), and the layers with higher contributions are selected for finetuning. Extensive experiments demonstrate that our method achieves state-of-the-art performance. Our code and model will be released at hrefhttps://github.com/Dragonisss/RAMhttps://github.com/Dragonisss/RAM.
Key facts. Cited by 20 papers in the map (data through 7 Oct 2026). Builds on 38 of its 62 references that are in the map. First posted on arXiv 28 Sep 2024.
Builds on
38 of 62 references.
References · 38
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
- 2017Axiomatic Attribution for Deep Networkscited by 3,350
- 2021SwinIR: Image Restoration Using Swin Transformercited by 1,869
- 2021Restormer: Efficient Transformer for High-Resolution Image Restorationcited by 1,618
- 2021SimMIM: A Simple Framework for Masked Image Modelingcited by 1,147
- 2020Pre-Trained Image Processing Transformercited by 891
- 2021Uformer: A General U-Shaped Transformer for Image Restorationcited by 864
- 2016Deep Multi-scale Convolutional Neural Network for Dynamic Scene Deblurringcited by 722
- 2018Deep Retinex Decomposition for Low-Light Enhancementcited by 720
- 2022Simple Baselines for Image Restorationcited by 701
26 more
- 2020Zero-Reference Deep Curve Estimation for Low-Light Image Enhancementcited by 541
- 2017Benchmarking Single Image Dehazing and Beyondcited by 445
- 2016Deep Joint Rain Detection and Removal from a Single Imagecited by 351
- 2022Images Speak in Images: A Generalist Painter for In-Context Visual Learningcited by 317
- 2018Density-aware Single Image De-raining using a Multi-stream Dense Networkcited by 248
- 2018Recurrent Squeeze-and-Excitation Context Aggregation Net for Single Image Derainingcited by 205
- 2017Image De-raining Using a Conditional Generative Adversarial Networkcited by 197
- 2016Clearing the Skies: A deep network architecture for single-image rain removalcited by 136
- 2020Interpreting Super-Resolution Networks with Local Attribution Mapscited by 136
- 2023Embedding Fourier for Ultra-High-Definition Low-Light Image Enhancementcited by 86
- 2019Single Image Deraining: From Model-Based to Data-Driven and Beyondcited by 77
- 2018How Important Is a Neuron?cited by 73
- 2023RIDCP: Revitalizing Real Image Dehazing via High-Quality Codebook Priorscited by 73
- 2019A General Decoupled Learning Framework for Parameterized Image Operatorscited by 72
- 2023Masked Image Training for Generalizable Deep Image Denoisingcited by 57
- 2022TAPE: Task-Agnostic Prior Embedding for Image Restorationcited by 54
- 2020MPRNet: Multi-Path Residual Network for Lightweight Image Super Resolutioncited by 38
- 2022Learning Degradation Representations for Image Deblurringcited by 35
- 2016Gradients of Counterfactualscited by 31
- 2018Influence-Directed Explanations for Deep Convolutional Networkscited by 31
- 2023Unsupervised Image Denoising in Real-World Scenarios via Self-Collaboration Parallel Generative Adversarial Branchescited by 29
- 2021Finding Discriminative Filters for Specific Degradations in Blind Super-Resolutioncited by 26
- 2023Empowering Low-Light Image Enhancer through Customized Learnable Priorscited by 22
- 2023All-in-one Multi-degradation Image Restoration Network via Hierarchical Degradation Representationcited by 21
- 2021Discovering Distinctive "Semantics" in Super-Resolution Networkscited by 20
- 2018Computationally Efficient Measures of Internal Neuron Importancecited by 19
Built on by
Citing papers per year: 2024: 2; 2025: 13; 2026: 5.
20 papers.
Sort:
By area:
- 2024A Survey on All-in-One Image Restoration: Taxonomy, Evaluation and Future Trendscited by 58
- 2025Visual-Instructed Degradation Diffusion for All-in-One Image Restorationcited by 26
- 2025From Zero to Detail: Deconstructing Ultra-High-Definition Image Restoration from Progressive Spectral Perspectivecited by 22
- 2025Beyond Degradation Redundancy: Contrastive Prompt Learning for All-in-One Image Restorationcited by 6
- 2025UniRes: Universal Image Restoration for Complex Degradationscited by 5
- 2025Universal Image Restoration Pre-training via Masked Degradation Classificationcited by 4
- 2024Adaptive Blind All-in-One Image Restorationcited by 3
- 2025Elucidating and Endowing the Diffusion Training Paradigm for General Image Restorationcited by 3
- 2025EndoIR: Degradation-Agnostic All-in-One Endoscopic Image Restoration via Noise-Aware Routing Diffusioncited by 2
- 2026PaAgent: Portrait-Aware Image Restoration Agent via Subjective-Objective Reinforcement Learningcited by 2
- 2025Boosting All-in-One Image Restoration via Self-Improved Privilege Learningcited by 1
- 2025GPSMamba: A Global Phase and Spectral Prompt-guided Mamba for Infrared Image Super-Resolutioncited by 1
8 more
- 2025RAM++: Robust Representation Learning via Adaptive Mask for All-in-One Image Restorationcited by 1
- 2025RouteWinFormer: A Route-Window Transformer for Middle-range Attention in Image Restorationcited by 0
- 2025RealRep: Generalized SDR-to-HDR Conversion via Attribute-Disentangled Representation Learningcited by 0
- 2025MaskAnyNet: Rethinking Masked Image Regions as Valuable Information in Supervised Learningcited by 0
- 2026Bridging Degradation Discrimination and Generation for Universal Image Restorationcited by 0
- 2026SLER-IR: Spherical Layer-wise Expert Routing for All-in-One Image Restorationcited by 0
- 2026DVANet: Degradation-aware Visual-prior Alignment Network for Image Restorationcited by 0
- 2026Restoring Without Forgetting: Continual Learning Across Image Degradationscited by 0
- 2026Restoring Without Forgetting: Continual Learning Across Image Degradations24 Aug 2026
- 2026DVANet: Degradation-aware Visual-prior Alignment Network for Image Restoration17 Jun 2026
- 2026PaAgent: Portrait-Aware Image Restoration Agent via Subjective-Objective Reinforcement Learning17 Mar 2026
- 2026SLER-IR: Spherical Layer-wise Expert Routing for All-in-One Image Restoration6 Mar 2026
- 2026Bridging Degradation Discrimination and Generation for Universal Image Restoration31 Jan 2026
- 2025MaskAnyNet: Rethinking Masked Image Regions as Valuable Information in Supervised Learning16 Nov 2025
- 2025EndoIR: Degradation-Agnostic All-in-One Endoscopic Image Restoration via Noise-Aware Routing Diffusion8 Nov 2025
- 2025Universal Image Restoration Pre-training via Masked Degradation Classification15 Oct 2025
- 2025RAM++: Robust Representation Learning via Adaptive Mask for All-in-One Image Restoration15 Sep 2025
- 2025GPSMamba: A Global Phase and Spectral Prompt-guided Mamba for Infrared Image Super-Resolution25 Jul 2025
- 2025Elucidating and Endowing the Diffusion Training Paradigm for General Image Restoration26 Jun 2025
- 2025Visual-Instructed Degradation Diffusion for All-in-One Image Restoration20 Jun 2025
8 more
- 2025UniRes: Universal Image Restoration for Complex Degradations5 Jun 2025
- 2025Boosting All-in-One Image Restoration via Self-Improved Privilege Learning30 May 2025
- 2025RealRep: Generalized SDR-to-HDR Conversion via Attribute-Disentangled Representation Learning12 May 2025
- 2025RouteWinFormer: A Route-Window Transformer for Middle-range Attention in Image Restoration23 Apr 2025
- 2025Beyond Degradation Redundancy: Contrastive Prompt Learning for All-in-One Image Restoration14 Apr 2025
- 2025From Zero to Detail: Deconstructing Ultra-High-Definition Image Restoration from Progressive Spectral Perspective17 Mar 2025
- 2024Adaptive Blind All-in-One Image Restoration27 Nov 2024
- 2024A Survey on All-in-One Image Restoration: Taxonomy, Evaluation and Future Trends19 Oct 2024
- 2024A Survey on All-in-One Image Restoration: Taxonomy, Evaluation and Future Trendscited by 58
- 2025Visual-Instructed Degradation Diffusion for All-in-One Image Restorationcited by 26
- 2025From Zero to Detail: Deconstructing Ultra-High-Definition Image Restoration from Progressive Spectral Perspectivecited by 22
- 2025Beyond Degradation Redundancy: Contrastive Prompt Learning for All-in-One Image Restorationcited by 6
- 2025UniRes: Universal Image Restoration for Complex Degradationscited by 5
- 2025Universal Image Restoration Pre-training via Masked Degradation Classificationcited by 4
- 2024Adaptive Blind All-in-One Image Restorationcited by 3
- 2025EndoIR: Degradation-Agnostic All-in-One Endoscopic Image Restoration via Noise-Aware Routing Diffusioncited by 2
- 2025Boosting All-in-One Image Restoration via Self-Improved Privilege Learningcited by 1
- 2025RAM++: Robust Representation Learning via Adaptive Mask for All-in-One Image Restorationcited by 1
- 2025RouteWinFormer: A Route-Window Transformer for Middle-range Attention in Image Restorationcited by 0
- 2025RealRep: Generalized SDR-to-HDR Conversion via Attribute-Disentangled Representation Learningcited by 0
12 most cited of 16 All 16 (JSON)
- 2026Restoring Without Forgetting: Continual Learning Across Image Degradations24 Aug 2026
- 2026DVANet: Degradation-aware Visual-prior Alignment Network for Image Restoration17 Jun 2026
- 2026Bridging Degradation Discrimination and Generation for Universal Image Restoration31 Jan 2026
- 2025MaskAnyNet: Rethinking Masked Image Regions as Valuable Information in Supervised Learning16 Nov 2025
- 2025EndoIR: Degradation-Agnostic All-in-One Endoscopic Image Restoration via Noise-Aware Routing Diffusion8 Nov 2025
- 2025Universal Image Restoration Pre-training via Masked Degradation Classification15 Oct 2025
- 2025RAM++: Robust Representation Learning via Adaptive Mask for All-in-One Image Restoration15 Sep 2025
- 2025Visual-Instructed Degradation Diffusion for All-in-One Image Restoration20 Jun 2025
- 2025UniRes: Universal Image Restoration for Complex Degradations5 Jun 2025
- 2025Boosting All-in-One Image Restoration via Self-Improved Privilege Learning30 May 2025
- 2025RealRep: Generalized SDR-to-HDR Conversion via Attribute-Disentangled Representation Learning12 May 2025
- 2025RouteWinFormer: A Route-Window Transformer for Middle-range Attention in Image Restoration23 Apr 2025
12 newest of 16 All 16 (JSON)