Beyond Uniform Restoration: Empowering All-in-One Restoration with Pixel-Level Multimodal Guidance
Not on the map. Why?
Abstract (arXiv)
All-in-one image restoration is a unified low-level vision task that aims to effectively recover high-quality images from inputs degraded by various types and levels of corruption using a single model. Recent works have achieved remarkable progress by learning degradation-adaptive prompts or network architectures. However, these methods typically apply a uniform restoration strategy across the entire image, neglecting the fact that different regions may suffer from distinct degradation types and varying degrees of severity. In contrast, we propose to perform restoration at the pixel level, thereby enabling more fine-grained and precise control over the restoration process. Specifically, we present MGN-AIR, a novel pixel-level restoration framework for all-in-one image restoration. Our approach first learns to estimate a pixel-level visual prompt. Then, it leverages both textual and visual prompts to provide global and local degradation cues, guiding the model on where to look and how to restore at each pixel. We conduct extensive experiments on multiple all-in-one image restoration benchmarks, covering a wide range of tasks including denoising, deraining, deblurring, dehazing, desnowing, and low-light enhancement. Experimental results demonstrate that our proposed method consistently and significantly outperforms existing approaches.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 49 of its 74 references that are in the map. First posted on arXiv 10 Aug 2026.
Builds on
49 of 74 references.
References · 49
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
- 2021SwinIR: Image Restoration Using Swin Transformercited by 1,869
- 2021Restormer: Efficient Transformer for High-Resolution Image Restorationcited by 1,618
- 2021Uformer: A General U-Shaped Transformer for Image Restorationcited by 864
- 2021Multi-Stage Progressive Image Restorationcited by 813
- 2016Deep Multi-scale Convolutional Neural Network for Dynamic Scene Deblurringcited by 722
- 2018Deep Retinex Decomposition for Low-Light Enhancementcited by 720
- 2020Zero-Reference Deep Curve Estimation for Low-Light Image Enhancementcited by 541
- 2018Noise2Noise: Learning Image Restoration without Clean Datacited by 526
- 2017Benchmarking Single Image Dehazing and Beyondcited by 445
37 more
- 2017Learning Deep CNN Denoiser Prior for Image Restorationcited by 407
- 2017DeblurGAN: Blind Motion Deblurring Using Conditional Adversarial Networkscited by 366
- 2019DeblurGAN-v2: Deblurring (Orders-of-Magnitude) Faster and Bettercited by 361
- 2019FFA-Net: Feature Fusion Attention Network for Single Image Dehazingcited by 307
- 2017MemNet: A Persistent Memory Network for Image Restorationcited by 244
- 2019Residual Non-local Attention Networks for Image Restorationcited by 236
- 2019GridDehazeNet: Attention-Based Multi-Scale Network for Image Dehazingcited by 227
- 2021Contrastive Learning for Compact Single Image Dehazingcited by 219
- 2018Recurrent Squeeze-and-Excitation Context Aggregation Net for Single Image Derainingcited by 205
- 2022Efficient Frequency Domain-based Transformers for High-Quality Image Deblurringcited by 164
- 2019Heavy Rain Image Restoration: Integrating Physics Model and Conditional Adversarial Learningcited by 157
- 2024InstructIR: High-Quality Image Restoration Following Human Instructionscited by 139
- 2022Deep Generalized Unfolding Networks for Image Restorationcited by 119
- 2019Multi-Temporal Recurrent Neural Networks For Progressive Non-Uniform Single Image Deblurring With Incremental Temporal Trainingcited by 112
- 2020Domain Adaptation for Image Dehazingcited by 108
- 2022Cross Aggregation Transformer for Image Restorationcited by 92
- 2024OneRestore: A Universal Restoration Framework for Composite Degradationcited by 91
- 2020FD-GAN: Generative Adversarial Networks with Fusion-discriminator for Single Image Dehazingcited by 79
- 2019A General Decoupled Learning Framework for Parameterized Image Operatorscited by 72
- 2022TAPE: Task-Agnostic Prior Embedding for Image Restorationcited by 54
- 2025Degradation-Aware Feature Perturbation for All-in-One Image Restorationcited by 39
- 2025Vision-Language Gradient Descent-driven All-in-One Deep Unfolding Networkscited by 37
- 2023Language-driven All-in-one Adverse Weather Removalcited by 36
- 2021Robust Representation Learning with Feedback for Single Image Derainingcited by 32
- 2025Universal Image Restoration Pre-training via Degradation Classificationcited by 32
- 2023Random Sub-Samples Generation for Self-Supervised Real Image Denoisingcited by 31
- 2024All-In-One Medical Image Restoration via Task-Adaptive Routingcited by 30
- 2023Unsupervised Image Denoising in Real-World Scenarios via Self-Collaboration Parallel Generative Adversarial Branchescited by 29
- 2023Textual Prompt Guided Image Restorationcited by 27
- 2025Visual-Instructed Degradation Diffusion for All-in-One Image Restorationcited by 26
- 2024UniProcessor: A Text-induced Unified Low-level Image Processorcited by 22
- 2024Multi-Expert Adaptive Selection: Task-Balancing for All-in-One Image Restorationcited by 18
- 2020Fast Deep Multi-patch Hierarchical Network for Nonhomogeneous Image Dehazingcited by 15
- 2023Dual Degradation Representation for Joint Deraining and Low-Light Enhancement in the Darkcited by 9
- 2025Beyond Degradation Redundancy: Contrastive Prompt Learning for All-in-One Image Restorationcited by 6
- 2025Prompt to Restore, Restore to Prompt: Cyclic Prompting for Universal Adverse Weather Removalcited by 4
- 2025Learning Where and What to Restore for Composite Image Restorationcited by 4
Built on by
Not cited yet.