Chain-of-Restoration: Multi-Task Image Restoration Models are Zero-Shot Step-by-Step Universal Image Restorers
Not on the map. Why?
Abstract (arXiv)
Despite previous image restoration (IR) methods have often concentrated on isolated degradations, recent research has increasingly focused on addressing composite degradations involving a complex combination of multiple isolated degradations. However, current IR methods for composite degradations require building training data that contain an exponential number of possible degradation combinations, which brings in a significant burden. To alleviate this issue, this paper proposes a new task setting, i.e. Universal Image Restoration (UIR). Specifically, UIR doesn't require training on all the degradation combinations but only on a set of degradation bases and then removing any degradation that these bases can potentially compose in a zero-shot manner. Inspired by the Chain-of-Thought that prompts large language models (LLMs) to address problems step-by-step, we propose Chain-of-Restoration (CoR) mechanism, which instructs models to remove unknown composite degradations step-by-step. By integrating a simple Degradation Discriminator into pre-trained multi-task models, CoR facilitates the process where models remove one degradation basis per step, continuing this process until the image is fully restored from the unknown composite degradation. Extensive experiments show that CoR can significantly improve model performance in removing composite degradations, achieving comparable or better results than those state-of-the-art (SoTA) methods trained on all degradations.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 53 of its 80 references that are in the map. First posted on arXiv 11 Oct 2024.
Builds on
53 of 80 references.
References · 53
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2022Training language models to follow instructions with human feedbackcited by 15,712
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
- 2016Densely Connected Convolutional Networkscited by 6,691
- 2022Large Language Models are Zero-Shot Reasonerscited by 4,323
- 2021Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processingcited by 2,222
- 2019Searching for MobileNetV3cited by 1,984
- 2021SwinIR: Image Restoration Using Swin Transformercited by 1,869
38 more
- 2017Decoupled Weight Decay Regularizationcited by 1,722
- 2021Restormer: Efficient Transformer for High-Resolution Image Restorationcited by 1,618
- 2016Beyond a Gaussian Denoiser: Residual Learning of Deep CNN for Image Denoisingcited by 1,352
- 2021What Makes Good In-Context Examples for GPT-3?cited by 1,184
- 2020Pre-Trained Image Processing Transformercited by 891
- 2021Uformer: A General U-Shaped Transformer for Image Restorationcited by 864
- 2021Multi-Stage Progressive Image Restorationcited by 813
- 2022Simple Baselines for Image Restorationcited by 701
- 2022Automatic Chain of Thought Prompting in Large Language Modelscited by 684
- 2018Noise2Noise: Learning Image Restoration without Clean Datacited by 526
- 2017FFDNet: Toward a Fast and Flexible Solution for CNN based Image Denoisingcited by 509
- 2023Large Language Models Are Zero-Shot Time Series Forecasterscited by 491
- 2017Benchmarking Single Image Dehazing and Beyondcited by 445
- 2022Activating More Pixels in Image Super-Resolution Transformercited by 433
- 2024MambaIR: A Simple Baseline for Image Restoration with State-Space Modelcited by 349
- 2020Learning Texture Transformer Network for Image Super-Resolutioncited by 346
- 2020Learning Enriched Features for Real Image Restoration and Enhancementcited by 311
- 2023Large Language Models are Zero-Shot Rankers for Recommender Systemscited by 307
- 2020Retinex-inspired Unrolling with Cooperative Prior Architecture Search for Low-light Image Enhancementcited by 303
- 2020Multi-Scale Progressive Fusion Network for Single Image Derainingcited by 259
- 2022Vision Transformers for Single Image Dehazingcited by 255
- 2021TransWeather: Transformer-based Restoration of Images Degraded by Adverse Weather Conditionscited by 243
- 2022Restoring Vision in Adverse Weather Conditions with Patch-Based Denoising Diffusion Modelscited by 215
- 2023Learning A Sparse Transformer Network for Effective Image Derainingcited by 204
- 2019Spatial Attentive Single-Image Deraining with a High Quality Real Rain Datasetcited by 192
- 2020A Review of Generalized Zero-Shot Learning Methodscited by 159
- 2022Learning Enriched Features for Fast Image Restoration and Enhancementcited by 150
- 2024InstructIR: High-Quality Image Restoration Following Human Instructionscited by 139
- 2023Dual Aggregation Transformer for Image Super-Resolutioncited by 124
- 2022Deep Generalized Unfolding Networks for Image Restorationcited by 119
- 2022Cross Aggregation Transformer for Image Restorationcited by 92
- 2024OneRestore: A Universal Restoration Framework for Composite Degradationcited by 91
- 2023Curricular Contrastive Regularization for Physics-aware Single Image Dehazingcited by 83
- 2023Low-Light Image Enhancement via Structure Modeling and Guidancecited by 78
- 2021Low-light Image Enhancement via Breaking Down the Darknesscited by 65
- 2024RestoreAgent: Autonomous Image Restoration Agent via Multimodal Large Language Modelscited by 41
- 2022MSP-Former: Multi-Scale Projection Transformer for Single Image Desnowingcited by 39
- 2024UniProcessor: A Text-induced Unified Low-level Image Processorcited by 22
50 most cited of 53 All 53 (JSON)
Built on by
Citing papers per year: 2024: 1; 2025: 1; 2026: 2.
4 papers.
- 2024A Survey on All-in-One Image Restoration: Taxonomy, Evaluation and Future Trendscited by 58
- 2025Hybrid Agents for Image Restorationcited by 14
- 2026TIR-Agent: Training an Explorative and Efficient Agent for Image Restorationcited by 3
- 2026Universal Image Restoration via Internalized Chain-of-Thought Reasoningcited by 0
- 2026Universal Image Restoration via Internalized Chain-of-Thought Reasoning16 Jun 2026
- 2026TIR-Agent: Training an Explorative and Efficient Agent for Image Restoration29 Mar 2026
- 2025Hybrid Agents for Image Restoration13 Mar 2025
- 2024A Survey on All-in-One Image Restoration: Taxonomy, Evaluation and Future Trends19 Oct 2024
Similar, not cited
Close in wording, no citation either way
- 2026UnSCAR: Universal, Scalable, Controllable, and Adaptable Image Restoration
- 2025UniRes: Universal Image Restoration for Complex Degradations
- 2025Unleashing Degradation-Carrying Features in Symmetric U-Net: Simpler and Stronger Baselines for All-in-One Image Restoration
- 2024UniRestorer: Universal Image Restoration via Adaptively Estimating Image Degradation at Proper Granularity
- 2024Training-Free Large Model Priors for Multiple-in-One Image Restoration
- 2026RIRF: Reasoning Image Restoration Framework
- 2025DPMambaIR: All-in-One Image Restoration via Degradation-Aware Prompt State Space Model
- 2025ClusIR: Towards Cluster-Guided All-in-One Image Restoration