mlsanityData to 7 Oct 2026

Chain-of-Restoration: Multi-Task Image Restoration Models are Zero-Shot Step-by-Step Universal Image Restorers

arXiv 2410.08688 ↗First posted 11 Oct 2024cs.CV cs.AIcited by 4

Not on the map. Why?

Abstract (arXiv)

Despite previous image restoration (IR) methods have often concentrated on isolated degradations, recent research has increasingly focused on addressing composite degradations involving a complex combination of multiple isolated degradations. However, current IR methods for composite degradations require building training data that contain an exponential number of possible degradation combinations, which brings in a significant burden. To alleviate this issue, this paper proposes a new task setting, i.e. Universal Image Restoration (UIR). Specifically, UIR doesn't require training on all the degradation combinations but only on a set of degradation bases and then removing any degradation that these bases can potentially compose in a zero-shot manner. Inspired by the Chain-of-Thought that prompts large language models (LLMs) to address problems step-by-step, we propose Chain-of-Restoration (CoR) mechanism, which instructs models to remove unknown composite degradations step-by-step. By integrating a simple Degradation Discriminator into pre-trained multi-task models, CoR facilitates the process where models remove one degradation basis per step, continuing this process until the image is fully restored from the unknown composite degradation. Extensive experiments show that CoR can significantly improve model performance in removing composite degradations, achieving comparable or better results than those state-of-the-art (SoTA) methods trained on all degradations.

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 53 of its 80 references that are in the map. First posted on arXiv 11 Oct 2024.

Builds on

53 of 80 references.

References · 53

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2020Language Models are Few-Shot Learnerscited by 32,199
  4. 2022Training language models to follow instructions with human feedbackcited by 15,712
  5. 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
  6. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  7. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
  8. 2016Densely Connected Convolutional Networkscited by 6,691
  9. 2022Large Language Models are Zero-Shot Reasonerscited by 4,323
  10. 2021Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processingcited by 2,222
  11. 2019Searching for MobileNetV3cited by 1,984
  12. 2021SwinIR: Image Restoration Using Swin Transformercited by 1,869
38 more
  1. 2017Decoupled Weight Decay Regularizationcited by 1,722
  2. 2021Restormer: Efficient Transformer for High-Resolution Image Restorationcited by 1,618
  3. 2016Beyond a Gaussian Denoiser: Residual Learning of Deep CNN for Image Denoisingcited by 1,352
  4. 2021What Makes Good In-Context Examples for GPT-3?cited by 1,184
  5. 2020Pre-Trained Image Processing Transformercited by 891
  6. 2021Uformer: A General U-Shaped Transformer for Image Restorationcited by 864
  7. 2021Multi-Stage Progressive Image Restorationcited by 813
  8. 2022Simple Baselines for Image Restorationcited by 701
  9. 2022Automatic Chain of Thought Prompting in Large Language Modelscited by 684
  10. 2018Noise2Noise: Learning Image Restoration without Clean Datacited by 526
  11. 2017FFDNet: Toward a Fast and Flexible Solution for CNN based Image Denoisingcited by 509
  12. 2023Large Language Models Are Zero-Shot Time Series Forecasterscited by 491
  13. 2017Benchmarking Single Image Dehazing and Beyondcited by 445
  14. 2022Activating More Pixels in Image Super-Resolution Transformercited by 433
  15. 2024MambaIR: A Simple Baseline for Image Restoration with State-Space Modelcited by 349
  16. 2020Learning Texture Transformer Network for Image Super-Resolutioncited by 346
  17. 2020Learning Enriched Features for Real Image Restoration and Enhancementcited by 311
  18. 2023Large Language Models are Zero-Shot Rankers for Recommender Systemscited by 307
  19. 2020Retinex-inspired Unrolling with Cooperative Prior Architecture Search for Low-light Image Enhancementcited by 303
  20. 2020Multi-Scale Progressive Fusion Network for Single Image Derainingcited by 259
  21. 2022Vision Transformers for Single Image Dehazingcited by 255
  22. 2021TransWeather: Transformer-based Restoration of Images Degraded by Adverse Weather Conditionscited by 243
  23. 2022Restoring Vision in Adverse Weather Conditions with Patch-Based Denoising Diffusion Modelscited by 215
  24. 2023Learning A Sparse Transformer Network for Effective Image Derainingcited by 204
  25. 2019Spatial Attentive Single-Image Deraining with a High Quality Real Rain Datasetcited by 192
  26. 2020A Review of Generalized Zero-Shot Learning Methodscited by 159
  27. 2022Learning Enriched Features for Fast Image Restoration and Enhancementcited by 150
  28. 2024InstructIR: High-Quality Image Restoration Following Human Instructionscited by 139
  29. 2023Dual Aggregation Transformer for Image Super-Resolutioncited by 124
  30. 2022Deep Generalized Unfolding Networks for Image Restorationcited by 119
  31. 2022Cross Aggregation Transformer for Image Restorationcited by 92
  32. 2024OneRestore: A Universal Restoration Framework for Composite Degradationcited by 91
  33. 2023Curricular Contrastive Regularization for Physics-aware Single Image Dehazingcited by 83
  34. 2023Low-Light Image Enhancement via Structure Modeling and Guidancecited by 78
  35. 2021Low-light Image Enhancement via Breaking Down the Darknesscited by 65
  36. 2024RestoreAgent: Autonomous Image Restoration Agent via Multimodal Large Language Modelscited by 41
  37. 2022MSP-Former: Multi-Scale Projection Transformer for Single Image Desnowingcited by 39
  38. 2024UniProcessor: A Text-induced Unified Low-level Image Processorcited by 22

50 most cited of 53 All 53 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 1; 2025: 1; 2026: 2.

4 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026UnSCAR: Universal, Scalable, Controllable, and Adaptable Image Restoration
  2. 2025UniRes: Universal Image Restoration for Complex Degradations
  3. 2025Unleashing Degradation-Carrying Features in Symmetric U-Net: Simpler and Stronger Baselines for All-in-One Image Restoration
  4. 2024UniRestorer: Universal Image Restoration via Adaptively Estimating Image Degradation at Proper Granularity
  5. 2024Training-Free Large Model Priors for Multiple-in-One Image Restoration
  6. 2026RIRF: Reasoning Image Restoration Framework
  7. 2025DPMambaIR: All-in-One Image Restoration via Degradation-Aware Prompt State Space Model
  8. 2025ClusIR: Towards Cluster-Guided All-in-One Image Restoration