Crafting a Toolchain for Image Restoration by Deep Reinforcement Learning
Not on the map. Why?
Abstract (arXiv)
We investigate a novel approach for image restoration by reinforcement learning. Unlike existing studies that mostly train a single large network for a specialized task, we prepare a toolbox consisting of small-scale convolutional networks of different complexities and specialized in different tasks. Our method, RL-Restore, then learns a policy to select appropriate tools from the toolbox to progressively restore the quality of a corrupted image. We formulate a step-wise reward function proportional to how well the image is restored at each step to learn the action policy. We also devise a joint learning scheme to train the agent and tools for better performance in handling uncertainty. In comparison to conventional human-designed networks, RL-Restore is capable of restoring images corrupted with complex and unknown distortions in a more parameter-efficient manner using the dynamically formed toolchain.
Key facts. Cited by 45 papers in the map (data through 7 Oct 2026). First posted on arXiv 10 Apr 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2020: 1; 2021: 14; 2022: 8; 2023: 7; 2024: 5; 2025: 4; 2026: 6.
45 papers.
Sort:
By area:
- 2021Palette: Image-to-Image Diffusion Modelscited by 1,296
- 2023Exploiting Diffusion Prior for Real-World Image Super-Resolutioncited by 486
- 2023Generative Diffusion Prior for Unified Image Restoration and Enhancementcited by 198
- 2023A Complete Survey on Generative AI (AIGC): Is ChatGPT from GPT-4 to GPT-5 All You Need?cited by 84
- 2021ClassSR: A General Framework to Accelerate Super-Resolution Networks by Data Characteristiccited by 81
- 2022TAPE: Task-Agnostic Prior Embedding for Image Restorationcited by 54
- 2021NTIRE 2021 Challenge on Image Deblurringcited by 49
- 2024RestoreAgent: Autonomous Image Restoration Agent via Multimodal Large Language Modelscited by 41
- 2024An Intelligent Agentic System for Complex Image Restoration Problemscited by 41
- 2022Bringing Old Films Back to Lifecited by 31
- 2021ReLLIE: Deep Reinforcement Learning for Customized Low-Light Image Enhancementcited by 26
- 2023Learning Distortion Invariant Representation for Image Restoration from A Causality Perspectivecited by 17
33 more
- 2021Toward Real-World Super-Resolution via Adaptive Downsampling Modelscited by 14
- 2022Pik-Fix: Restoring and Colorizing Old Photoscited by 8
- 2022Lightweight Stepless Super-Resolution of Remote Sensing Images via Saliency-Aware Dynamic Routing Strategycited by 6
- 2020Restoring Spatially-Heterogeneous Distortions using Mixture of Experts Networkcited by 5
- 2021R3L: Connecting Deep Reinforcement Learning to Recurrent Neural Networks for Image Denoising via Residual Recoverycited by 4
- 2022DRL-ISP: Multi-Objective Camera ISP with Deep Reinforcement Learningcited by 4
- 2024Spatial-temporal Hierarchical Reinforcement Learning for Interpretable Pathology Image Super-Resolutioncited by 4
- 2023Simulating analogue film damage to analyse and improve artefact restoration on high-resolution scanscited by 3
- 2023ALL-E: Aesthetics-guided Low-light Image Enhancementcited by 3
- 2025Position: Agentic Systems Constitute a Key Component of Next-Generation Intelligent Image Processingcited by 3
- 2026Bridging Information Asymmetry: A Hierarchical Framework for Deterministic Blind Face Restorationcited by 3
- 2021Sparsely ensembled convolutional neural network classifiers via reinforcement learningcited by 2
- 2022REPNP: Plug-and-Play with Deep Reinforcement Learning Prior for Robust Image Restorationcited by 2
- 2025TooBadRL: Trigger Optimization to Boost Effectiveness of Backdoor Attacks on Deep Reinforcement Learningcited by 2
- 2026RL-AWB: Deep Reinforcement Learning for Auto White Balance Correction in Low-Light Night-time Scenescited by 2
- 2026OPERA: An Agent for Image Restoration with End-to-End Joint Planning-Execution Optimizationcited by 2
- 2021Adaptive Remote Sensing Image Attribute Learning for Active Object Detectioncited by 1
- 2021A Reinforcement Learning Approach for Sequential Spatial Transformer Networkscited by 1
- 2021Multi-frame Joint Enhancement for Early Interlaced Videoscited by 1
- 2021Aesthetic Photo Collage with Deep Reinforcement Learningcited by 1
- 2021Reinforcement Learning of Self Enhancing Camera Image and Signal Processingcited by 1
- 2021A Close Look at Few-shot Real Image Super-resolution from the Distortion Relation Perspectivecited by 1
- 2022TreEnhance: A Tree Search Method For Low-Light Image Enhancementcited by 1
- 2024Image Deraining via Self-supervised Reinforcement Learningcited by 1
- 2024Rethinking Generalizability and Discriminability of Self-Supervised Learning from Evolutionary Game Theory Perspectivecited by 1
- 2026AbsoluteDegradation: A Physics-Inspired Synthetic Film-Degradation Pipeline and Archival Film Restoration Benchmarkcited by 1
- 2021Super-Resolving Compressed Video in Coding Chaincited by 0
- 2022ROMNet: Renovate the Old Memoriescited by 0
- 2023Balancing Efficiency and Quality: MoEISR for Arbitrary-Scale Image Super-Resolutioncited by 0
- 2025Metadata, Wavelet, and Time Aware Diffusion Models for Satellite Image Super Resolutioncited by 0
- 2025Reinforced Diffusion: Learning to Push the Limits of Anisotropic Diffusion for Image Denoisingcited by 0
- 2026SPARK: Spatial Policy-driven Adaptive Reinforcement learning for Knowledge distillationcited by 0
- 2026SafeRestore: Detector-Relative Risk Certificates for Selective Industrial Image Restorationcited by 0
- 2026SafeRestore: Detector-Relative Risk Certificates for Selective Industrial Image Restoration3 Sep 2026
- 2026AbsoluteDegradation: A Physics-Inspired Synthetic Film-Degradation Pipeline and Archival Film Restoration Benchmark2 Jul 2026
- 2026SPARK: Spatial Policy-driven Adaptive Reinforcement learning for Knowledge distillation13 Jun 2026
- 2026OPERA: An Agent for Image Restoration with End-to-End Joint Planning-Execution Optimization21 May 2026
- 2026Bridging Information Asymmetry: A Hierarchical Framework for Deterministic Blind Face Restoration27 Jan 2026
- 2026RL-AWB: Deep Reinforcement Learning for Auto White Balance Correction in Low-Light Night-time Scenes8 Jan 2026
- 2025Reinforced Diffusion: Learning to Push the Limits of Anisotropic Diffusion for Image Denoising30 Dec 2025
- 2025Metadata, Wavelet, and Time Aware Diffusion Models for Satellite Image Super Resolution30 Jun 2025
- 2025TooBadRL: Trigger Optimization to Boost Effectiveness of Backdoor Attacks on Deep Reinforcement Learning11 Jun 2025
- 2025Position: Agentic Systems Constitute a Key Component of Next-Generation Intelligent Image Processing21 May 2025
- 2024Rethinking Generalizability and Discriminability of Self-Supervised Learning from Evolutionary Game Theory Perspective30 Nov 2024
- 2024An Intelligent Agentic System for Complex Image Restoration Problems23 Oct 2024
33 more
- 2024RestoreAgent: Autonomous Image Restoration Agent via Multimodal Large Language Models25 Jul 2024
- 2024Spatial-temporal Hierarchical Reinforcement Learning for Interpretable Pathology Image Super-Resolution26 Jun 2024
- 2024Image Deraining via Self-supervised Reinforcement Learning27 Mar 2024
- 2023Balancing Efficiency and Quality: MoEISR for Arbitrary-Scale Image Super-Resolution20 Nov 2023
- 2023Exploiting Diffusion Prior for Real-World Image Super-Resolution11 May 2023
- 2023ALL-E: Aesthetics-guided Low-light Image Enhancement28 Apr 2023
- 2023Generative Diffusion Prior for Unified Image Restoration and Enhancement3 Apr 2023
- 2023A Complete Survey on Generative AI (AIGC): Is ChatGPT from GPT-4 to GPT-5 All You Need?21 Mar 2023
- 2023Learning Distortion Invariant Representation for Image Restoration from A Causality Perspective13 Mar 2023
- 2023Simulating analogue film damage to analyse and improve artefact restoration on high-resolution scans20 Feb 2023
- 2022Lightweight Stepless Super-Resolution of Remote Sensing Images via Saliency-Aware Dynamic Routing Strategy14 Oct 2022
- 2022REPNP: Plug-and-Play with Deep Reinforcement Learning Prior for Robust Image Restoration25 Jul 2022
- 2022DRL-ISP: Multi-Objective Camera ISP with Deep Reinforcement Learning7 Jul 2022
- 2022TreEnhance: A Tree Search Method For Low-Light Image Enhancement25 May 2022
- 2022Pik-Fix: Restoring and Colorizing Old Photos4 May 2022
- 2022Bringing Old Films Back to Life31 Mar 2022
- 2022TAPE: Task-Agnostic Prior Embedding for Image Restoration11 Mar 2022
- 2022ROMNet: Renovate the Old Memories5 Feb 2022
- 2021A Close Look at Few-shot Real Image Super-resolution from the Distortion Relation Perspective25 Nov 2021
- 2021Reinforcement Learning of Self Enhancing Camera Image and Signal Processing15 Nov 2021
- 2021Palette: Image-to-Image Diffusion Models10 Nov 2021
- 2021Aesthetic Photo Collage with Deep Reinforcement Learning19 Oct 2021
- 2021Multi-frame Joint Enhancement for Early Interlaced Videos29 Sep 2021
- 2021Toward Real-World Super-Resolution via Adaptive Downsampling Models8 Sep 2021
- 2021ReLLIE: Deep Reinforcement Learning for Customized Low-Light Image Enhancement13 Jul 2021
- 2021R3L: Connecting Deep Reinforcement Learning to Recurrent Neural Networks for Image Denoising via Residual Recovery12 Jul 2021
- 2021A Reinforcement Learning Approach for Sequential Spatial Transformer Networks27 Jun 2021
- 2021NTIRE 2021 Challenge on Image Deblurring30 Apr 2021
- 2021Super-Resolving Compressed Video in Coding Chain26 Mar 2021
- 2021ClassSR: A General Framework to Accelerate Super-Resolution Networks by Data Characteristic6 Mar 2021
- 2021Sparsely ensembled convolutional neural network classifiers via reinforcement learning7 Feb 2021
- 2021Adaptive Remote Sensing Image Attribute Learning for Active Object Detection16 Jan 2021
- 2020Restoring Spatially-Heterogeneous Distortions using Mixture of Experts Network30 Sep 2020
- 2021Palette: Image-to-Image Diffusion Modelscited by 1,296
- 2023Exploiting Diffusion Prior for Real-World Image Super-Resolutioncited by 486
- 2023Generative Diffusion Prior for Unified Image Restoration and Enhancementcited by 198
- 2025Metadata, Wavelet, and Time Aware Diffusion Models for Satellite Image Super Resolutioncited by 0
- 2025Metadata, Wavelet, and Time Aware Diffusion Models for Satellite Image Super Resolution30 Jun 2025
- 2023Exploiting Diffusion Prior for Real-World Image Super-Resolution11 May 2023
- 2023Generative Diffusion Prior for Unified Image Restoration and Enhancement3 Apr 2023
- 2021Palette: Image-to-Image Diffusion Models10 Nov 2021
- 2023A Complete Survey on Generative AI (AIGC): Is ChatGPT from GPT-4 to GPT-5 All You Need?cited by 84
- 2021ClassSR: A General Framework to Accelerate Super-Resolution Networks by Data Characteristiccited by 81
- 2022TAPE: Task-Agnostic Prior Embedding for Image Restorationcited by 54
- 2021NTIRE 2021 Challenge on Image Deblurringcited by 49
- 2022Bringing Old Films Back to Lifecited by 31
- 2021ReLLIE: Deep Reinforcement Learning for Customized Low-Light Image Enhancementcited by 26
- 2023Learning Distortion Invariant Representation for Image Restoration from A Causality Perspectivecited by 17
- 2021Toward Real-World Super-Resolution via Adaptive Downsampling Modelscited by 14
- 2022Pik-Fix: Restoring and Colorizing Old Photoscited by 8
- 2022Lightweight Stepless Super-Resolution of Remote Sensing Images via Saliency-Aware Dynamic Routing Strategycited by 6
- 2021R3L: Connecting Deep Reinforcement Learning to Recurrent Neural Networks for Image Denoising via Residual Recoverycited by 4
- 2022DRL-ISP: Multi-Objective Camera ISP with Deep Reinforcement Learningcited by 4
12 most cited of 37 All 37 (JSON)
- 2026SafeRestore: Detector-Relative Risk Certificates for Selective Industrial Image Restoration3 Sep 2026
- 2026AbsoluteDegradation: A Physics-Inspired Synthetic Film-Degradation Pipeline and Archival Film Restoration Benchmark2 Jul 2026
- 2026SPARK: Spatial Policy-driven Adaptive Reinforcement learning for Knowledge distillation13 Jun 2026
- 2026OPERA: An Agent for Image Restoration with End-to-End Joint Planning-Execution Optimization21 May 2026
- 2026Bridging Information Asymmetry: A Hierarchical Framework for Deterministic Blind Face Restoration27 Jan 2026
- 2026RL-AWB: Deep Reinforcement Learning for Auto White Balance Correction in Low-Light Night-time Scenes8 Jan 2026
- 2025Reinforced Diffusion: Learning to Push the Limits of Anisotropic Diffusion for Image Denoising30 Dec 2025
- 2025TooBadRL: Trigger Optimization to Boost Effectiveness of Backdoor Attacks on Deep Reinforcement Learning11 Jun 2025
- 2024Rethinking Generalizability and Discriminability of Self-Supervised Learning from Evolutionary Game Theory Perspective30 Nov 2024
- 2024Spatial-temporal Hierarchical Reinforcement Learning for Interpretable Pathology Image Super-Resolution26 Jun 2024
- 2024Image Deraining via Self-supervised Reinforcement Learning27 Mar 2024
- 2023Balancing Efficiency and Quality: MoEISR for Arbitrary-Scale Image Super-Resolution20 Nov 2023
12 newest of 37 All 37 (JSON)