Self-Evolving Agentic Image Restoration via Deliberate Planning and Intuitive Execution
On the map: LLM agents and tool use → Multimodal and embodied agents
also in 1 more
Abstract (arXiv)
Real-world image restoration (IR) remains challenging due to complex and coupled degradations. While recent agentic IR frameworks leverage Large Language Models for flexible tool planning, they face two critical limitations. First, from a search scheme perspective, excessive reliance on greedy strategies fails to balance exploration and exploitation. Second, existing agentic systems underutilize information, exhibiting episodic amnesia. To address these challenges, we propose Self-Evolving Agentic Image Restoration (SEAR), which formulates restoration as a sequential decision-making problem. Inspired by the dual-process theory, SEAR comprises an Intuitive Executor and a Deliberate Planner, respectively following the fast-thinking textitSystem 1 and slow-thinking textitSystem 2 principles. The Deliberate Planner employs Pruning-Aware Monte Carlo Tree Search for long-horizon reasoning, utilizing a hybrid no-reference reward and a Multimodal Large Language Model (MLLM)-based tournament to prevent metric exploitation. Complementarily, the Intuitive Executor leverages a self-evolving episodic memory indexed by degradation-aware state fingerprints. This mechanism distills expensive search trajectories into adaptive expertise, overcoming episodic amnesia while progressively amortizing cold-start exploration costs through memory reuse. Extensive experiments on synthetic and real-world benchmarks demonstrate its strong perceptual and quantitative performance.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Placed in Multimodal and embodied agents, one of 16 directions in LLM agents and tool use. Builds on 56 of its 67 references that are in the map. First posted on arXiv 27 Jun 2026.
Builds on
56 of 67 references.
Closest ancestors · 4
Same direction, newest first
- 2025Hybrid Agents for Image Restoration13 Mar
- 2024An Intelligent Agentic System for Complex Image Restoration Problems23 Oct
- 2024RestoreAgent: Autonomous Image Restoration Agent via Multimodal Large Language Models25 Jul
- 2024Agent AI: Surveying the Horizons of Multimodal Interaction7 Jan
Other references · 52
- 2023GPT-4 Technical Reportcited by 18,132
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,500
- 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversationcited by 1,906
- 2021SwinIR: Image Restoration Using Swin Transformercited by 1,869
- 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Frameworkcited by 1,761
- 2021Restormer: Efficient Transformer for High-Resolution Image Restorationcited by 1,618
- 2016Beyond a Gaussian Denoiser: Residual Learning of Deep CNN for Image Denoisingcited by 1,352
- 2024Qwen2.5-Coder Technical Reportcited by 1,151
- 2021MUSIQ: Multi-scale Image Quality Transformercited by 1,058
38 more
- 2022Exploring CLIP for Assessing the Look and Feel of Imagescited by 974
- 2023Human Preference Score v2: A Solid Benchmark for Evaluating Human Preferences of Text-to-Image Synthesiscited by 847
- 2023MemoryBank: Enhancing Large Language Models with Long-Term Memorycited by 539
- 2019Object Detection in 20 Years: A Surveycited by 528
- 2022MANIQA: Multi-dimension Attention Network for No-Reference Image Quality Assessmentcited by 514
- 2019Toward Real-World Single Image Super-Resolution: A New Benchmark and A New Modelcited by 400
- 2022MAXIM: Multi-Axis MLP for Image Processingcited by 301
- 2022Vision Transformers for Single Image Dehazingcited by 255
- 2020Component Divide-and-Conquer for Real-World Image Super-Resolutioncited by 243
- 2024One-Step Effective Diffusion Network for Real-World Image Super-Resolutioncited by 243
- 2023Learning A Sparse Transformer Network for Effective Image Derainingcited by 204
- 2024InstructIR: High-Quality Image Restoration Following Human Instructionscited by 139
- 2020A Physics-based Noise Formation Model for Extreme Low-light Raw Denoisingcited by 138
- 2020NH-HAZE: An Image Dehazing Benchmark with Non-Homogeneous Hazy and Haze-Free Imagescited by 108
- 2023Controlling Vision-Language Models for Multi-Task Image Restorationcited by 108
- 2023Depicting Beyond Scores: Advancing Image Quality Assessment through Multi-modal Language Modelscited by 104
- 2023AutoDIR: Automatic All-in-One Image Restoration with Latent Diffusioncited by 98
- 2021Towards Flexible Blind JPEG Artifacts Removalcited by 76
- 2023RIDCP: Revitalizing Real Image Dehazing via High-Quality Codebook Priorscited by 73
- 2018I-HAZE: a dehazing benchmark with real hazy and haze-free indoor imagescited by 64
- 2023HAT: Hybrid Attention Transformer for Image Restorationcited by 64
- 2024ExACT: Teaching AI Agents to Explore with Reflective-MCTS and Exploratory Learningcited by 61
- 2024A Survey on All-in-One Image Restoration: Taxonomy, Evaluation and Future Trendscited by 58
- 2023Masked Image Training for Generalizable Deep Image Denoisingcited by 57
- 2023A Comparative Study of Image Restoration Networks for General Backbone Network Designcited by 56
- 2024Towards Effective Multiple-in-One Image Restoration: A Sequential and Prompt Learning Strategycited by 48
- 2020Image Restoration for Under-Display Cameracited by 47
- 2022Learning to Deblur using Light Field Generated and Real Defocus Imagescited by 46
- 2023From Sky to the Ground: A Large-scale Benchmark and Simple Baseline Towards Real Rain Removalcited by 39
- 2020MPRNet: Multi-Path Residual Network for Lightweight Image Super Resolutioncited by 38
- 2022Multi-stage image denoising with the wavelet transformcited by 37
- 2025Visual Autoregressive Modeling for Image Super-Resolutioncited by 36
- 20254KAgent: Agentic Any Image to 4K Super-Resolutioncited by 34
- 2025JarvisIR: Elevating Autonomous Driving Perception with Intelligent Image Restorationcited by 32
- 2018Does Haze Removal Help CNN-based Image Classification?cited by 20
- 2025Multi-Agent Image Restorationcited by 19
- 2025BlurDM: A Blur Diffusion Model for Image Deblurringcited by 5
- 2026RF-Agent: Automated Reward Function Design via Language Agent Tree Searchcited by 3
50 most cited of 52 All 52 (JSON)
Built on by
Citing papers per year: 2026: 3.
3 papers.
Similar, not cited
Close in wording, no citation either way
- 2026Causal-AgentIR: Self-Evolving Causal Memory for Adaptive Image Restoration Agents
- 2026EvoIR-Agent: Self-Evolving Image Restoration Agentic System via Experience-Driven Learning
- 2026TIR-Agent: Training an Explorative and Efficient Agent for Image Restoration
- 2026PaAgent: Portrait-Aware Image Restoration Agent via Subjective-Objective Reinforcement Learning
- 2025Restore-R1: Efficient Image Restoration Agents via Reinforcement Learning with Multimodal LLM Perceptual Feedback
- 2026DiTTo: Scalable Order-aware All-in-One Image Restoration Agent
- 2026RIRF: Reasoning Image Restoration Framework
- 2026Does AI Understand Imaging? A Systematic Benchmark of Agentic AI for Computational Imaging Tasks