mlsanityData to 7 Oct 2026

Self-Evolving Agentic Image Restoration via Deliberate Planning and Intuitive Execution

arXiv 2606.28971 ↗First posted 27 Jun 2026cs.CVcited by 3

On the map: LLM agents and tool use → Multimodal and embodied agents

also in 1 more
Abstract (arXiv)

Real-world image restoration (IR) remains challenging due to complex and coupled degradations. While recent agentic IR frameworks leverage Large Language Models for flexible tool planning, they face two critical limitations. First, from a search scheme perspective, excessive reliance on greedy strategies fails to balance exploration and exploitation. Second, existing agentic systems underutilize information, exhibiting episodic amnesia. To address these challenges, we propose Self-Evolving Agentic Image Restoration (SEAR), which formulates restoration as a sequential decision-making problem. Inspired by the dual-process theory, SEAR comprises an Intuitive Executor and a Deliberate Planner, respectively following the fast-thinking textitSystem 1 and slow-thinking textitSystem 2 principles. The Deliberate Planner employs Pruning-Aware Monte Carlo Tree Search for long-horizon reasoning, utilizing a hybrid no-reference reward and a Multimodal Large Language Model (MLLM)-based tournament to prevent metric exploitation. Complementarily, the Intuitive Executor leverages a self-evolving episodic memory indexed by degradation-aware state fingerprints. This mechanism distills expensive search trajectories into adaptive expertise, overcoming episodic amnesia while progressively amortizing cold-start exploration costs through memory reuse. Extensive experiments on synthetic and real-world benchmarks demonstrate its strong perceptual and quantitative performance.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Placed in Multimodal and embodied agents, one of 16 directions in LLM agents and tool use. Builds on 56 of its 67 references that are in the map. First posted on arXiv 27 Jun 2026.

Builds on

56 of 67 references.

Closest ancestors · 4

Same direction, newest first

  1. 2025Hybrid Agents for Image Restoration13 Mar
  2. 2024An Intelligent Agentic System for Complex Image Restoration Problems23 Oct
  3. 2024RestoreAgent: Autonomous Image Restoration Agent via Multimodal Large Language Models25 Jul
  4. 2024Agent AI: Surveying the Horizons of Multimodal Interaction7 Jan

Other references · 52

  1. 2023GPT-4 Technical Reportcited by 18,132
  2. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
  3. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  4. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  5. 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,500
  6. 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversationcited by 1,906
  7. 2021SwinIR: Image Restoration Using Swin Transformercited by 1,869
  8. 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Frameworkcited by 1,761
  9. 2021Restormer: Efficient Transformer for High-Resolution Image Restorationcited by 1,618
  10. 2016Beyond a Gaussian Denoiser: Residual Learning of Deep CNN for Image Denoisingcited by 1,352
  11. 2024Qwen2.5-Coder Technical Reportcited by 1,151
  12. 2021MUSIQ: Multi-scale Image Quality Transformercited by 1,058
38 more
  1. 2022Exploring CLIP for Assessing the Look and Feel of Imagescited by 974
  2. 2023Human Preference Score v2: A Solid Benchmark for Evaluating Human Preferences of Text-to-Image Synthesiscited by 847
  3. 2023MemoryBank: Enhancing Large Language Models with Long-Term Memorycited by 539
  4. 2019Object Detection in 20 Years: A Surveycited by 528
  5. 2022MANIQA: Multi-dimension Attention Network for No-Reference Image Quality Assessmentcited by 514
  6. 2019Toward Real-World Single Image Super-Resolution: A New Benchmark and A New Modelcited by 400
  7. 2022MAXIM: Multi-Axis MLP for Image Processingcited by 301
  8. 2022Vision Transformers for Single Image Dehazingcited by 255
  9. 2020Component Divide-and-Conquer for Real-World Image Super-Resolutioncited by 243
  10. 2024One-Step Effective Diffusion Network for Real-World Image Super-Resolutioncited by 243
  11. 2023Learning A Sparse Transformer Network for Effective Image Derainingcited by 204
  12. 2024InstructIR: High-Quality Image Restoration Following Human Instructionscited by 139
  13. 2020A Physics-based Noise Formation Model for Extreme Low-light Raw Denoisingcited by 138
  14. 2020NH-HAZE: An Image Dehazing Benchmark with Non-Homogeneous Hazy and Haze-Free Imagescited by 108
  15. 2023Controlling Vision-Language Models for Multi-Task Image Restorationcited by 108
  16. 2023Depicting Beyond Scores: Advancing Image Quality Assessment through Multi-modal Language Modelscited by 104
  17. 2023AutoDIR: Automatic All-in-One Image Restoration with Latent Diffusioncited by 98
  18. 2021Towards Flexible Blind JPEG Artifacts Removalcited by 76
  19. 2023RIDCP: Revitalizing Real Image Dehazing via High-Quality Codebook Priorscited by 73
  20. 2018I-HAZE: a dehazing benchmark with real hazy and haze-free indoor imagescited by 64
  21. 2023HAT: Hybrid Attention Transformer for Image Restorationcited by 64
  22. 2024ExACT: Teaching AI Agents to Explore with Reflective-MCTS and Exploratory Learningcited by 61
  23. 2024A Survey on All-in-One Image Restoration: Taxonomy, Evaluation and Future Trendscited by 58
  24. 2023Masked Image Training for Generalizable Deep Image Denoisingcited by 57
  25. 2023A Comparative Study of Image Restoration Networks for General Backbone Network Designcited by 56
  26. 2024Towards Effective Multiple-in-One Image Restoration: A Sequential and Prompt Learning Strategycited by 48
  27. 2020Image Restoration for Under-Display Cameracited by 47
  28. 2022Learning to Deblur using Light Field Generated and Real Defocus Imagescited by 46
  29. 2023From Sky to the Ground: A Large-scale Benchmark and Simple Baseline Towards Real Rain Removalcited by 39
  30. 2020MPRNet: Multi-Path Residual Network for Lightweight Image Super Resolutioncited by 38
  31. 2022Multi-stage image denoising with the wavelet transformcited by 37
  32. 2025Visual Autoregressive Modeling for Image Super-Resolutioncited by 36
  33. 20254KAgent: Agentic Any Image to 4K Super-Resolutioncited by 34
  34. 2025JarvisIR: Elevating Autonomous Driving Perception with Intelligent Image Restorationcited by 32
  35. 2018Does Haze Removal Help CNN-based Image Classification?cited by 20
  36. 2025Multi-Agent Image Restorationcited by 19
  37. 2025BlurDM: A Blur Diffusion Model for Image Deblurringcited by 5
  38. 2026RF-Agent: Automated Reward Function Design via Language Agent Tree Searchcited by 3

50 most cited of 52 All 52 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 3.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Causal-AgentIR: Self-Evolving Causal Memory for Adaptive Image Restoration Agents
  2. 2026EvoIR-Agent: Self-Evolving Image Restoration Agentic System via Experience-Driven Learning
  3. 2026TIR-Agent: Training an Explorative and Efficient Agent for Image Restoration
  4. 2026PaAgent: Portrait-Aware Image Restoration Agent via Subjective-Objective Reinforcement Learning
  5. 2025Restore-R1: Efficient Image Restoration Agents via Reinforcement Learning with Multimodal LLM Perceptual Feedback
  6. 2026DiTTo: Scalable Order-aware All-in-One Image Restoration Agent
  7. 2026RIRF: Reasoning Image Restoration Framework
  8. 2026Does AI Understand Imaging? A Systematic Benchmark of Agentic AI for Computational Imaging Tasks