Look Before You Restore: Learning to Predict Before Acting for Agentic Image Restoration
On the map: LLM agents and tool use → Multimodal and embodied agents also fits: Tool learning and function calling
Abstract (arXiv)
Agents for mixed-degradation image restoration typically learn what a tool does to an image only after running it: failed calls waste computation and harmful outputs go unnoticed until too late. We propose PreActIR, an agentic restoration framework that predicts tool consequences before execution. For each candidate tool, a tool-conditioned world model forecasts changes in residual degradation, image quality, and fidelity, together with the risk of harm and the uncertainty of the prediction. The agent executes the top-ranked candidate, and an independent verifier commits or rolls back its output before the agent replans from the observed state. PreActIR also audits whether performance is limited by the selector or by the candidate space, and studies targeted tool adaptation as a controlled way to expand that space. In a controlled evaluation that fixes the candidate pool, verifier, and budget and employs reference-annotated degradation states, PreActIR uses 42.5% fewer real tool calls and 63.4% fewer rejected calls than reactive, execute-then-evaluate trial and error, while improving Y-PSNR by 0.92 dB.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Multimodal and embodied agents, one of 16 directions in LLM agents and tool use. Builds on 57 of its 63 references that are in the map. First posted on arXiv 14 Oct 2026.
Builds on
57 of 63 references.
Closest ancestors · 10
Same direction, newest first
- 2026SkillIR: Evolving Scene-Aware Skills for Agentic Image Restoration18 Sep
- 2026Self-Evolving Agentic Image Restoration via Deliberate Planning and Intuitive Execution27 Jun
- 2026DiTTo: Scalable Order-aware All-in-One Image Restoration Agent29 May
- 2026EpiAgent: An Agent-Centric System for Ancient Inscription Restoration10 Apr
- 2026TIR-Agent: Training an Explorative and Efficient Agent for Image Restoration29 Mar
- 2026PaAgent: Portrait-Aware Image Restoration Agent via Subjective-Objective Reinforcement Learning17 Mar
- 2025Restore-R1: Efficient Image Restoration Agents via Reinforcement Learning with Multimodal LLM Perceptual Feedback21 Dec
- 2025Hybrid Agents for Image Restoration13 Mar
- 2024An Intelligent Agentic System for Complex Image Restoration Problems23 Oct
- 2024RestoreAgent: Autonomous Image Restoration Agent via Multimodal Large Language Models25 Jul
Other references · 47
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
- 2021SwinIR: Image Restoration Using Swin Transformercited by 1,887
- 2021Restormer: Efficient Transformer for High-Resolution Image Restorationcited by 1,627
- 2016Beyond a Gaussian Denoiser: Residual Learning of Deep CNN for Image Denoisingcited by 1,358
- 2019Mastering Atari, Go, Chess and Shogi by Planning with a Learned Modelcited by 1,353
- 2018Learning Latent Dynamics for Planning from Pixelscited by 1,264
- 2021MUSIQ: Multi-scale Image Quality Transformercited by 1,081
- 2022Exploring CLIP for Assessing the Look and Feel of Imagescited by 991
- 2021Real-ESRGAN: Training Real-World Blind Super-Resolution with Pure Synthetic Datacited by 970
- 2021Multi-Stage Progressive Image Restorationcited by 816
- 2018Recurrent World Models Facilitate Policy Evolutioncited by 785
35 more
- 2018Deep Reinforcement Learning in a Handful of Trials using Probabilistic Dynamics Modelscited by 774
- 2019When to Trust Your Model: Model-Based Policy Optimizationcited by 773
- 2018Deep Retinex Decomposition for Low-Light Enhancementcited by 723
- 2022Simple Baselines for Image Restorationcited by 708
- 2021Designing a Practical Degradation Model for Deep Blind Image Super-Resolutioncited by 529
- 2022MANIQA: Multi-dimension Attention Network for No-Reference Image Quality Assessmentcited by 522
- 2017FFDNet: Toward a Fast and Flexible Solution for CNN based Image Denoisingcited by 510
- 2018Learning to See in the Darkcited by 460
- 2022Activating More Pixels in Image Super-Resolution Transformercited by 438
- 2020Learning Enriched Features for Real Image Restoration and Enhancementcited by 312
- 2022MAXIM: Multi-Axis MLP for Image Processingcited by 302
- 2022Vision Transformers for Single Image Dehazingcited by 260
- 2021HINet: Half Instance Normalization Network for Image Restorationcited by 237
- 2024Is Your LLM Secretly a World Model of the Internet? Model-Based Planning for Web Agentscited by 154
- 2024InstructIR: High-Quality Image Restoration Following Human Instructionscited by 140
- 2023PromptIR: Prompting for All-in-One Blind Image Restorationcited by 114
- 2024AdaIR: Adaptive All-in-One Image Restoration via Frequency Mining and Modulationcited by 111
- 2023Controlling Vision-Language Models for Multi-Task Image Restorationcited by 110
- 2023AutoDIR: Automatic All-in-One Image Restoration with Latent Diffusioncited by 100
- 2024Complexity Experts are Task-Discriminative Learners for Any Image Restorationcited by 77
- 2024Perceive-IR: Learning to Perceive Degradation Better for All-in-One Image Restorationcited by 62
- 2023A Comparative Study of Image Restoration Networks for General Backbone Network Designcited by 57
- 2024Towards Effective Multiple-in-One Image Restoration: A Sequential and Prompt Learning Strategycited by 50
- 2018Crafting a Toolchain for Image Restoration by Deep Reinforcement Learningcited by 47
- 2019Path-Restore: Learning Network Path Selection for Image Restorationcited by 40
- 20254KAgent: Agentic Any Image to 4K Super-Resolutioncited by 36
- 2025JarvisIR: Elevating Autonomous Driving Perception with Intelligent Image Restorationcited by 34
- 2025Multi-Agent Image Restorationcited by 21
- 2025Q-Agent: Quality-Driven Chain-of-Thought Image Restoration Agent through Robust Multimodal Large Language Modelcited by 15
- 2024PreAct: Prediction Enhances Agent's Planning Abilitycited by 12
- 2026ClearAIR: A Human-Visual-Perception-Inspired All-in-One Image Restorationcited by 12
- 2025FAPE-IR: Frequency-Aware Planning and Execution Framework for All-in-One Image Restorationcited by 4
- 2026OPERA: An Agent for Image Restoration with End-to-End Joint Planning-Execution Optimizationcited by 4
- 2026Derain-Agent: A Plug-and-Play Agent Framework for Rainy Image Restorationcited by 1
- 2026Causal-AgentIR: Self-Evolving Causal Memory for Adaptive Image Restoration Agentscited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026HarnessIR: Harnessing Multimodal Foundation Models for Universal Real-World Image Restoration
- 2026EvoIR-Agent: Self-Evolving Image Restoration Agentic System via Experience-Driven Learning
- 2026Edit2Restore:Few-Shot Image Restoration via Parameter-Efficient Adaptation of Pre-trained Editing Models
- 2026RIRF: Reasoning Image Restoration Framework
- 2026VQ-Jarvis: Retrieval-Augmented Video Restoration Agent with Sharp Vision and Fast Thought
- 2026Continuous Expert Assembly: Instance-Conditioned Low-Rank Residuals for All-in-One Image Restoration
- 2026TTTIR: Unlocking Instance-Specific State Evolution via Test-Time Training for Image Restoration
- 2026UnSCAR: Universal, Scalable, Controllable, and Adaptable Image Restoration