Restore-R1: Efficient Image Restoration Agents via Reinforcement Learning with Multimodal LLM Perceptual Feedback
On the map: Multimodal LLMs / vision-language models → Image editing and quality assessment
also in 1 more
Abstract (arXiv)
Complex image restoration aims to recover high-quality images from inputs affected by multiple degradations such as blur, noise, rain, and compression artifacts. Recent restoration agents, powered by vision-language models and large language models, offer promising restoration capabilities but suffer from significant efficiency bottlenecks due to reflection, rollback, and iterative tool searching. Moreover, their performance heavily depends on degradation recognition models that require extensive annotations for training, limiting their applicability in label-free environments. To address these limitations, we propose a policy optimization-based restoration framework that learns an lightweight agent to determine tool-calling sequences. The agent operates in a sequential decision process, selecting the most appropriate restoration operation at each step to maximize final image quality. To enable training within label-free environments, we introduce a novel reward mechanism driven by multimodal large language models, which act as human-aligned evaluator and provide perceptual feedback for policy improvement. Once trained, our agent executes a deterministic restoration plans without redundant tool invocations, significantly accelerating inference while maintaining high restoration quality. Extensive experiments show that despite using no supervision, our method matches SOTA performance on full-reference metrics and surpasses existing approaches on no-reference metrics across diverse degradation scenarios.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Placed in Image editing and quality assessment, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 55 of its 74 references that are in the map. First posted on arXiv 21 Dec 2025.
Builds on
55 of 74 references.
Closest ancestors · 4
Same direction, newest first
- 2025Teaching Large Language Models to Regress Accurate Image Quality Scores using Score Distribution20 Jan
- 2024RestoreAgent: Autonomous Image Restoration Agent via Multimodal Large Language Models25 Jul
- 2023Depicting Beyond Scores: Advancing Image Quality Assessment through Multi-modal Language Models14 Dec
- 2023Controlling Vision-Language Models for Multi-Task Image Restoration2 Oct
Other references · 51
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2023GPT-4 Technical Reportcited by 18,132
- 2022Training language models to follow instructions with human feedbackcited by 15,712
- 2017Proximal Policy Optimization Algorithmscited by 14,441
- 2024The Llama 3 Herd of Modelscited by 14,192
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
- 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,151
- 2013Playing Atari with Deep Reinforcement Learningcited by 3,211
- 2015Trust Region Policy Optimizationcited by 2,503
- 2015High-Dimensional Continuous Control Using Generalized Advantage Estimationcited by 1,916
38 more
- 2021SwinIR: Image Restoration Using Swin Transformercited by 1,869
- 2021Restormer: Efficient Transformer for High-Resolution Image Restorationcited by 1,618
- 2021MUSIQ: Multi-scale Image Quality Transformercited by 1,058
- 2022Exploring CLIP for Assessing the Look and Feel of Imagescited by 974
- 2021Uformer: A General U-Shaped Transformer for Image Restorationcited by 864
- 2021Multi-Stage Progressive Image Restorationcited by 813
- 2017The Perception-Distortion Tradeoffcited by 582
- 2022MANIQA: Multi-dimension Attention Network for No-Reference Image Quality Assessmentcited by 514
- 2017Benchmarking Single Image Dehazing and Beyondcited by 445
- 2019Benchmarking Robustness in Object Detection: Autonomous Driving when Winter is Comingcited by 332
- 2020Learning Enriched Features for Real Image Restoration and Enhancementcited by 311
- 2022MAXIM: Multi-Axis MLP for Image Processingcited by 301
- 2022Vision Transformers for Single Image Dehazingcited by 255
- 2024InstructIR: High-Quality Image Restoration Following Human Instructionscited by 139
- 2023AutoDIR: Automatic All-in-One Image Restoration with Latent Diffusioncited by 98
- 2021Iterative Filter Adaptive Network for Single Image Defocus Deblurringcited by 85
- 2024Towards Open-ended Visual Quality Comparisoncited by 85
- 2021Towards Flexible Blind JPEG Artifacts Removalcited by 76
- 2023RIDCP: Revitalizing Real Image Dehazing via High-Quality Codebook Priorscited by 73
- 2023A Comparative Study of Image Restoration Networks for General Backbone Network Designcited by 56
- 2018Distort-and-Recover: Color Enhancement using Deep Reinforcement Learningcited by 52
- 2025Token Reduction Should Go Beyond Efficiency in Generative Models -- From Vision, Language to Multimodalitycited by 49
- 2024Towards Effective Multiple-in-One Image Restoration: A Sequential and Prompt Learning Strategycited by 48
- 2022Learning to Deblur using Light Field Generated and Real Defocus Imagescited by 46
- 2022Weakly-Supervised Camouflaged Object Detection with Scribble Annotationscited by 43
- 2024An Intelligent Agentic System for Complex Image Restoration Problemscited by 41
- 2024All-In-One Medical Image Restoration via Task-Adaptive Routingcited by 30
- 2025Multi-Agent Image Restorationcited by 19
- 2023Robust Unsupervised StyleGAN Image Restorationcited by 14
- 2025Hybrid Agents for Image Restorationcited by 14
- 2025DSPO: Direct Semantic Preference Optimization for Real-World Image Super-Resolutioncited by 13
- 2025VQToken: Neural Discrete Token Representation Learning for Extreme Token Reduction in Video Large Language Modelscited by 12
- 2025Representation Potentials of Foundation Models for Multimodal Alignment: A Surveycited by 10
- 2024A Preliminary Exploration Towards General Image Restorationcited by 6
- 2025RealSR-R1: Reinforcement Learning for Real-World Image Super-Resolution with Vision-Language Chain-of-Thoughtcited by 5
- 2025CoT Referring: Improving Referring Expression Tasks with Grounded Reasoningcited by 5
- 2025LinkedOut: Linking World Knowledge Representation Out of Video LLM for Next-Generation Video Recommendationcited by 5
- 2023IFT: Image Fusion Transformer for Ghost-free High Dynamic Range Imagingcited by 3
50 most cited of 51 All 51 (JSON)
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026TIR-Agent: Training an Explorative and Efficient Agent for Image Restorationcited by 3
- 2026MUSE: A Unified Agentic Harness for MLLMscited by 0
- 2026Causal-AgentIR: Self-Evolving Causal Memory for Adaptive Image Restoration Agentscited by 0
- 2026SkillIR: Evolving Scene-Aware Skills for Agentic Image Restorationcited by 0
- 2026SkillIR: Evolving Scene-Aware Skills for Agentic Image Restoration18 Sep 2026
- 2026Causal-AgentIR: Self-Evolving Causal Memory for Adaptive Image Restoration Agents23 Jul 2026
- 2026MUSE: A Unified Agentic Harness for MLLMs2 Jun 2026
- 2026TIR-Agent: Training an Explorative and Efficient Agent for Image Restoration29 Mar 2026
Similar, not cited
Close in wording, no citation either way
- 2026EvoIR-Agent: Self-Evolving Image Restoration Agentic System via Experience-Driven Learning
- 2026PaAgent: Portrait-Aware Image Restoration Agent via Subjective-Objective Reinforcement Learning
- 2026HarnessIR: Harnessing Multimodal Foundation Models for Universal Real-World Image Restoration
- 2026RIRF: Reasoning Image Restoration Framework
- 2026DiTTo: Scalable Order-aware All-in-One Image Restoration Agent
- 2026Self-Evolving Agentic Image Restoration via Deliberate Planning and Intuitive Execution
- 2026VQ-Jarvis: Retrieval-Augmented Video Restoration Agent with Sharp Vision and Fast Thought
- 2026Leveraging Multimodal Large Language Models for All-in-One Image Restoration via a Mixture of Frequency Experts