mlsanityData to 7 Oct 2026

Restore-R1: Efficient Image Restoration Agents via Reinforcement Learning with Multimodal LLM Perceptual Feedback

arXiv 2512.18599 ↗First posted 21 Dec 2025cs.CVcited by 4

On the map: Multimodal LLMs / vision-language models → Image editing and quality assessment

also in 1 more
Abstract (arXiv)

Complex image restoration aims to recover high-quality images from inputs affected by multiple degradations such as blur, noise, rain, and compression artifacts. Recent restoration agents, powered by vision-language models and large language models, offer promising restoration capabilities but suffer from significant efficiency bottlenecks due to reflection, rollback, and iterative tool searching. Moreover, their performance heavily depends on degradation recognition models that require extensive annotations for training, limiting their applicability in label-free environments. To address these limitations, we propose a policy optimization-based restoration framework that learns an lightweight agent to determine tool-calling sequences. The agent operates in a sequential decision process, selecting the most appropriate restoration operation at each step to maximize final image quality. To enable training within label-free environments, we introduce a novel reward mechanism driven by multimodal large language models, which act as human-aligned evaluator and provide perceptual feedback for policy improvement. Once trained, our agent executes a deterministic restoration plans without redundant tool invocations, significantly accelerating inference while maintaining high restoration quality. Extensive experiments show that despite using no supervision, our method matches SOTA performance on full-reference metrics and surpasses existing approaches on no-reference metrics across diverse degradation scenarios.

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Placed in Image editing and quality assessment, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 55 of its 74 references that are in the map. First posted on arXiv 21 Dec 2025.

Builds on

55 of 74 references.

Closest ancestors · 4

Same direction, newest first

  1. 2025Teaching Large Language Models to Regress Accurate Image Quality Scores using Score Distribution20 Jan
  2. 2024RestoreAgent: Autonomous Image Restoration Agent via Multimodal Large Language Models25 Jul
  3. 2023Depicting Beyond Scores: Advancing Image Quality Assessment through Multi-modal Language Models14 Dec
  4. 2023Controlling Vision-Language Models for Multi-Task Image Restoration2 Oct

Other references · 51

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2023GPT-4 Technical Reportcited by 18,132
  3. 2022Training language models to follow instructions with human feedbackcited by 15,712
  4. 2017Proximal Policy Optimization Algorithmscited by 14,441
  5. 2024The Llama 3 Herd of Modelscited by 14,192
  6. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
  7. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  8. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
  9. 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,151
  10. 2013Playing Atari with Deep Reinforcement Learningcited by 3,211
  11. 2015Trust Region Policy Optimizationcited by 2,503
  12. 2015High-Dimensional Continuous Control Using Generalized Advantage Estimationcited by 1,916
38 more
  1. 2021SwinIR: Image Restoration Using Swin Transformercited by 1,869
  2. 2021Restormer: Efficient Transformer for High-Resolution Image Restorationcited by 1,618
  3. 2021MUSIQ: Multi-scale Image Quality Transformercited by 1,058
  4. 2022Exploring CLIP for Assessing the Look and Feel of Imagescited by 974
  5. 2021Uformer: A General U-Shaped Transformer for Image Restorationcited by 864
  6. 2021Multi-Stage Progressive Image Restorationcited by 813
  7. 2017The Perception-Distortion Tradeoffcited by 582
  8. 2022MANIQA: Multi-dimension Attention Network for No-Reference Image Quality Assessmentcited by 514
  9. 2017Benchmarking Single Image Dehazing and Beyondcited by 445
  10. 2019Benchmarking Robustness in Object Detection: Autonomous Driving when Winter is Comingcited by 332
  11. 2020Learning Enriched Features for Real Image Restoration and Enhancementcited by 311
  12. 2022MAXIM: Multi-Axis MLP for Image Processingcited by 301
  13. 2022Vision Transformers for Single Image Dehazingcited by 255
  14. 2024InstructIR: High-Quality Image Restoration Following Human Instructionscited by 139
  15. 2023AutoDIR: Automatic All-in-One Image Restoration with Latent Diffusioncited by 98
  16. 2021Iterative Filter Adaptive Network for Single Image Defocus Deblurringcited by 85
  17. 2024Towards Open-ended Visual Quality Comparisoncited by 85
  18. 2021Towards Flexible Blind JPEG Artifacts Removalcited by 76
  19. 2023RIDCP: Revitalizing Real Image Dehazing via High-Quality Codebook Priorscited by 73
  20. 2023A Comparative Study of Image Restoration Networks for General Backbone Network Designcited by 56
  21. 2018Distort-and-Recover: Color Enhancement using Deep Reinforcement Learningcited by 52
  22. 2025Token Reduction Should Go Beyond Efficiency in Generative Models -- From Vision, Language to Multimodalitycited by 49
  23. 2024Towards Effective Multiple-in-One Image Restoration: A Sequential and Prompt Learning Strategycited by 48
  24. 2022Learning to Deblur using Light Field Generated and Real Defocus Imagescited by 46
  25. 2022Weakly-Supervised Camouflaged Object Detection with Scribble Annotationscited by 43
  26. 2024An Intelligent Agentic System for Complex Image Restoration Problemscited by 41
  27. 2024All-In-One Medical Image Restoration via Task-Adaptive Routingcited by 30
  28. 2025Multi-Agent Image Restorationcited by 19
  29. 2023Robust Unsupervised StyleGAN Image Restorationcited by 14
  30. 2025Hybrid Agents for Image Restorationcited by 14
  31. 2025DSPO: Direct Semantic Preference Optimization for Real-World Image Super-Resolutioncited by 13
  32. 2025VQToken: Neural Discrete Token Representation Learning for Extreme Token Reduction in Video Large Language Modelscited by 12
  33. 2025Representation Potentials of Foundation Models for Multimodal Alignment: A Surveycited by 10
  34. 2024A Preliminary Exploration Towards General Image Restorationcited by 6
  35. 2025RealSR-R1: Reinforcement Learning for Real-World Image Super-Resolution with Vision-Language Chain-of-Thoughtcited by 5
  36. 2025CoT Referring: Improving Referring Expression Tasks with Grounded Reasoningcited by 5
  37. 2025LinkedOut: Linking World Knowledge Representation Out of Video LLM for Next-Generation Video Recommendationcited by 5
  38. 2023IFT: Image Fusion Transformer for Ghost-free High Dynamic Range Imagingcited by 3

50 most cited of 51 All 51 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 4.

4 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026EvoIR-Agent: Self-Evolving Image Restoration Agentic System via Experience-Driven Learning
  2. 2026PaAgent: Portrait-Aware Image Restoration Agent via Subjective-Objective Reinforcement Learning
  3. 2026HarnessIR: Harnessing Multimodal Foundation Models for Universal Real-World Image Restoration
  4. 2026RIRF: Reasoning Image Restoration Framework
  5. 2026DiTTo: Scalable Order-aware All-in-One Image Restoration Agent
  6. 2026Self-Evolving Agentic Image Restoration via Deliberate Planning and Intuitive Execution
  7. 2026VQ-Jarvis: Retrieval-Augmented Video Restoration Agent with Sharp Vision and Fast Thought
  8. 2026Leveraging Multimodal Large Language Models for All-in-One Image Restoration via a Mixture of Frequency Experts