mlsanityData to 7 Oct 2026

HarnessIR: Harnessing Multimodal Foundation Models for Universal Real-World Image Restoration

arXiv 2610.10133 ↗First posted 7 Oct 2026cs.CVcited by 0

On the map: LLM agents and tool use → Multimodal and embodied agents

Abstract (arXiv)

Real-world low-quality images suffer from complex mixed degradations, including but not limited to noise, blur, atmospheric effects, etc. Recent agentic methods usually model real-world image restoration (Real-IR) as a sequential tool calling problem over task-specific single-degradation restoration models. This paradigm, however, is fundamentally limited because complex real-world degradations cannot be cleanly undone degradation by degradation, and the tool used for task-specific models caps the capability of the agent system. In this work, we present HarnessIR, an agentic framework for Real-IR by harnessing a multimodal foundation model (MFM) as the executor. HarnessIR consists of five stages: perception and diagnosis, on-demand tool invocation, prompt composition, execution, and verification-driven refinement. Unlike prior agentic Real-IR methods that rely on tool chains assembled from task-specific models, HarnessIR feeds the restoration requirements, the perceptual diagnosis, and the evidence into an MFM that performs restoration in a single pass, followed by verification stages to determine whether the result warrants further processing. Under our harness, off-the-shelf MFMs handle restoration tasks remarkably well, achieving state-of-the-art results on the widely used MiO100 synthetic benchmark. More importantly, by exploiting the strong generalization ability of MFMs, HarnessIR delivers compelling restoration quality on challenging real-world scenes where previous agentic IR systems often struggle. Codes is available at https://github.com/PolyU-VCLab/HarnessIR.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Multimodal and embodied agents, one of 16 directions in LLM agents and tool use. Builds on 20 of its 77 references that are in the map. First posted on arXiv 7 Oct 2026.

Builds on

20 of 77 references.

Closest ancestors · 1

Same direction, newest first

  1. 2026Self-Evolving Agentic Image Restoration via Deliberate Planning and Intuitive Execution27 Jun

Other references · 19

  1. 2023GPT-4 Technical Reportcited by 18,132
  2. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
  3. 2025Qwen3-VL Technical Reportcited by 2,534
  4. 2023MemGPT: Towards LLMs as Operating Systemscited by 1,295
  5. 2025Qwen-Image Technical Reportcited by 973
  6. 2022Vision Transformers for Single Image Dehazingcited by 255
  7. 2018Real-world Noisy Image Denoising: A New Benchmarkcited by 74
  8. 2023HAT: Hybrid Attention Transformer for Image Restorationcited by 64
  9. 2024Towards Effective Multiple-in-One Image Restoration: A Sequential and Prompt Learning Strategycited by 48
  10. 2022Toward Real-world Single Image Deraining: A New Benchmark and Beyondcited by 40
  11. 20254KAgent: Agentic Any Image to 4K Super-Resolutioncited by 34
  12. 2024Photo-Realistic Image Restoration in the Wild with Controlled Vision-Language Modelscited by 19
7 more
  1. 2025Q-Agent: Quality-Driven Chain-of-Thought Image Restoration Agent through Robust Multimodal Large Language Modelcited by 13
  2. 2026PP-OCRv6: From 1.5M to 34.5M Parameters, Surpassing Billion-Scale VLMs on OCR Taskscited by 12
  3. 2026RealRestorer: Towards Generalizable Real-World Image Restoration with Large-Scale Image Editing Modelscited by 9
  4. 2025NTIRE 2025 the 2nd Restore Any Image Model (RAIM) in the Wild Challengecited by 5
  5. 2026Can Nano Banana 2 Replace Traditional Image Restoration Models? An Evaluation of Its Performance on Image Restoration Taskscited by 4
  6. 2026OPERA: An Agent for Image Restoration with End-to-End Joint Planning-Execution Optimizationcited by 2
  7. 2026PixRestore: Unified Image Restoration via Pixel Diffusion Transformercited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026SkillIR: Evolving Scene-Aware Skills for Agentic Image Restoration
  2. 2025Multi-Agent Image Restoration
  3. 2025Restore-R1: Efficient Image Restoration Agents via Reinforcement Learning with Multimodal LLM Perceptual Feedback
  4. 2024RestoreAgent: Autonomous Image Restoration Agent via Multimodal Large Language Models
  5. 2024An Intelligent Agentic System for Complex Image Restoration Problems
  6. 2026ClearAIR: A Human-Visual-Perception-Inspired All-in-One Image Restoration
  7. 2026PaAgent: Portrait-Aware Image Restoration Agent via Subjective-Objective Reinforcement Learning
  8. 2025Hybrid Agents for Image Restoration