Position: Agentic Systems Constitute a Key Component of Next-Generation Intelligent Image Processing
On the map: LLM agents and tool use → Multimodal and embodied agents
Abstract (arXiv)
This position paper argues that the image processing community should broaden its focus from purely model-centric development to include agentic system design as an essential complementary paradigm. While deep learning has significantly advanced capabilities for specific image processing tasks, current approaches face critical limitations in generalization, adaptability, and real-world problem-solving flexibility. We propose that developing intelligent agentic systems, capable of dynamically selecting, combining, and optimizing existing image processing tools, represents the next evolutionary step for the field. Such systems would emulate human experts' ability to strategically orchestrate different tools to solve complex problems, overcoming the brittleness of monolithic models. The paper analyzes key limitations of model-centric paradigms, establishes design principles for agentic image processing systems, and outlines different capability levels for such agents.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Placed in Multimodal and embodied agents, one of 16 directions in LLM agents and tool use. Builds on 60 of its 70 references that are in the map. First posted on arXiv 21 May 2025.
Builds on
60 of 70 references.
Closest ancestors · 3
Same direction, newest first
- 2024An Intelligent Agentic System for Complex Image Restoration Problems23 Oct
- 2024RestoreAgent: Autonomous Image Restoration Agent via Multimodal Large Language Models25 Jul
- 2024Agent AI: Surveying the Horizons of Multimodal Interaction7 Jan
Other references · 57
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2023GPT-4 Technical Reportcited by 18,396
- 2022Training language models to follow instructions with human feedbackcited by 15,971
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
- 2022Large Language Models are Zero-Shot Reasonerscited by 4,374
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,276
- 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,568
- 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,211
38 more
- 2023Mistral 7Bcited by 3,164
- 2023A Survey on Large Language Model based Autonomous Agentscited by 2,242
- 2024Mixtral of Expertscited by 1,823
- 2023The Rise and Potential of Large Language Model Based Agents: A Surveycited by 1,439
- 2016Beyond a Gaussian Denoiser: Residual Learning of Deep CNN for Image Denoisingcited by 1,358
- 2014Image Super-Resolution Using Deep Convolutional Networkscited by 1,224
- 2023HuggingGPT: Solving AI Tasks with ChatGPT and its Friends in Hugging Facecited by 1,190
- 2021Real-ESRGAN: Training Real-World Blind Super-Resolution with Pure Synthetic Datacited by 970
- 2023Graph of Thoughts: Solving Elaborate Problems with Large Language Modelscited by 886
- 2024DeepSeekMoE: Towards Ultimate Expert Specialization in Mixture-of-Experts Language Modelscited by 867
- 2023Visual ChatGPT: Talking, Drawing and Editing with Visual Foundation Modelscited by 668
- 2019Learning agile and dynamic motor skills for legged robotscited by 504
- 2023Q-Align: Teaching LMMs for Visual Scoring via Discrete Text-Defined Levelscited by 503
- 2023Ghost in the Minecraft: Generally Capable Agents for Open-World Environments via Large Language Models with Text-based Knowledge and Memorycited by 289
- 2024Scaling Up to Excellence: Practicing Model Scaling for Photo-Realistic Image Restoration In the Wildcited by 286
- 2018Unprocessing Images for Learned Raw Denoisingcited by 250
- 2023Q-Bench: A Benchmark for General-Purpose Foundation Models on Low-level Visioncited by 249
- 2023Multimodal Foundation Models: From Specialists to General-Purpose Assistantscited by 247
- 2024A Survey on Mixture of Experts in Large Language Modelscited by 237
- 2023AutoAgents: A Framework for Automatic Agent Generationcited by 216
- 2023OctoPack: Instruction Tuning Code Large Language Modelscited by 189
- 2020PIPAL: a Large-Scale Image Quality Assessment Dataset for Perceptual Image Restorationcited by 178
- 2023SwiftSage: A Generative Agent with Fast and Slow Thinking for Complex Interactive Taskscited by 168
- 2025Teaching Large Language Models to Regress Accurate Image Quality Scores using Score Distributioncited by 141
- 2020Interpreting Super-Resolution Networks with Local Attribution Mapscited by 136
- 2023Depicting Beyond Scores: Advancing Image Quality Assessment through Multi-modal Language Modelscited by 105
- 2024Code Generation with AlphaCodium: From Prompt Engineering to Flow Engineeringcited by 103
- 2024Towards Open-ended Visual Quality Comparisoncited by 85
- 2023Masked Image Training for Generalizable Deep Image Denoisingcited by 57
- 2023SayCanPay: Heuristic Planning with Large Language Models using Learnable Domain Knowledgecited by 49
- 2018Crafting a Toolchain for Image Restoration by Deep Reinforcement Learningcited by 47
- 2024Enhancing Descriptive Image Quality Assessment with A Large-scale Multi-modal Datasetcited by 38
- 2025JarvisIR: Elevating Autonomous Driving Perception with Intelligent Image Restorationcited by 34
- 2017Reconfiguring the Imaging Pipeline for Computer Visioncited by 32
- 2020Image Quality Assessment for Perceptual Image Restoration: A New Dataset, Benchmark and Metriccited by 26
- 2022A Closer Look at Blind Super-Resolution: Degradation Models, Baselines, and Performance Upper Boundscited by 22
- 2023Crafting Training Degradation Distribution for the Accuracy-Generalization Trade-off in Real-World Super-Resolutioncited by 21
- 2021Discovering Distinctive "Semantics" in Super-Resolution Networkscited by 20
50 most cited of 57 All 57 (JSON)
Built on by
Citing papers per year: 2025: 1; 2026: 2.
3 papers.
Similar, not cited
Close in wording, no citation either way
- 2025Simple Agents Outperform Experts in Biomedical Imaging Workflow Optimization
- 2025Autonomous Computer Vision Development with Agentic AI
- 2026Agentic Discovery with Active Hypothesis Exploration for Visual Recognition
- 2026Kimi K2.5: Visual Agentic Intelligence
- 2026Agentic AI in Remote Sensing: Foundations, Taxonomy, and Emerging Systems
- 2026Does AI Understand Imaging? A Systematic Benchmark of Agentic AI for Computational Imaging Tasks
- 2026Self-Evolving Agentic Image Restoration via Deliberate Planning and Intuitive Execution
- 2025Agentic AI: A Comprehensive Survey of Architectures, Applications, and Future Directions