AgentIAD: Agentic Industrial Anomaly Detection via Adaptive Memory Augmentation
On the map: LLM agents and tool use → Software engineering coding agents
Abstract (arXiv)
Industrial anomaly detection (IAD) is challenging due to the subtle and highly localized nature of many defects, which single-pass vision--language models (VLMs) often fail to capture. Moreover, existing approaches lack mechanisms to actively acquire complementary evidence during inference. We propose AgentIAD, an agentic vision--language framework that enables iterative industrial inspection through a unified action space. The agent dynamically accesses two forms of memory during inspection: visual memory via the Perceptive Zoomer (PZ) for fine-grained local analysis, and retrieved memory via the Web Searcher (WS) and Comparative Retriever (CR) for external knowledge acquisition and cross-instance verification. This design allows the model to progressively gather evidence through multi-round perception--action reasoning. To effectively learn such policies under sparse supervision, AgentIAD adopts a two-stage training strategy: tool-aware supervised fine-tuning first initializes structured reasoning and memory-access behaviors, followed by agentic reinforcement learning to refine long-horizon decision policies. Extensive experiments show that, under the same backbone, AgentIAD improves classification accuracy by 5.92% over the previous state-of-the-art method on the MMAD benchmark while providing more reliable and interpretable anomaly analysis.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Placed in Software engineering coding agents, one of 16 directions in LLM agents and tool use. Builds on 42 of its 46 references that are in the map. First posted on arXiv 15 Dec 2025.
Builds on
42 of 46 references.
References · 42
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
- 2023Visual Instruction Tuningcited by 7,792
- 2024GPT-4o System Cardcited by 4,467
- 2023Improved Baselines with Visual Instruction Tuningcited by 4,362
- 2023Qwen Technical Reportcited by 3,273
- 2024Gemini 1.5: Unlocking multimodal understanding across millions of tokens of contextcited by 3,175
- 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,534
- 2025Qwen3-VL Technical Reportcited by 2,534
- 2024MiniCPM-V: A GPT-4V Level MLLM on Your Phonecited by 1,061
- 2025A-MEM: Agentic Memory for LLM Agentscited by 1,000
- 2021Towards Total Recall in Industrial Anomaly Detectioncited by 772
- 2020PaDiM: a Patch Distribution Modeling Framework for Anomaly Detection and Localizationcited by 591
30 more
- 2019Memorizing Normality to Detect Anomaly: Memory-augmented Deep Autoencoder for Unsupervised Anomaly Detectioncited by 560
- 2021CutPaste: Self-Supervised Learning for Anomaly Detection and Localizationcited by 529
- 2021DRAEM -- A discriminatively trained reconstruction embedding for surface anomaly detectioncited by 510
- 2025DeepEyes: Incentivizing "Thinking with Images" via Reinforcement Learningcited by 398
- 2022SPot-the-Difference Self-Supervised Pre-training for Anomaly Detection and Segmentationcited by 397
- 2023WinCLIP: Zero-/Few-Shot Anomaly Classification and Segmentationcited by 311
- 2020Sub-Image Anomaly Detection with Deep Pyramid Correspondencescited by 297
- 2023AnomalyCLIP: Object-agnostic Prompt Learning for Zero-shot Anomaly Detectioncited by 270
- 2024VideoAgent: A Memory-augmented Multimodal Agent for Video Understandingcited by 224
- 2023Multimodal Large Language Models: A Surveycited by 193
- 2023AnomalyGPT: Detecting Industrial Anomalies Using Large Vision-Language Modelscited by 169
- 2022Registration based Few-Shot Anomaly Detectioncited by 133
- 2020Explainable Deep One-Class Classificationcited by 126
- 2024AdaCLIP: Adapting CLIP with Hybrid Learnable Prompts for Zero-Shot Anomaly Detectioncited by 126
- 2024PromptAD: Learning Prompts with only Normal Samples for Few-Shot Anomaly Detectioncited by 97
- 2024MMAD: A Comprehensive Benchmark for Multimodal Large Language Models in Industrial Anomaly Detectioncited by 46
- 2025VisionThink: Smart and Efficient Vision Language Model via Reinforcement Learningcited by 41
- 2023Myriad: Large Multimodal Model by Applying Vision Experts for Industrial Anomaly Detectioncited by 39
- 2022MAEDAY: MAE for few and zero shot AnomalY-Detectioncited by 30
- 2025AnomalyR1: A GRPO-based End-to-end MLLM for Industrial Anomaly Detectioncited by 28
- 2025LogicAD: Explainable Anomaly Detection via VLM-based Text Feature Extractioncited by 24
- 2023PKU-GoodsAD: A Supermarket Goods Dataset for Unsupervised Anomaly Detection and Segmentationcited by 21
- 2025OmniAD: Detect and Understand Industrial Anomaly via Multimodal Reasoningcited by 18
- 2025IAD-R1: Reinforcing Consistent Reasoning in Industrial Anomaly Detectioncited by 17
- 2023Random Word Data Augmentation with CLIP for Zero-Shot Anomaly Detectioncited by 15
- 2025EMIT: Enhancing MLLMs for Industrial Anomaly Detection via Difficulty-Aware GRPOcited by 11
- 2025LAD-Reasoner: Tiny Multimodal Models are Good Reasoners for Logical Anomaly Detectioncited by 9
- 2025LR-IAD:Mask-Free Industrial Anomaly Detection with Logical Reasoningcited by 9
- 2025AD-FM: Multimodal LLMs for Anomaly Detection via Multi-Stage Reasoning and Fine-Grained Reward Optimizationcited by 8
- 2025A Survey on Foundation-Model-Based Industrial Defect Detectioncited by 5
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026AnomalyClaw: A Universal Visual Anomaly Detection Agent via Tool-Grounded Refutationcited by 0
- 2026IndusAgent: Reinforcing Open-Vocabulary Industrial Anomaly Detection with Agentic Toolscited by 0
- 2026Industrial Anomaly Detection via Defect-Grounded Reasoning in Visual Latent Spacecited by 0
- 2026Is In-Domain Training Enough for Fine-Grained Industrial Anomaly Understanding?cited by 0
- 2026Is In-Domain Training Enough for Fine-Grained Industrial Anomaly Understanding?8 Oct 2026
- 2026Industrial Anomaly Detection via Defect-Grounded Reasoning in Visual Latent Space24 Sep 2026
- 2026IndusAgent: Reinforcing Open-Vocabulary Industrial Anomaly Detection with Agentic Tools20 May 2026
- 2026AnomalyClaw: A Universal Visual Anomaly Detection Agent via Tool-Grounded Refutation11 May 2026
Similar, not cited
Close in wording, no citation either way
- 2025AutoIAD: Manager-Driven Multi-Agent Collaboration for Automated Industrial Anomaly Detection
- 2026Plan First, Judge Later, Run Better: A DMAIC-Inspired Agentic System for Industrial Anomaly Detection
- 2026AnomalyAgent: Agentic Industrial Anomaly Synthesis via Tool-Augmented Reinforcement Learning
- 2025PANDA: Towards Generalist Video Anomaly Detection via Agentic AI Engineer
- 2026AgenticVAU: Multi-Agent Explore-Verify Reasoning for Video Anomaly Understanding
- 2026Towards Explainable Industrial Anomaly Detection via Knowledge-Guided Latent Reasoning
- 2026OPD-IAD: From Language Judgment to Industrial Anomaly Detection via On-Policy Self-Distillation
- 2026AnomalyAgent: Training-Free Agentic Models for Zero-/Few-Shot Anomaly Detection