mlsanityData to 7 Oct 2026

MMVIAD: Multi-view Multi-task Video Understanding for Industrial Anomaly Detection

arXiv 2605.10833 ↗First posted 11 May 2026cs.CV cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Industrial anomaly detection is critical for manufacturing quality control, yet existing datasets mainly focus on static images or sparse views, which do not fully reflect continuous inspection processes in real industrial scenarios. We introduce MMVIAD (Multi-view Multi-task Video Industrial Anomaly Detection), to the best of our knowledge the first continuous multi-view video dataset for industrial anomaly detection and understanding, together with a benchmark for multi-task evaluation. MMVIAD contains object-centric 2-second inspection clips with approximately 120 degrees of camera motion, covering 48 object categories, 14 environments, and 6 structural anomaly types. It supports anomaly detection, defect classification, object classification, and anomaly visible-time localization. Systematic evaluations on MMVIAD show that current commercial and open-source video MLLMs remain far below human performance, especially for fine-grained defect recognition and temporal grounding. To improve transferable anomaly understanding, we further develop a two-stage post-training pipeline where PS-SFT (Perception-Structured Supervised Fine-Tuning) initializes perception-structured reasoning and VISTA-GRPO (Visibility-grounded Industrial Structured Temporal Anomaly Group Relative Policy Optimization) refines the model with semantic-gated defect reward and visibility-aware temporal reward, producing the final model VISTA. On MMVIAD-Unseen, VISTA improves the base model's average score across the four tasks from 45.0 to 57.5, surpassing GPT-5.4. Source code is available at https://github.com/Georgekeepmoving/MMVIAD.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 37 of its 45 references that are in the map. First posted on arXiv 11 May 2026.

Builds on

37 of 45 references.

References · 37

  1. 2022Training language models to follow instructions with human feedbackcited by 15,712
  2. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
  3. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
  4. 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,069
  5. 2023MiniGPT-4: Enhancing Vision-Language Understanding with Advanced Large Language Modelscited by 2,689
  6. 2025Qwen3-VL Technical Reportcited by 2,534
  7. 2023Video-LLaMA: An Instruction-tuned Audio-Visual Language Model for Video Understandingcited by 1,461
  8. 2023Video-ChatGPT: Towards Detailed Video Understanding via Large Vision and Language Modelscited by 1,047
  9. 2021Towards Total Recall in Industrial Anomaly Detectioncited by 772
  10. 2024VideoLLaMA 2: Advancing Spatial-Temporal Modeling and Audio Understanding in Video-LLMscited by 749
  11. 2017Localizing Moments in Video with Natural Languagecited by 660
  12. 2020PaDiM: a Patch Distribution Modeling Framework for Anomaly Detection and Localizationcited by 591
25 more
  1. 2017TALL: Temporal Activity Localization via Language Querycited by 581
  2. 2023LLaMA-VID: An Image is Worth 2 Tokens in Large Language Modelscited by 539
  3. 2021CutPaste: Self-Supervised Learning for Anomaly Detection and Localizationcited by 529
  4. 2021DRAEM -- A discriminatively trained reconstruction embedding for surface anomaly detectioncited by 510
  5. 2024Long Context Transfer from Language to Visioncited by 502
  6. 2025Video-R1: Reinforcing Video Reasoning in MLLMscited by 464
  7. 2022Anomaly Detection via Reverse Distillation from One-Class Embeddingcited by 419
  8. 2023TimeChat: A Time-sensitive Multimodal Large Language Model for Long Video Understandingcited by 399
  9. 2022SPot-the-Difference Self-Supervised Pre-training for Anomaly Detection and Segmentationcited by 397
  10. 2019Learning 2D Temporal Adjacent Networks for Moment Localization with Natural Languagecited by 283
  11. 2025VideoChat-R1: Enhancing Spatio-Temporal Perception via Reinforcement Fine-Tuningcited by 248
  12. 2021The MVTec 3D-AD Dataset for Unsupervised 3D Anomaly Detection and Localizationcited by 174
  13. 2023EfficientAD: Accurate Visual Anomaly Detection at Millisecond-Level Latenciescited by 157
  14. 2024Real-IAD: A Real-World Multi-View Dataset for Benchmarking Versatile Industrial Anomaly Detectioncited by 138
  15. 2025Time-R1: Post-Training Large Vision Language Model for Temporal Video Groundingcited by 138
  16. 2024TRACE: Temporal Grounding Video LLM via Causal Event Modelingcited by 87
  17. 2024VTG-LLM: Integrating Timestamp Knowledge into Video LLMs for Enhanced Video Temporal Groundingcited by 85
  18. 2023Towards Scalable 3D Anomaly Detection and Localization: A Benchmark via 3D Anomaly Synthesis and A Self-Supervised Learning Networkcited by 67
  19. 2025VideoChat-R1.5: Visual Test-Time Scaling to Reinforce Multimodal Reasoning by Iterative Perceptioncited by 60
  20. 2024ChatVTG: Video Temporal Grounding via Chat with Video Dialogue Large Language Modelscited by 54
  21. 2023PAD: A Dataset and Benchmark for Pose-agnostic Anomaly Detectioncited by 46
  22. 2024MMAD: A Comprehensive Benchmark for Multimodal Large Language Models in Industrial Anomaly Detectioncited by 46
  23. 2025AnomalyR1: A GRPO-based End-to-end MLLM for Industrial Anomaly Detectioncited by 28
  24. 2025Towards Visual Discrimination and Reasoning of Real-World Physical Dynamics: Physics-Grounded Anomaly Detectioncited by 9
  25. 2024RAD: A Dataset and Benchmark for Real-Life Anomaly Detection with Robotic Observationscited by 5

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025IADGPT: Unified LVLM for Few-Shot Industrial Anomaly Detection, Localization, and Reasoning via In-Context Learning
  2. 2026Industrial Anomaly Detection via Defect-Grounded Reasoning in Visual Latent Space
  3. 2024VMAD: Visual-enhanced Multimodal Large Language Model for Zero-Shot Anomaly Detection
  4. 2026AD-Copilot: A Vision-Language Assistant for Industrial Anomaly Detection via Visual In-context Comparison
  5. 2025Detect, Classify, Act: Categorizing Industrial Anomalies with Multi-Modal Large Language Models
  6. 2023AnomalyGPT: Detecting Industrial Anomalies Using Large Vision-Language Models
  7. 2026InspectorGPT: A Comparative Reasoning Enhanced VLM for Comprehensive Industrial Anomaly Detection
  8. 2025IAD-R1: Reinforcing Consistent Reasoning in Industrial Anomaly Detection