mlsanityData to 14 Oct 2026

FoodMonitor: Benchmarking MLLMs for Explainable Compliance Analysis

arXiv 2605.24503 ↗First posted 23 May 2026cs.CV cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

As AI-powered compliance monitoring becomes increasingly important in public governance and industrial safety, the ability to provide verifiable evidence and traceable accountability signals is essential. However, existing video anomaly detection datasets focus on event-level binary classification, lacking the rule-driven, explainable analysis required for real-world compliance scenarios. We introduce FoodMonitor, a benchmark for explainable compliance analysis in commercial kitchen surveillance. FoodMonitor comprises 477 video clips with 3,307 violation annotations across a dual-channel design covering both person-level and environment-level violations. Each annotation specifies which rule was violated, what non-compliant behavior occurred, and who committed it with frame-level bounding boxes. We establish a unified evaluation protocol with a two-stage matching mechanism that separately assesses spatial localization and semantic understanding, along with a composite metric (Cscore) that balances environment and person detection performance. Systematic evaluation of several state-of-the-art multimodal large language models reveals that the best-performing model achieves only 0.360 Cscore, with spatial localization and fine-grained rule understanding emerging as the primary bottlenecks. Our analysis identifies two distinct failure modes: localization-dominated errors and semantics-dominated errors, providing diagnostic insights for future model development.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 32 of its 38 references that are in the map. First posted on arXiv 23 May 2026.

Builds on

32 of 38 references.

References · 32

  1. 2025Qwen2.5-VL Technical Reportcited by 5,587
  2. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
  3. 2024Gemini 1.5: Unlocking multimodal understanding across millions of tokens of contextcited by 3,224
  4. 2025Qwen3-VL Technical Reportcited by 2,793
  5. 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,834
  6. 2021Ego4D: Around the World in 3,000 Hours of Egocentric Videocited by 1,556
  7. 2024Video-MME: The First-Ever Comprehensive Evaluation Benchmark of Multi-modal LLMs in Video Analysiscited by 1,413
  8. 2023MVBench: A Comprehensive Multi-modal Video Understanding Benchmarkcited by 1,109
  9. 2018Scaling Egocentric Vision: The EPIC-KITCHENS Datasetcited by 795
  10. 2023EgoSchema: A Diagnostic Benchmark for Very Long-form Video Language Understandingcited by 680
  11. 2018Real-world Anomaly Detection in Surveillance Videoscited by 577
  12. 2019Memorizing Normality to Detect Anomaly: Memory-augmented Deep Autoencoder for Unsupervised Anomaly Detectioncited by 564
20 more
  1. 2019ActivityNet-QA: A Dataset for Understanding Complex Web Videos via Question Answeringcited by 561
  2. 2020Rescaling Egocentric Visioncited by 540
  3. 2026Kimi K2.5: Visual Agentic Intelligencecited by 501
  4. 2025GLM-4.5V and GLM-4.1V-Thinking: Towards Versatile Multimodal Reasoning with Scalable Reinforcement Learningcited by 466
  5. 2021LAVT: Language-Aware Vision Transformer for Referring Image Segmentationcited by 348
  6. 2019COIN: A Large-scale Dataset for Comprehensive Instructional Video Analysiscited by 318
  7. 2022Assembly101: A Large-Scale Multi-View Video Dataset for Understanding Procedural Activitiescited by 287
  8. 2020Learning Memory-guided Normality for Anomaly Detectioncited by 278
  9. 2016Learning Temporal Regularity in Video Sequencescited by 254
  10. 2020Not only Look, but also Listen: Learning Multimodal Violence Detection under Weak Supervisioncited by 238
  11. 2021Weakly-supervised Video Anomaly Detection with Robust Temporal Feature Magnitude Learningcited by 230
  12. 2021MIST: Multiple Instance Self-Training Framework for Video Anomaly Detectioncited by 138
  13. 2023VadCLIP: Adapting Vision-Language Models for Weakly Supervised Video Anomaly Detectioncited by 123
  14. 2021UBnormal: New Benchmark for Supervised Open-Set Video Anomaly Detectioncited by 93
  15. 2019Street Scene: A new dataset and evaluation protocol for video anomaly detectioncited by 90
  16. 2023Hybrid-SORT: Weak Cues Matter for Online Multi-Object Trackingcited by 67
  17. 2023Unbiased Multiple Instance Learning for Weakly Supervised Video Anomaly Detectioncited by 64
  18. 2023Open-Vocabulary Video Anomaly Detectioncited by 57
  19. 2024Text Prompt with Normality Guidance for Weakly Supervised Video Anomaly Detectioncited by 49
  20. 2025Anomize: Better Open Vocabulary Video Anomaly Detectioncited by 13

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026SteelBench: Evaluating Vision-Language Models in Real-World Industrial Environments
  2. 2025January Food Benchmark (JFB): A Public Benchmark Dataset and Evaluation Suite for Multimodal Food Analysis
  3. 2025iSafetyBench: A video-language benchmark for safety in industrial environment
  4. 2025MultiFoodhat: A potential new paradigm for intelligent food quality inspection
  5. 2026Beyond Hazard Resemblance: Contrastive Event Adjudication for Training-Free Video Anomaly Detection
  6. 2025OSCAR: Object Status and Contextual Awareness for Recipes to Support Non-Visual Cooking
  7. 2025A Benchmark for Crime Surveillance Video Analysis with Large Models
  8. 2026Tiny but Trusted: Efficient Vision-Language Reasoning for Time-Series Anomaly Detection