mlsanityData to 7 Oct 2026

SAGE: A Visual Language Model for Anomaly Detection via Fact Enhancement and Entropy-aware Alignment

arXiv 2507.07939 ↗First posted 10 Jul 2025cs.CLcited by 4

On the map: Multimodal LLMs / vision-language models → Chart understanding and anomaly detection

also in 1 more
Abstract (arXiv)

While Vision-Language Models (VLMs) have shown promising progress in general multimodal tasks, they often struggle in industrial anomaly detection and reasoning, particularly in delivering interpretable explanations and generalizing to unseen categories. This limitation stems from the inherently domain-specific nature of anomaly detection, which hinders the applicability of existing VLMs in industrial scenarios that require precise, structured, and context-aware analysis. To address these challenges, we propose SAGE, a VLM-based framework that enhances anomaly reasoning through Self-Guided Fact Enhancement (SFE) and Entropy-aware Direct Preference Optimization (E-DPO). SFE integrates domain-specific knowledge into visual reasoning via fact extraction and fusion, while E-DPO aligns model outputs with expert preferences using entropy-aware optimization. Additionally, we introduce AD-PL, a preference-optimized dataset tailored for industrial anomaly reasoning, consisting of 28,415 question-answering instances with expert-ranked responses. To evaluate anomaly reasoning models, we develop Multiscale Logical Evaluation (MLE), a quantitative framework analyzing model logic and consistency. SAGE demonstrates superior performance on industrial anomaly datasets under zero-shot and one-shot settings. The code, model and dataset are available at https://github.com/amoreZgx1n/SAGE.

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Placed in Chart understanding and anomaly detection, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 31 of its 64 references that are in the map. First posted on arXiv 10 Jul 2025.

Builds on

31 of 64 references.

Closest ancestors · 2

Same direction, newest first

  1. 2025Towards Zero-Shot Anomaly Detection and Reasoning with Multimodal Large Language Models11 Feb
  2. 2023VadCLIP: Adapting Vision-Language Models for Weakly Supervised Video Anomaly Detection22 Aug

Other references · 29

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  3. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
  4. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
  5. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
  6. 2023Segment Anythingcited by 8,158
  7. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
  8. 2020End-to-End Object Detection with Transformerscited by 7,384
  9. 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,304
  10. 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,534
  11. 2013Describing Textures in the Wildcited by 2,110
  12. 2021ViViT: A Video Vision Transformercited by 1,610
17 more
  1. 2020PaDiM: a Patch Distribution Modeling Framework for Anomaly Detection and Localizationcited by 591
  2. 2019Memorizing Normality to Detect Anomaly: Memory-augmented Deep Autoencoder for Unsupervised Anomaly Detectioncited by 560
  3. 2024DeepSeek-VL2: Mixture-of-Experts Vision-Language Models for Advanced Multimodal Understandingcited by 559
  4. 2021CutPaste: Self-Supervised Learning for Anomaly Detection and Localizationcited by 529
  5. 2022Anomaly Detection via Reverse Distillation from One-Class Embeddingcited by 419
  6. 2019Uninformed Students: Student-Teacher Anomaly Detection with Discriminative Latent Embeddingscited by 386
  7. 2020Sub-Image Anomaly Detection with Deep Pyramid Correspondencescited by 297
  8. 2023AnomalyCLIP: Object-agnostic Prompt Learning for Zero-shot Anomaly Detectioncited by 270
  9. 2020PANDA: Adapting Pretrained Features for Anomaly Detection and Segmentationcited by 175
  10. 2023Multimodal Industrial Anomaly Detection via Hybrid Fusioncited by 138
  11. 2023Towards Scalable 3D Anomaly Detection and Localization: A Benchmark via 3D Anomaly Synthesis and A Self-Supervised Learning Networkcited by 67
  12. 2021Towards General Purpose Vision Systemscited by 46
  13. 2024MANTA: A Large-Scale Multi-View and Visual-Text Anomaly Detection Dataset for Tiny Objectscited by 26
  14. 2021K-shot NAS: Learnable Weight-Sharing for NAS with K-shot Supernetscited by 22
  15. 2024Salvaging the Overlooked: Leveraging Class-Aware Contrastive Learning for Multi-Class Anomaly Detectioncited by 15
  16. 2023Learning to See Low-Light Images via Feature Domain Adaptationcited by 8
  17. 2025SIFT: Grounding LLM Reasoning in Contexts via Stickerscited by 6

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 1; 2026: 3.

4 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025IAD-R1: Reinforcing Consistent Reasoning in Industrial Anomaly Detection
  2. 2026Towards Explainable Industrial Anomaly Detection via Knowledge-Guided Latent Reasoning
  3. 2026JUDO: A Juxtaposed Domain-Oriented Multimodal Reasoner for Industrial Anomaly QA
  4. 2026InspectorGPT: A Comparative Reasoning Enhanced VLM for Comprehensive Industrial Anomaly Detection
  5. 2026Industrial Anomaly Detection via Defect-Grounded Reasoning in Visual Latent Space
  6. 2024Customizing Visual-Language Foundation Models for Multi-modal Anomaly Detection and Reasoning
  7. 2026EAGLE: Expert-Augmented Attention Guidance for Tuning-Free Industrial Anomaly Detection in Multimodal Large Language Models
  8. 2025ADSeeker: A Knowledge-Grounded Reasoning Framework for Industry Anomaly Detection and Reasoning