SAGE: A Visual Language Model for Anomaly Detection via Fact Enhancement and Entropy-aware Alignment
On the map: Multimodal LLMs / vision-language models → Chart understanding and anomaly detection
also in 1 more
Abstract (arXiv)
While Vision-Language Models (VLMs) have shown promising progress in general multimodal tasks, they often struggle in industrial anomaly detection and reasoning, particularly in delivering interpretable explanations and generalizing to unseen categories. This limitation stems from the inherently domain-specific nature of anomaly detection, which hinders the applicability of existing VLMs in industrial scenarios that require precise, structured, and context-aware analysis. To address these challenges, we propose SAGE, a VLM-based framework that enhances anomaly reasoning through Self-Guided Fact Enhancement (SFE) and Entropy-aware Direct Preference Optimization (E-DPO). SFE integrates domain-specific knowledge into visual reasoning via fact extraction and fusion, while E-DPO aligns model outputs with expert preferences using entropy-aware optimization. Additionally, we introduce AD-PL, a preference-optimized dataset tailored for industrial anomaly reasoning, consisting of 28,415 question-answering instances with expert-ranked responses. To evaluate anomaly reasoning models, we develop Multiscale Logical Evaluation (MLE), a quantitative framework analyzing model logic and consistency. SAGE demonstrates superior performance on industrial anomaly datasets under zero-shot and one-shot settings. The code, model and dataset are available at https://github.com/amoreZgx1n/SAGE.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Placed in Chart understanding and anomaly detection, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 31 of its 64 references that are in the map. First posted on arXiv 10 Jul 2025.
Builds on
31 of 64 references.
Closest ancestors · 2
Same direction, newest first
- 2025Towards Zero-Shot Anomaly Detection and Reasoning with Multimodal Large Language Models11 Feb
- 2023VadCLIP: Adapting Vision-Language Models for Weakly Supervised Video Anomaly Detection22 Aug
Other references · 29
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
- 2023Segment Anythingcited by 8,158
- 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
- 2020End-to-End Object Detection with Transformerscited by 7,384
- 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,304
- 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,534
- 2013Describing Textures in the Wildcited by 2,110
- 2021ViViT: A Video Vision Transformercited by 1,610
17 more
- 2020PaDiM: a Patch Distribution Modeling Framework for Anomaly Detection and Localizationcited by 591
- 2019Memorizing Normality to Detect Anomaly: Memory-augmented Deep Autoencoder for Unsupervised Anomaly Detectioncited by 560
- 2024DeepSeek-VL2: Mixture-of-Experts Vision-Language Models for Advanced Multimodal Understandingcited by 559
- 2021CutPaste: Self-Supervised Learning for Anomaly Detection and Localizationcited by 529
- 2022Anomaly Detection via Reverse Distillation from One-Class Embeddingcited by 419
- 2019Uninformed Students: Student-Teacher Anomaly Detection with Discriminative Latent Embeddingscited by 386
- 2020Sub-Image Anomaly Detection with Deep Pyramid Correspondencescited by 297
- 2023AnomalyCLIP: Object-agnostic Prompt Learning for Zero-shot Anomaly Detectioncited by 270
- 2020PANDA: Adapting Pretrained Features for Anomaly Detection and Segmentationcited by 175
- 2023Multimodal Industrial Anomaly Detection via Hybrid Fusioncited by 138
- 2023Towards Scalable 3D Anomaly Detection and Localization: A Benchmark via 3D Anomaly Synthesis and A Self-Supervised Learning Networkcited by 67
- 2021Towards General Purpose Vision Systemscited by 46
- 2024MANTA: A Large-Scale Multi-View and Visual-Text Anomaly Detection Dataset for Tiny Objectscited by 26
- 2021K-shot NAS: Learnable Weight-Sharing for NAS with K-shot Supernetscited by 22
- 2024Salvaging the Overlooked: Leveraging Class-Aware Contrastive Learning for Multi-Class Anomaly Detectioncited by 15
- 2023Learning to See Low-Light Images via Feature Domain Adaptationcited by 8
- 2025SIFT: Grounding LLM Reasoning in Contexts via Stickerscited by 6
Built on by
Citing papers per year: 2025: 1; 2026: 3.
4 papers.
- 2025GAOT: Generating Articulated Objects Through Text-Guided Diffusion Modelscited by 1
- 2026HMVLA: Hyperbolic Multimodal Fusion for Vision-Language-Action Modelscited by 1
- 2026MMR-AD: A Large-Scale Multimodal Dataset for Benchmarking General Anomaly Detection with Multimodal Large Language Modelscited by 1
- 2026FOCA: Frequency-Oriented Cross-Domain Forgery Detection, Localization and Explanation via Multi-Modal Large Language Modelcited by 0
- 2026MMR-AD: A Large-Scale Multimodal Dataset for Benchmarking General Anomaly Detection with Multimodal Large Language Models13 Apr 2026
- 2026FOCA: Frequency-Oriented Cross-Domain Forgery Detection, Localization and Explanation via Multi-Modal Large Language Model21 Feb 2026
- 2026HMVLA: Hyperbolic Multimodal Fusion for Vision-Language-Action Models28 Jan 2026
- 2025GAOT: Generating Articulated Objects Through Text-Guided Diffusion Models3 Dec 2025
Similar, not cited
Close in wording, no citation either way
- 2025IAD-R1: Reinforcing Consistent Reasoning in Industrial Anomaly Detection
- 2026Towards Explainable Industrial Anomaly Detection via Knowledge-Guided Latent Reasoning
- 2026JUDO: A Juxtaposed Domain-Oriented Multimodal Reasoner for Industrial Anomaly QA
- 2026InspectorGPT: A Comparative Reasoning Enhanced VLM for Comprehensive Industrial Anomaly Detection
- 2026Industrial Anomaly Detection via Defect-Grounded Reasoning in Visual Latent Space
- 2024Customizing Visual-Language Foundation Models for Multi-modal Anomaly Detection and Reasoning
- 2026EAGLE: Expert-Augmented Attention Guidance for Tuning-Free Industrial Anomaly Detection in Multimodal Large Language Models
- 2025ADSeeker: A Knowledge-Grounded Reasoning Framework for Industry Anomaly Detection and Reasoning