TED:Text-Axis Evidence Decomposition for Prompted Anomaly Localization
On the map: Multimodal LLMs / vision-language models → Chart understanding and anomaly detection
Abstract (arXiv)
CLIP is a powerful vision-language model, but it was not designed for fine-grained defect localization; CLIP-based anomaly detectors therefore adapt it with prompts or lightweight modules to increase defect sensitivity. We show that stronger sensitivity does not necessarily make local evidence reliable: under domain shift, adapted CLIP-AD models often assign high anomaly scores to both true defects and visually complex normal regions. The issue is not simply missing defect information, but a local scoring rule that decodes defect and hard-normal evidence, having the same anomaly evidence. We propose TED (Text-Axis Evidence Decomposition), a post-hoc scoring method that asks whether each ambiguous response is better supported by source defect patches or by source normal patches mistaken as anomalous. TED compares these supports under the host's normal-versus-anomaly text response, leaves the backbone and prompts unchanged, and requires no target-domain training. It works as a train-free score for raw VLM backbones or as a source-calibrated residual correction for adapted CLIP-AD hosts. Across frozen VLM backbones, TED substantially improves pixel-level localization over raw prompt similarity; across adapted hosts, it improves most pixel-level settings over P-AUROC, P-PRO, and P-AP. Gains are largest under stronger hard-FP competition, with mean localization gain increasing from +5.0 in low-competition regimes to about +10.9 in mid/high-competition regimes. These results suggest that recoverable defect evidence can already exist in pretrained multimodal representations, but reliable localization requires decoding it against hard-normal competitors. Code will be released at TED GitHub repository.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Chart understanding and anomaly detection, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 35 of its 41 references that are in the map. First posted on arXiv 30 Sep 2026.
Builds on
35 of 41 references.
Closest ancestors · 3
Same direction, newest first
- 2025AD-FM: Multimodal LLMs for Anomaly Detection via Multi-Stage Reasoning and Fine-Grained Reward Optimization6 Aug
- 2025Towards Zero-Shot Anomaly Detection and Reasoning with Multimodal Large Language Models11 Feb
- 2024MMAD: A Comprehensive Benchmark for Multimodal Large Language Models in Industrial Anomaly Detection12 Oct
Other references · 32
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2021Learning to Prompt for Vision-Language Modelscited by 2,281
- 2023ImageBind: One Embedding Space To Bind Them Allcited by 1,175
- 2023Vision-Language Models for Vision Tasks: A Surveycited by 839
- 2020PaDiM: a Patch Distribution Modeling Framework for Anomaly Detection and Localizationcited by 594
- 2021DRAEM -- A discriminatively trained reconstruction embedding for surface anomaly detectioncited by 514
- 2022Anomaly Detection via Reverse Distillation from One-Class Embeddingcited by 421
- 2022SPot-the-Difference Self-Supervised Pre-training for Anomaly Detection and Segmentationcited by 400
- 2019Uninformed Students: Student-Teacher Anomaly Detection with Discriminative Latent Embeddingscited by 386
- 2021CFLOW-AD: Real-Time Unsupervised Anomaly Detection with Localization via Conditional Normalizing Flowscited by 321
- 2023WinCLIP: Zero-/Few-Shot Anomaly Classification and Segmentationcited by 315
- 2020Sub-Image Anomaly Detection with Deep Pyramid Correspondencescited by 300
20 more
- 2021DeepViT: Towards Deeper Vision Transformercited by 289
- 2023AnomalyCLIP: Object-agnostic Prompt Learning for Zero-shot Anomaly Detectioncited by 271
- 2021FastFlow: Unsupervised Anomaly Detection and Localization via 2D Normalizing Flowscited by 227
- 2021VT-ADL: A Vision Transformer Network for Image Anomaly Detection and Localizationcited by 223
- 2023Deep Industrial Image Anomaly Detection: A Surveycited by 148
- 2024AdaCLIP: Adapting CLIP with Hybrid Learnable Prompts for Zero-Shot Anomaly Detectioncited by 127
- 2021Self-Supervised Predictive Convolutional Attentive Block for Anomaly Detectioncited by 119
- 2021Fully Convolutional Cross-Scale-Flows for Image-based Defect Detectioncited by 117
- 2024RealNet: A Feature Selection Network with Realistic Synthetic Anomaly for Anomaly Detectioncited by 116
- 2020Modeling the Distribution of Normal Data in Pre-Trained Deep Features for Anomaly Detectioncited by 115
- 2021Divide-and-Assemble: Learning Block-wise Memory for Unsupervised Anomaly Detectioncited by 83
- 2025AA-CLIP: Enhancing Zero-shot Anomaly Detection via Anomaly-Aware CLIPcited by 73
- 2025The MVTec AD 2 Dataset: Advanced Scenarios for Unsupervised Anomaly Detectioncited by 30
- 2025AdaptCLIP: Adapting CLIP for Universal Visual Anomaly Detectioncited by 29
- 2025AnomalyR1: A GRPO-based End-to-end MLLM for Industrial Anomaly Detectioncited by 28
- 2024Fine-grained Abnormality Prompt Learning for Zero-shot Anomaly Detectioncited by 22
- 2022A Survey on Unsupervised Anomaly Detection Algorithms for Industrial Imagescited by 21
- 2025OmniAD: Detect and Understand Industrial Anomaly via Multimodal Reasoningcited by 18
- 2025Continual-MEGA: A Large-scale Benchmark for Generalizable Continual Anomaly Detectioncited by 4
- 2025GenCLIP: Generalizing CLIP Prompts for Zero-shot Anomaly Detectioncited by 3
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Defect-aware Hybrid Prompt Optimization via Progressive Tuning for Zero-Shot Multi-type Anomaly Detection and Segmentation
- 2024Do LLMs Understand Visual Anomalies? Uncovering LLM's Capabilities in Zero-shot Anomaly Detection
- 2026TIPS Over Tricks: Simple Prompts for Effective Zero-shot Anomaly Detection
- 2026Proximity-CLIP: Text-Guided Semantic Proximity Learning for Zero-Shot Anomaly Detection
- 2024Dual-Image Enhanced CLIP for Zero-Shot Anomaly Detection
- 2026DevPrompt: Deviation-Based Prompt Learning for One-Normal ShotImage Anomaly Detection
- 2026Reasoning-Driven Anomaly Detection and Localization with Image-Level Supervision
- 2026VisualAD: Language-Free Zero-Shot Anomaly Detection via Vision Transformer