ViP2-CLIP: Visual-Perception Prompting with Unified Alignment for Zero-Shot Anomaly Detection
Not on the map. Why?
Abstract (arXiv)
Zero-shot anomaly detection (ZSAD) aims to detect anomalies without any target domain training samples, relying solely on external auxiliary data. Existing CLIP-based methods attempt to activate the model's ZSAD potential via handcrafted or static learnable prompts. The former incur high engineering costs and limited semantic coverage, whereas the latter apply identical descriptions across diverse anomaly types, thus fail to adapt to complex variations. Furthermore, since CLIP is originally pretrained on large-scale classification tasks, its anomaly segmentation quality is highly sensitive to the exact wording of class names, severely constraining prompting strategies that depend on class labels. To address these challenges, we introduce ViP2-CLIP. The key insight of ViP2-CLIP is a Visual-Perception Prompting (ViP-Prompt) mechanism, which fuses global and multi-scale local visual context to adaptively generate fine-grained textual prompts, eliminating manual templates and class-name priors. This design enables our model to focus on precise abnormal regions, making it particularly valuable when category labels are ambiguous or privacy-constrained. Extensive experiments on 15 industrial and medical benchmarks demonstrate that ViP2-CLIP achieves state-of-the-art performance and robust cross-domain generalization.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 28 of its 40 references that are in the map. First posted on arXiv 23 May 2025.
Builds on
28 of 40 references.
References · 28
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2022Training language models to follow instructions with human feedbackcited by 15,971
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
- 2022Conditional Prompt Learning for Vision-Language Modelscited by 1,433
- 2021Towards Total Recall in Industrial Anomaly Detectioncited by 776
- 2022MaPLe: Multi-modal Prompt Learningcited by 687
- 2019Kvasir-SEG: A Segmented Polyp Datasetcited by 589
- 2017Skin Lesion Analysis Toward Melanoma Detection: A Challenge at the 2017 International Symposium on Biomedical Imaging (ISBI), Hosted by the International Skin Imaging Collaboration (ISIC)cited by 549
- 2021DenseCLIP: Language-Guided Dense Prediction with Context-Aware Promptingcited by 532
- 2022Anomaly Detection via Reverse Distillation from One-Class Embeddingcited by 421
- 2022SPot-the-Difference Self-Supervised Pre-training for Anomaly Detection and Segmentationcited by 400
- 2023WinCLIP: Zero-/Few-Shot Anomaly Classification and Segmentationcited by 315
16 more
- 2023Visual-Language Prompt Tuning with Knowledge-guided Context Optimizationcited by 308
- 2020Multiresolution Knowledge Distillation for Anomaly Detectioncited by 285
- 2023Self-regulating Prompts: Foundational Model Adaptation without Forgettingcited by 272
- 2023AnomalyCLIP: Object-agnostic Prompt Learning for Zero-shot Anomaly Detectioncited by 271
- 2021VT-ADL: A Vision Transformer Network for Image Anomaly Detection and Localizationcited by 223
- 2019Dice Loss for Data-imbalanced NLP Taskscited by 182
- 2019Segmentation-Based Deep-Learning Approach for Surface-Defect Detectioncited by 145
- 2023APRIL-GAN: A Zero-/Few-Shot Anomaly Classification and Segmentation Method for CVPR 2023 VAND Workshop Challenge Tracks 1&2: 1st Place on Zero-shot AD and 4th Place on Few-shot ADcited by 130
- 2024AdaCLIP: Adapting CLIP with Hybrid Learnable Prompts for Zero-Shot Anomaly Detectioncited by 127
- 2023TCP:Textual-based Class-aware Prompt tuning for Visual-Language Modelcited by 76
- 2025AA-CLIP: Enhancing Zero-shot Anomaly Detection via Anomaly-Aware CLIPcited by 73
- 2023CLIP-AD: A Language-Guided Staged Dual-Path Model for Zero-shot Anomaly Detectioncited by 58
- 2024FiLo: Zero-Shot Anomaly Detection by Fine-Grained Description and High-Quality Localizationcited by 51
- 2024VCP-CLIP: A visual context prompting model for zero-shot anomaly segmentationcited by 50
- 2025MMRL: Multi-Modal Representation Learning for Vision-Language Modelscited by 39
- 2025KAnoCLIP: Zero-Shot Anomaly Detection through Knowledge-Driven Prompt Learning and Enhanced Cross-Modal Integrationcited by 7
Built on by
Not cited yet.