Towards Efficient Pixel Labeling for Industrial Anomaly Detection and Localization
Not on the map. Why?
Abstract (arXiv)
In the realm of practical Anomaly Detection (AD) tasks, manual labeling of anomalous pixels proves to be a costly endeavor. Consequently, many AD methods are crafted as one-class classifiers, tailored for training sets completely devoid of anomalies, ensuring a more cost-effective approach. While some pioneering work has demonstrated heightened AD accuracy by incorporating real anomaly samples in training, this enhancement comes at the price of labor-intensive labeling processes. This paper strikes the balance between AD accuracy and labeling expenses by introducing ADClick, a novel Interactive Image Segmentation (IIS) algorithm. ADClick efficiently generates "ground-truth" anomaly masks for real defective images, leveraging innovative residual features and meticulously crafted language prompts. Notably, ADClick showcases a significantly elevated generalization capacity compared to existing state-of-the-art IIS approaches. Functioning as an anomaly labeling tool, ADClick generates high-quality anomaly labels (AP = 94.1% on MVTec AD) based on only 3 to 5 manual click annotations per training image. Furthermore, we extend the capabilities of ADClick into ADClick-Seg, an enhanced model designed for anomaly detection and localization. By fine-tuning the ADClick-Seg model using the weak labels inferred by ADClick, we establish the state-of-the-art performances in supervised AD tasks (AP = 86.4% on MVTec AD and AP = 78.4%, PRO = 98.6% on KSDD2).
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 51 of its 70 references that are in the map. First posted on arXiv 3 Jul 2024.
Builds on
51 of 70 references.
References · 51
- 2017Attention Is All You Needcited by 59,932
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2014Microsoft COCO: Common Objects in Contextcited by 17,498
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
- 2023Segment Anythingcited by 8,158
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
- 2016Wide Residual Networkscited by 3,057
- 2019LVIS: A Dataset for Large Vocabulary Instance Segmentationcited by 1,215
- 2016Modeling Context in Referring Expressionscited by 1,054
- 2023Vision Transformers Need Registerscited by 844
- 2021Towards Total Recall in Industrial Anomaly Detectioncited by 772
38 more
- 2020PaDiM: a Patch Distribution Modeling Framework for Anomaly Detection and Localizationcited by 591
- 2021DRAEM -- A discriminatively trained reconstruction embedding for surface anomaly detectioncited by 510
- 2022Anomaly Detection via Reverse Distillation from One-Class Embeddingcited by 419
- 2021LAVT: Language-Aware Vision Transformer for Referring Image Segmentationcited by 347
- 2021CFLOW-AD: Real-Time Unsupervised Anomaly Detection with Localization via Conditional Normalizing Flowscited by 320
- 2023WinCLIP: Zero-/Few-Shot Anomaly Classification and Segmentationcited by 311
- 2022A Unified Model for Multi-class Anomaly Detectioncited by 267
- 2018Improving Unsupervised Defect Segmentation by Applying Structural Similarity to Autoencoderscited by 263
- 2023SimpleNet: A Simple Network for Image Anomaly Detection and Localizationcited by 256
- 2023AnomalyGPT: Detecting Industrial Anomalies Using Large Vision-Language Modelscited by 169
- 2016Deep Interactive Object Selectioncited by 160
- 2022DeSTSeg: Segmentation Guided Denoising Student-Teacher for Anomaly Detectioncited by 153
- 2023PolyFormer: Referring Image Segmentation as Sequential Polygon Generationcited by 147
- 2017Deep Extreme Cut: From Extreme Points to Object Segmentationcited by 127
- 2021Self-Supervised Predictive Convolutional Attentive Block for Anomaly Detectioncited by 119
- 2024MambaAD: Exploring State Space Models for Multi-class Unsupervised Anomaly Detectioncited by 113
- 2022VLT: Vision-Language Transformer and Query Generation for Referring Segmentationcited by 110
- 2022SimpleClick: Interactive Image Segmentation with Simple Vision Transformerscited by 109
- 2022Catching Both Gray and Black Swans: Open-set Supervised Anomaly Detectioncited by 104
- 2021Mixed supervision for surface-defect detection: from weakly to fully supervised learningcited by 101
- 2022FocalClick: Towards Practical Interactive Image Segmentationcited by 101
- 2019Indices Matter: Learning to Index for Deep Image Mattingcited by 93
- 2024Dinomaly: The Less Is More Philosophy in Multi-Class Unsupervised Anomaly Detectioncited by 92
- 2023PyramidFlow: High-Resolution Defect Contrastive Localization using Pyramid Normalizing Flowcited by 74
- 2022Explicit Boundary Guided Semi-Push-Pull Contrastive Learning for Supervised Anomaly Detectioncited by 72
- 2021Explainable Deep Few-shot Anomaly Detection with Deviation Networkscited by 69
- 2019AdaptIS: Adaptive Instance Selection Networkcited by 64
- 2023ReContrast: Domain-Specific Anomaly Detection via Contrastive Reconstructioncited by 62
- 2022Prototypical Residual Networks for Anomaly Detection and Localizationcited by 56
- 2023Collaborative Discrepancy Optimization for Reliable Image Anomaly Localizationcited by 56
- 2021EdgeFlow: Achieving Practical Interactive Segmentation with Edge-Guided Flowcited by 40
- 2023Target before Shooting: Accurate Anomaly Detection and Localization under One Millisecond via Cascade Patch Retrievalcited by 22
- 2023Focused and Collaborative Feedback Integration for Interactive Image Segmentationcited by 17
- 2023Random Word Data Augmentation with CLIP for Zero-Shot Anomaly Detectioncited by 15
- 2023Interactive Segmentation as Gaussian Process Classificationcited by 14
- 2021PEDENet: Image Anomaly Localization via Patch Embedding and Density Estimationcited by 11
- 2021Comprehensive Multi-Modal Interactions for Referring Image Segmentationcited by 9
- 2023A Prototype-Based Neural Network for Image Anomaly Detection and Localizationcited by 7
50 most cited of 51 All 51 (JSON)
Built on by
Not cited yet.