mlsanityData to 7 Oct 2026

Towards Efficient Pixel Labeling for Industrial Anomaly Detection and Localization

arXiv 2407.03130 ↗First posted 3 Jul 2024cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

In the realm of practical Anomaly Detection (AD) tasks, manual labeling of anomalous pixels proves to be a costly endeavor. Consequently, many AD methods are crafted as one-class classifiers, tailored for training sets completely devoid of anomalies, ensuring a more cost-effective approach. While some pioneering work has demonstrated heightened AD accuracy by incorporating real anomaly samples in training, this enhancement comes at the price of labor-intensive labeling processes. This paper strikes the balance between AD accuracy and labeling expenses by introducing ADClick, a novel Interactive Image Segmentation (IIS) algorithm. ADClick efficiently generates "ground-truth" anomaly masks for real defective images, leveraging innovative residual features and meticulously crafted language prompts. Notably, ADClick showcases a significantly elevated generalization capacity compared to existing state-of-the-art IIS approaches. Functioning as an anomaly labeling tool, ADClick generates high-quality anomaly labels (AP = 94.1% on MVTec AD) based on only 3 to 5 manual click annotations per training image. Furthermore, we extend the capabilities of ADClick into ADClick-Seg, an enhanced model designed for anomaly detection and localization. By fine-tuning the ADClick-Seg model using the weak labels inferred by ADClick, we establish the state-of-the-art performances in supervised AD tasks (AP = 86.4% on MVTec AD and AP = 78.4%, PRO = 98.6% on KSDD2).

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 51 of its 70 references that are in the map. First posted on arXiv 3 Jul 2024.

Builds on

51 of 70 references.

References · 51

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  4. 2014Microsoft COCO: Common Objects in Contextcited by 17,498
  5. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
  6. 2023Segment Anythingcited by 8,158
  7. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
  8. 2016Wide Residual Networkscited by 3,057
  9. 2019LVIS: A Dataset for Large Vocabulary Instance Segmentationcited by 1,215
  10. 2016Modeling Context in Referring Expressionscited by 1,054
  11. 2023Vision Transformers Need Registerscited by 844
  12. 2021Towards Total Recall in Industrial Anomaly Detectioncited by 772
38 more
  1. 2020PaDiM: a Patch Distribution Modeling Framework for Anomaly Detection and Localizationcited by 591
  2. 2021DRAEM -- A discriminatively trained reconstruction embedding for surface anomaly detectioncited by 510
  3. 2022Anomaly Detection via Reverse Distillation from One-Class Embeddingcited by 419
  4. 2021LAVT: Language-Aware Vision Transformer for Referring Image Segmentationcited by 347
  5. 2021CFLOW-AD: Real-Time Unsupervised Anomaly Detection with Localization via Conditional Normalizing Flowscited by 320
  6. 2023WinCLIP: Zero-/Few-Shot Anomaly Classification and Segmentationcited by 311
  7. 2022A Unified Model for Multi-class Anomaly Detectioncited by 267
  8. 2018Improving Unsupervised Defect Segmentation by Applying Structural Similarity to Autoencoderscited by 263
  9. 2023SimpleNet: A Simple Network for Image Anomaly Detection and Localizationcited by 256
  10. 2023AnomalyGPT: Detecting Industrial Anomalies Using Large Vision-Language Modelscited by 169
  11. 2016Deep Interactive Object Selectioncited by 160
  12. 2022DeSTSeg: Segmentation Guided Denoising Student-Teacher for Anomaly Detectioncited by 153
  13. 2023PolyFormer: Referring Image Segmentation as Sequential Polygon Generationcited by 147
  14. 2017Deep Extreme Cut: From Extreme Points to Object Segmentationcited by 127
  15. 2021Self-Supervised Predictive Convolutional Attentive Block for Anomaly Detectioncited by 119
  16. 2024MambaAD: Exploring State Space Models for Multi-class Unsupervised Anomaly Detectioncited by 113
  17. 2022VLT: Vision-Language Transformer and Query Generation for Referring Segmentationcited by 110
  18. 2022SimpleClick: Interactive Image Segmentation with Simple Vision Transformerscited by 109
  19. 2022Catching Both Gray and Black Swans: Open-set Supervised Anomaly Detectioncited by 104
  20. 2021Mixed supervision for surface-defect detection: from weakly to fully supervised learningcited by 101
  21. 2022FocalClick: Towards Practical Interactive Image Segmentationcited by 101
  22. 2019Indices Matter: Learning to Index for Deep Image Mattingcited by 93
  23. 2024Dinomaly: The Less Is More Philosophy in Multi-Class Unsupervised Anomaly Detectioncited by 92
  24. 2023PyramidFlow: High-Resolution Defect Contrastive Localization using Pyramid Normalizing Flowcited by 74
  25. 2022Explicit Boundary Guided Semi-Push-Pull Contrastive Learning for Supervised Anomaly Detectioncited by 72
  26. 2021Explainable Deep Few-shot Anomaly Detection with Deviation Networkscited by 69
  27. 2019AdaptIS: Adaptive Instance Selection Networkcited by 64
  28. 2023ReContrast: Domain-Specific Anomaly Detection via Contrastive Reconstructioncited by 62
  29. 2022Prototypical Residual Networks for Anomaly Detection and Localizationcited by 56
  30. 2023Collaborative Discrepancy Optimization for Reliable Image Anomaly Localizationcited by 56
  31. 2021EdgeFlow: Achieving Practical Interactive Segmentation with Edge-Guided Flowcited by 40
  32. 2023Target before Shooting: Accurate Anomaly Detection and Localization under One Millisecond via Cascade Patch Retrievalcited by 22
  33. 2023Focused and Collaborative Feedback Integration for Interactive Image Segmentationcited by 17
  34. 2023Random Word Data Augmentation with CLIP for Zero-Shot Anomaly Detectioncited by 15
  35. 2023Interactive Segmentation as Gaussian Process Classificationcited by 14
  36. 2021PEDENet: Image Anomaly Localization via Patch Embedding and Density Estimationcited by 11
  37. 2021Comprehensive Multi-Modal Interactions for Referring Image Segmentationcited by 9
  38. 2023A Prototype-Based Neural Network for Image Anomaly Detection and Localizationcited by 7

50 most cited of 51 All 51 (JSON)

Built on by

Not cited yet.