MCL-AD: Multimodal Collaboration Learning for Zero-Shot 3D Anomaly Detection
Not on the map. Why?
Abstract (arXiv)
Zero-shot 3D (ZS-3D) anomaly detection aims to identify defects in 3D objects without relying on labeled training data, making it especially valuable in scenarios constrained by data scarcity, privacy, or high annotation cost. However, most existing methods focus exclusively on point clouds, neglecting the rich semantic cues available from complementary modalities such as RGB images and texts priors. This paper introduces MCL-AD, a novel framework that leverages multimodal collaboration learning across point clouds, RGB images, and texts semantics to achieve superior zero-shot 3D anomaly detection. Specifically, we propose a Multimodal Prompt Learning Mechanism (MPLM) that enhances the intra-modal representation capability and inter-modal collaborative learning by introducing an object-agnostic decoupled text prompt and a multimodal contrastive loss. In addition, a collaborative modulation mechanism (CMM) is proposed to fully leverage the complementary representations of point clouds and RGB images by jointly modulating the RGB image-guided and point cloud-guided branches. Extensive experiments demonstrate that the proposed MCL-AD framework achieves state-of-the-art performance in ZS-3D anomaly detection.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 39 of its 46 references that are in the map. First posted on arXiv 12 Sep 2025.
Builds on
39 of 46 references.
References · 39
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2021Learning to Prompt for Vision-Language Modelscited by 2,281
- 2021Towards Total Recall in Industrial Anomaly Detectioncited by 776
- 2022MaPLe: Multi-modal Prompt Learningcited by 687
- 2022Masked Autoencoders for Point Cloud Self-supervised Learningcited by 459
- 2022Anomaly Detection via Reverse Distillation from One-Class Embeddingcited by 421
- 2019Uninformed Students: Student-Teacher Anomaly Detection with Discriminative Latent Embeddingscited by 386
- 2023WinCLIP: Zero-/Few-Shot Anomaly Classification and Segmentationcited by 315
- 2023AnomalyCLIP: Object-agnostic Prompt Learning for Zero-shot Anomaly Detectioncited by 271
- 2022A Unified Model for Multi-class Anomaly Detectioncited by 268
- 2023SimpleNet: A Simple Network for Image Anomaly Detection and Localizationcited by 256
- 2022PointCLIP V2: Prompting CLIP and GPT for Powerful 3D Open-world Learningcited by 187
27 more
- 2021The MVTec 3D-AD Dataset for Unsupervised 3D Anomaly Detection and Localizationcited by 178
- 2023AnomalyGPT: Detecting Industrial Anomalies Using Large Vision-Language Modelscited by 171
- 2023Multimodal Industrial Anomaly Detection via Hybrid Fusioncited by 139
- 2022Registration based Few-Shot Anomaly Detectioncited by 133
- 2023APRIL-GAN: A Zero-/Few-Shot Anomaly Classification and Segmentation Method for CVPR 2023 VAND Workshop Challenge Tracks 1&2: 1st Place on Zero-shot AD and 4th Place on Few-shot ADcited by 130
- 2020Explainable Deep One-Class Classificationcited by 127
- 2021Self-Supervised Predictive Convolutional Attentive Block for Anomaly Detectioncited by 119
- 2022Back to the Feature: Classical 3D Features are (Almost) All You Need for 3D Anomaly Detectioncited by 93
- 2022DSR -- A dual subspace re-projection network for surface anomaly detectioncited by 90
- 2023Pushing the Limits of Fewshot Anomaly Detection in Industry Vision: Graphcorecited by 75
- 2023Complementary Pseudo Multimodal Feature for Point Cloud Anomaly Detectioncited by 75
- 2021Explainable Deep Few-shot Anomaly Detection with Deviation Networkscited by 69
- 2024A Survey on Visual Anomaly Detection: Challenge, Approach, and Prospectcited by 69
- 2023Towards Scalable 3D Anomaly Detection and Localization: A Benchmark via 3D Anomaly Synthesis and A Self-Supervised Learning Networkcited by 67
- 2022Anomaly Detection in 3D Point Clouds using Deep Geometric Descriptorscited by 66
- 2022The Eyecandies Dataset for Unsupervised Multimodal Anomaly Detection and Localizationcited by 57
- 2022Prototypical Residual Networks for Anomaly Detection and Localizationcited by 56
- 2023EasyNet: An Easy Network for 3D Industrial Anomaly Detectioncited by 43
- 2023Multimodal Industrial Anomaly Detection by Crossmodal Feature Mappingcited by 42
- 2021Zero-Shot Learning on 3D Point Cloud Objects and Beyondcited by 38
- 2023Anomaly Detection under Distribution Shiftcited by 35
- 2023Cheating Depth: Enhancing 3D Surface Anomaly Detection via Depth Simulationcited by 33
- 2024PointAD: Comprehending 3D Anomalies from Points and Pixels for Zero-shot 3D Anomaly Detectioncited by 29
- 2021Self-supervised Pseudo Multi-class Pre-training for Unsupervised Anomaly Detection and Segmentation in Medical Imagescited by 23
- 2023Learning Global-Local Correspondence with Semantic Bottleneck for Logical Anomaly Detectioncited by 21
- 2023When and How Does Known Class Help Discover Unknown Ones? Provable Understanding Through Spectral Analysiscited by 21
- 2024Towards Zero-shot Point Cloud Anomaly Detection: A Multi-View Projection Frameworkcited by 15
Built on by
Citing papers per year: 2026: 2.
2 papers.