Back to Point: Exploring Point-Language Models for Zero-Shot 3D Anomaly Detection
Not on the map. Why?
Abstract (arXiv)
Zero-shot (ZS) 3D anomaly detection is crucial for reliable industrial inspection, as it enables detecting and localizing defects without requiring any target-category training data. Existing approaches render 3D point clouds into 2D images and leverage pre-trained Vision-Language Models (VLMs) for anomaly detection. However, such strategies inevitably discard geometric details and exhibit limited sensitivity to local anomalies. In this paper, we revisit intrinsic 3D representations and explore the potential of pre-trained Point-Language Models (PLMs) for ZS 3D anomaly detection. We propose BTP (Back To Point), a novel framework that effectively aligns 3D point cloud and textual embeddings. Specifically, BTP aligns multi-granularity patch features with textual representations for localized anomaly detection, while incorporating geometric descriptors to enhance sensitivity to structural anomalies. Furthermore, we introduce a joint representation learning strategy that leverages auxiliary point cloud data to improve robustness and enrich anomaly semantics. Extensive experiments on Real3D-AD and Anomaly-ShapeNet demonstrate that BTP achieves superior performance in ZS 3D anomaly detection. Code will be available at hrefhttps://github.com/wistful-8029/BTP-3DADhttps://github.com/wistful-8029/BTP-3DAD.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 37 of its 59 references that are in the map. First posted on arXiv 23 Mar 2026.
Builds on
37 of 59 references.
References · 37
- 2017Attention Is All You Needcited by 59,932
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,223
- 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,384
- 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,880
- 2018Dynamic Graph CNN for Learning on Point Cloudscited by 2,220
- 2021Towards Total Recall in Industrial Anomaly Detectioncited by 772
- 2021Point-BERT: Pre-training 3D Point Cloud Transformers with Masked Point Modelingcited by 647
- 2019Deep Learning for 3D Point Clouds: A Surveycited by 557
- 2023WinCLIP: Zero-/Few-Shot Anomaly Classification and Segmentationcited by 311
- 2023AnomalyCLIP: Object-agnostic Prompt Learning for Zero-shot Anomaly Detectioncited by 270
25 more
- 2022A Unified Model for Multi-class Anomaly Detectioncited by 267
- 2022ULIP: Learning a Unified Representation of Language, Images, and Point Clouds for 3D Understandingcited by 262
- 2022Delving into Out-of-Distribution Detection with Vision-Language Representationscited by 215
- 2023ULIP-2: Towards Scalable Multimodal Pre-training for 3D Understandingcited by 199
- 2023OpenShape: Scaling Up 3D Shape Representation Towards Open-World Understandingcited by 183
- 2023Multimodal Industrial Anomaly Detection via Hybrid Fusioncited by 138
- 2024AdaCLIP: Adapting CLIP with Hybrid Learnable Prompts for Zero-Shot Anomaly Detectioncited by 126
- 2022Back to the Feature: Classical 3D Features are (Almost) All You Need for 3D Anomaly Detectioncited by 92
- 2023Real3D-AD: A Dataset of Point Cloud Anomaly Detectioncited by 87
- 2023Complementary Pseudo Multimodal Feature for Point Cloud Anomaly Detectioncited by 74
- 2025AA-CLIP: Enhancing Zero-shot Anomaly Detection via Anomaly-Aware CLIPcited by 72
- 2023Towards Scalable 3D Anomaly Detection and Localization: A Benchmark via 3D Anomaly Synthesis and A Self-Supervised Learning Networkcited by 67
- 2023Segment Any Anomaly without Training via Hybrid Prompt Regularizationcited by 59
- 2025Towards Zero-Shot Anomaly Detection and Reasoning with Multimodal Large Language Modelscited by 54
- 2024R3D-AD: Reconstruction via Diffusion for 3D Anomaly Detectioncited by 45
- 2023EasyNet: An Easy Network for 3D Industrial Anomaly Detectioncited by 43
- 2025Bayesian Prompt Flow Learning for Zero-Shot Anomaly Detectioncited by 31
- 2024PO3AD: Predicting Point Offsets toward Better 3D Point Cloud Anomaly Detectioncited by 30
- 2024PointAD: Comprehending 3D Anomalies from Points and Pixels for Zero-shot 3D Anomaly Detectioncited by 29
- 2024Multi-Sensor Object Anomaly Detection: Unifying Appearance, Geometry, and Internal Propertiescited by 26
- 2025Real-IAD D3: A Real-World 2D/Pseudo-3D/3D Dataset for Industrial Anomaly Detectioncited by 12
- 2024Towards Zero-shot 3D Anomaly Localizationcited by 8
- 2026Distilled Large Language Model-Driven Dynamic Sparse Expert Activation Mechanismcited by 7
- 2025Exploiting Point-Language Models with Dual-Prompts for 3D Anomaly Detectioncited by 4
- 2025MCL-AD: Multimodal Collaboration Learning for Zero-Shot 3D Anomaly Detectioncited by 2
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2024Towards Zero-shot Point Cloud Anomaly Detection: A Multi-View Projection Framework
- 2026Synthesis4AD: Synthetic Anomalies are All You Need for 3D Anomaly Detection
- 2026Towards Generalizable 3D Anomaly Detection via Relational Inconsistency Modeling
- 2026Two Steps Are All You Need: Efficient 3D Point Cloud Anomaly Detection with Consistency Models
- 2026ZSG-IAD: A Multimodal Framework for Zero-Shot Grounded Industrial Anomaly Detection
- 2026TIPS Over Tricks: Simple Prompts for Effective Zero-shot Anomaly Detection
- 2024FADE: Few-shot/zero-shot Anomaly Detection Engine using Large Vision-Language Model
- 2024VMAD: Visual-enhanced Multimodal Large Language Model for Zero-Shot Anomaly Detection