mlsanityData to 14 Oct 2026

SiM3D: Single-instance Multiview Multimodal and Multisetup 3D Anomaly Detection Benchmark

arXiv 2506.21549 ↗First posted 26 Jun 2025cs.CVcited by 5

Not on the map. Why?

Abstract (arXiv)

We propose SiM3D, the first benchmark considering the integration of multiview and multimodal information for comprehensive 3D anomaly detection and segmentation (ADS), where the task is to produce a voxel-based Anomaly Volume. Moreover, SiM3D focuses on a scenario of high interest in manufacturing: single-instance anomaly detection, where only one object, either real or synthetic, is available for training. In this respect, SiM3D stands out as the first ADS benchmark that addresses the challenge of generalising from synthetic training data to real test data. SiM3D includes a novel multimodal multiview dataset acquired using top-tier industrial sensors and robots. The dataset features multiview high-resolution images (12 Mpx) and point clouds (7M points) for 333 instances of eight types of objects, alongside a CAD model for each type. We also provide manually annotated 3D segmentation GTs for anomalous test samples. To establish reference baselines for the proposed multiview 3D ADS task, we adapt prominent singleview methods and assess their performance using novel metrics that operate on Anomaly Volumes.

Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Builds on 35 of its 47 references that are in the map. First posted on arXiv 26 Jun 2025.

Builds on

35 of 47 references.

References · 35

  1. 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,403
  2. 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
  3. 2016Wide Residual Networkscited by 3,070
  4. 2020PaDiM: a Patch Distribution Modeling Framework for Anomaly Detection and Localizationcited by 594
  5. 2021CutPaste: Self-Supervised Learning for Anomaly Detection and Localizationcited by 531
  6. 2021DRAEM -- A discriminatively trained reconstruction embedding for surface anomaly detectioncited by 514
  7. 2022Masked Autoencoders for Point Cloud Self-supervised Learningcited by 459
  8. 2022SPot-the-Difference Self-Supervised Pre-training for Anomaly Detection and Segmentationcited by 400
  9. 2021CFLOW-AD: Real-Time Unsupervised Anomaly Detection with Localization via Conditional Normalizing Flowscited by 321
  10. 2020Sub-Image Anomaly Detection with Deep Pyramid Correspondencescited by 300
  11. 2018Improving Unsupervised Defect Segmentation by Applying Structural Similarity to Autoencoderscited by 264
  12. 2021FastFlow: Unsupervised Anomaly Detection and Localization via 2D Normalizing Flowscited by 227
23 more
  1. 2020Patch SVDD: Patch-level SVDD for Anomaly Detection and Segmentationcited by 212
  2. 2020Same Same But DifferNet: Semi-Supervised Defect Detection with Normalizing Flowscited by 212
  3. 2021The MVTec 3D-AD Dataset for Unsupervised 3D Anomaly Detection and Localizationcited by 178
  4. 2020PANDA: Adapting Pretrained Features for Anomaly Detection and Segmentationcited by 175
  5. 2023EfficientAD: Accurate Visual Anomaly Detection at Millisecond-Level Latenciescited by 160
  6. 2023Deep Industrial Image Anomaly Detection: A Surveycited by 148
  7. 2023Multimodal Industrial Anomaly Detection via Hybrid Fusioncited by 139
  8. 2024Real-IAD: A Real-World Multi-View Dataset for Benchmarking Versatile Industrial Anomaly Detectioncited by 139
  9. 2020Learning and Evaluating Representations for Deep One-class Classificationcited by 133
  10. 2021Self-Supervised Predictive Convolutional Attentive Block for Anomaly Detectioncited by 119
  11. 2022Asymmetric Student-Teacher Networks for Industrial Anomaly Detectioncited by 117
  12. 2020Modeling the Distribution of Normal Data in Pre-Trained Deep Features for Anomaly Detectioncited by 115
  13. 2020Deep Nearest Neighbor Anomaly Detectioncited by 104
  14. 2022Back to the Feature: Classical 3D Features are (Almost) All You Need for 3D Anomaly Detectioncited by 93
  15. 2021Inpainting Transformer for Anomaly Detectioncited by 91
  16. 2023Real3D-AD: A Dataset of Point Cloud Anomaly Detectioncited by 87
  17. 2021Divide-and-Assemble: Learning Block-wise Memory for Unsupervised Anomaly Detectioncited by 83
  18. 2022MemSeg: A semi-supervised method for image surface defect detection using differences and commonalitiescited by 68
  19. 2022The Eyecandies Dataset for Unsupervised Multimodal Anomaly Detection and Localizationcited by 57
  20. 2023PAD: A Dataset and Benchmark for Pose-agnostic Anomaly Detectioncited by 46
  21. 2023Multimodal Industrial Anomaly Detection by Crossmodal Feature Mappingcited by 42
  22. 2020MOCCA: Multi-Layer One-Class ClassificAtion for Anomaly Detectioncited by 31
  23. 2024Test Time Training for Industrial Anomaly Segmentationcited by 4

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 4.

5 papers.

  1. 2025Physic-HM: Restoring Physical Generative Logic in Multimodal Anomaly Detection via Hierarchical Modulationcited by 0
  2. 2026Open-Set Supervised 3D Anomaly Detection: An Industrial Dataset and a Generalisable Framework for Unknown Defectscited by 0
  3. 2026Modulate-and-Map: Crossmodal Feature Mapping with Cross-View Modulation for 3D Anomaly Detectioncited by 0
  4. 2026SGANet: Semantic and Geometric Alignment for Multimodal Multi-view Anomaly Detectioncited by 0
  5. 2026Towards Active Real-to-Twin Inspection: A New Paradigm for Zero-Shot Anomaly Detectioncited by 0