mlsanityData to 7 Oct 2026

Multimodal Benchmark for Safety Assessment in Industrial Inspection Scenarios

arXiv 2601.21173 ↗First posted 29 Jan 2026cs.RO cs.CVcited by 1

Not on the map. Why?

Abstract (arXiv)

With the rapid development of industrial intelligence and unmanned inspection, reliable perception and safety assessment for AI systems in complex and dynamic industrial sites has become a key bottleneck for deploying predictive maintenance and autonomous inspection. Most public datasets remain limited by simulated data sources, single-modality sensing, or the absence of fine-grained object-level annotations, which prevents robust scene understanding and multimodal safety reasoning for industrial foundation models. To address these limitations, InspecSafe-V1 is released as the first multimodal benchmark dataset for industrial inspection safety assessment that is collected from routine operations of real inspection robots in real-world environments. InspecSafe-V1 covers five representative industrial scenarios, including tunnels, power facilities, sintering equipment, oil and gas petrochemical plants, and coal conveyor trestles. The dataset is constructed from 41 wheeled and rail-mounted inspection robots operating at 2,239 valid inspection sites, yielding 5,013 inspection instances. For each instance, pixel-level segmentation annotations are provided for key objects in visible-spectrum images. In addition, a semantic scene description and a corresponding safety level label are provided according to practical inspection tasks. Seven synchronized sensing modalities are further included, including infrared video, audio, depth point clouds, radar point clouds, gas measurements, temperature, and humidity, to support multimodal anomaly recognition, cross-modal fusion, and comprehensive safety assessment in industrial environments.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 23 of its 47 references that are in the map. First posted on arXiv 29 Jan 2026.

Builds on

23 of 47 references.

References · 23

  1. 2014Microsoft COCO: Common Objects in Contextcited by 17,498
  2. 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,485
  3. 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,088
  4. 2023InstructBLIP: Towards General-purpose Vision-Language Models with Instruction Tuningcited by 2,855
  5. 2016Visual Genome: Connecting Language and Vision Using Crowdsourced Dense Image Annotationscited by 2,646
  6. 2019Scalability in Perception for Autonomous Driving: Waymo Open Datasetcited by 2,436
  7. 2021Learning to Prompt for Vision-Language Modelscited by 2,269
  8. 2024M3-Embedding: Multi-Linguality, Multi-Functionality, Multi-Granularity Text Embeddings Through Self-Knowledge Distillationcited by 1,050
  9. 2018The Open Images Dataset V4: Unified image classification, object detection, and visual relationship detection at scalecited by 542
  10. 2022SPot-the-Difference Self-Supervised Pre-training for Anomaly Detection and Segmentationcited by 397
  11. 2024An Introduction to Vision-Language Modelingcited by 175
  12. 2021The MVTec 3D-AD Dataset for Unsupervised 3D Anomaly Detection and Localizationcited by 174
11 more
  1. 2024Real-IAD: A Real-World Multi-View Dataset for Benchmarking Versatile Industrial Anomaly Detectioncited by 138
  2. 2023Large Language Models for Robotics: A Surveycited by 132
  3. 2023Real3D-AD: A Dataset of Point Cloud Anomaly Detectioncited by 87
  4. 2017A Dataset for Developing and Benchmarking Active Visioncited by 50
  5. 2025VLSA: Vision-Language-Action Models with Plug-and-Play Safety Constraint Layercited by 32
  6. 2024ReplanVLM: Replanning Robotic Tasks with Visual Language Modelscited by 28
  7. 2025A Survey on Efficient Vision-Language Modelscited by 19
  8. 2025Real-IAD D3: A Real-World 2D/Pseudo-3D/3D Dataset for Industrial Anomaly Detectioncited by 12
  9. 2023Real-time Safety Assessment of Dynamic Systems in Non-stationary Environments: A Review of Methods and Techniquescited by 4
  10. 2024RoboMNIST: A Multimodal Dataset for Multi-Robot Activity Recognition Using WiFi Sensing, Video, and Audiocited by 3
  11. 2024Harnessing Smartphone Sensors for Enhanced Road Safety: A Comprehensive Dataset and Reviewcited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.