INSIGHT: Indoor Scene Intelligence from Geometric-Semantic Hierarchy Transfer for Public~Safety
Not on the map. Why?
Abstract (arXiv)
Indoor environments lack the spatial intelligence infrastructure that GPS provides outdoors; first responders arriving at unfamiliar buildings typically have no machine-readable map of safety equipment. Prior work on 3D semantic segmentation for public safety identified two barriers: scarcity of labeled indoor training data and poor recognition of small safety-critical features by native point-cloud methods. This paper presents INSIGHT, a zero-target-domain-annotation pipeline that projects 2D image understanding into 3D metric space via registered RGB-D data. Two interchangeable vision stacks share a common 3D back end: a SAM3 foundation-model stack for text-prompted segmentation, and a traditional CV stack (open-set detection, VQA, OCR) whose intermediate outputs are independently inspectable. Evaluated on all seven subareas of Stanford 2D-3D-S (70,496 images), the pipeline produces Pointcept-schema-compatible labeled point clouds and ISO~19164-compliant scene graphs with ~104× compression; role-filtered payloads transmit in <15,s at 1,Mbps over FirstNet Band~14. We report per-point labeling accuracy on 7 shared classes, detection sensitivity for 15 safety-critical classes absent from public 3D benchmarks alongside code-capped deployable estimates, and inter-pipeline complementarity, demonstrating that 2D-to-3D semantic transfer addresses the labeled-data bottleneck while scene graphs provide building intelligence compact enough for field deployment.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 21 of its 46 references that are in the map. First posted on arXiv 25 Apr 2026.
Builds on
21 of 46 references.
References · 21
- 2023Segment Anythingcited by 8,158
- 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,310
- 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,088
- 2024SAM 2: Segment Anything in Images and Videoscited by 2,784
- 2020Point Transformercited by 1,462
- 2019KPConv: Flexible and Deformable Convolution for Point Cloudscited by 1,202
- 2025SAM 3: Segment Anything with Conceptscited by 835
- 2022OpenScene: 3D Scene Understanding with Open Vocabulariescited by 556
- 2017Joint 2D-3D-Semantic Data for Indoor Scene Understandingcited by 404
- 2023ConceptGraphs: Open-Vocabulary 3D Scene Graphs for Perception and Planningcited by 357
- 2023OpenMask3D: Open-Vocabulary 3D Instance Segmentationcited by 288
- 20193D Scene Graph: A Structure for Unified Semantics, 3D Space, and Cameracited by 280
9 more
- 2020Learning 3D Semantic Scene Graphs from 3D Indoor Reconstructionscited by 205
- 2022Stratified Transformer for 3D Point Cloud Segmentationcited by 166
- 2020PP-OCR: A Practical Ultra Lightweight OCR Systemcited by 147
- 2023Open3DIS: Open-Vocabulary 3D Instance Segmentation with 2D Mask Guidancecited by 123
- 2023Towards Large-scale 3D Representation Learning with Multi-dataset Point Prompt Trainingcited by 85
- 2023OVIR-3D: Open-Vocabulary 3D Instance Retrieval Without Training on 3D Datacited by 81
- 2023Segment3D: Learning Fine-Grained Class-Agnostic 3D Segmentation without Manual Labelscited by 64
- 2025Fire360: A Benchmark for Robust Perception and Episodic Memory in Degraded 360-Degree Firefighting Videoscited by 2
- 2025Cross-Dataset Semantic Segmentation Performance Analysis: Unifying NIST Point Cloud City Datasets for 3D Deep Learningcited by 1
Built on by
Not cited yet.