mlsanityData to 7 Oct 2026

INSIGHT: Indoor Scene Intelligence from Geometric-Semantic Hierarchy Transfer for Public~Safety

arXiv 2604.23095 ↗First posted 25 Apr 2026cs.CV cs.ETcited by 0

Not on the map. Why?

Abstract (arXiv)

Indoor environments lack the spatial intelligence infrastructure that GPS provides outdoors; first responders arriving at unfamiliar buildings typically have no machine-readable map of safety equipment. Prior work on 3D semantic segmentation for public safety identified two barriers: scarcity of labeled indoor training data and poor recognition of small safety-critical features by native point-cloud methods. This paper presents INSIGHT, a zero-target-domain-annotation pipeline that projects 2D image understanding into 3D metric space via registered RGB-D data. Two interchangeable vision stacks share a common 3D back end: a SAM3 foundation-model stack for text-prompted segmentation, and a traditional CV stack (open-set detection, VQA, OCR) whose intermediate outputs are independently inspectable. Evaluated on all seven subareas of Stanford 2D-3D-S (70,496 images), the pipeline produces Pointcept-schema-compatible labeled point clouds and ISO~19164-compliant scene graphs with ~104× compression; role-filtered payloads transmit in <15,s at 1,Mbps over FirstNet Band~14. We report per-point labeling accuracy on 7 shared classes, detection sensitivity for 15 safety-critical classes absent from public 3D benchmarks alongside code-capped deployable estimates, and inter-pipeline complementarity, demonstrating that 2D-to-3D semantic transfer addresses the labeled-data bottleneck while scene graphs provide building intelligence compact enough for field deployment.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 21 of its 46 references that are in the map. First posted on arXiv 25 Apr 2026.

Builds on

21 of 46 references.

References · 21

  1. 2023Segment Anythingcited by 8,158
  2. 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,310
  3. 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,088
  4. 2024SAM 2: Segment Anything in Images and Videoscited by 2,784
  5. 2020Point Transformercited by 1,462
  6. 2019KPConv: Flexible and Deformable Convolution for Point Cloudscited by 1,202
  7. 2025SAM 3: Segment Anything with Conceptscited by 835
  8. 2022OpenScene: 3D Scene Understanding with Open Vocabulariescited by 556
  9. 2017Joint 2D-3D-Semantic Data for Indoor Scene Understandingcited by 404
  10. 2023ConceptGraphs: Open-Vocabulary 3D Scene Graphs for Perception and Planningcited by 357
  11. 2023OpenMask3D: Open-Vocabulary 3D Instance Segmentationcited by 288
  12. 20193D Scene Graph: A Structure for Unified Semantics, 3D Space, and Cameracited by 280
9 more
  1. 2020Learning 3D Semantic Scene Graphs from 3D Indoor Reconstructionscited by 205
  2. 2022Stratified Transformer for 3D Point Cloud Segmentationcited by 166
  3. 2020PP-OCR: A Practical Ultra Lightweight OCR Systemcited by 147
  4. 2023Open3DIS: Open-Vocabulary 3D Instance Segmentation with 2D Mask Guidancecited by 123
  5. 2023Towards Large-scale 3D Representation Learning with Multi-dataset Point Prompt Trainingcited by 85
  6. 2023OVIR-3D: Open-Vocabulary 3D Instance Retrieval Without Training on 3D Datacited by 81
  7. 2023Segment3D: Learning Fine-Grained Class-Agnostic 3D Segmentation without Manual Labelscited by 64
  8. 2025Fire360: A Benchmark for Robust Perception and Episodic Memory in Degraded 360-Degree Firefighting Videoscited by 2
  9. 2025Cross-Dataset Semantic Segmentation Performance Analysis: Unifying NIST Point Cloud City Datasets for 3D Deep Learningcited by 1

Built on by

Not cited yet.