mlsanityData to 14 Oct 2026

Robotic Fire Risk Detection based on Dynamic Knowledge Graph Reasoning: An LLM-Driven Approach with Graph Chain-of-Thought

arXiv 2509.00054 ↗First posted 25 Aug 2025cs.RO cs.AIcited by 0

On the map: LLM reasoning → Spatial and embodied reasoning

Abstract (arXiv)

Fire is a highly destructive disaster, but effective prevention can significantly reduce its likelihood of occurrence. When it happens, deploying emergency robots in fire-risk scenarios can help minimize the danger to human responders. However, current research on pre-disaster warnings and disaster-time rescue still faces significant challenges due to incomplete perception, inadequate fire situational awareness, and delayed response. To enhance intelligent perception and response planning for robots in fire scenarios, we first construct a knowledge graph (KG) by leveraging large language models (LLMs) to integrate fire domain knowledge derived from fire prevention guidelines and fire rescue task information from robotic emergency response documents. We then propose a new framework called Insights-on-Graph (IOG), which integrates the structured fire information of KG and Large Multimodal Models (LMMs). The framework generates perception-driven risk graphs from real-time scene imagery to enable early fire risk detection and provide interpretable emergency responses for task module and robot component configuration based on the evolving risk situation. Extensive simulations and real-world experiments show that IOG has good applicability and practical application value in fire risk detection and rescue decision-making.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Spatial and embodied reasoning, one of 17 directions in LLM reasoning. Builds on 21 of its 51 references that are in the map. First posted on arXiv 25 Aug 2025.

Builds on

21 of 51 references.

References · 21

  1. 2022Training language models to follow instructions with human feedbackcited by 15,971
  2. 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,234
  3. 2024Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time Scalingcited by 1,599
  4. 2020Leveraging Passage Retrieval with Generative Models for Open Domain Question Answeringcited by 1,210
  5. 2019ERNIE: Enhanced Language Representation with Informative Entitiescited by 528
  6. 2021QA-GNN: Reasoning with Language Models and Knowledge Graphs for Question Answeringcited by 388
  7. 2019KEPLER: A Unified Model for Knowledge Embedding and Pre-trained Language Representationcited by 356
  8. 2023ChatIE: Zero-Shot Information Extraction via Chatting with ChatGPTcited by 250
  9. 2023Think-on-Graph: Deep and Responsible Reasoning of Large Language Model on Knowledge Graphcited by 238
  10. 2024An Introduction to Vision-Language Modelingcited by 178
  11. 2024Graph Chain-of-Thought: Augmenting Large Language Models by Reasoning on Graphscited by 119
  12. 2023GraphAdapter: Tuning Vision-Language Models With Dual Knowledge Graphcited by 69
9 more
  1. 2023GRID: Scene-Graph-based Instruction-driven Robotic Task Planningcited by 27
  2. 2025AutoSchemaKG: Autonomous Knowledge Graph Construction through Dynamic Schema Induction from Web-Scale Corporacited by 23
  3. 2025Aligning Vision to Language: Annotation-Free Multimodal Knowledge Graph Construction for Enhanced LLMs Reasoningcited by 19
  4. 2025Efficient LLaMA-3.2-Vision by Trimming Cross-attended Visual Featurescited by 10
  5. 2025TRIFFID: Autonomous Robotic Aid For Increasing First Responders Efficiencycited by 5
  6. 2025From Symbolic to Neural and Back: Exploring Knowledge Graph-Large Language Model Synergiescited by 3
  7. 2018Casualty Detection from 3D Point Cloud Data for Autonomous Ground Mobile Rescue Robotscited by 2
  8. 2024Time is on my sight: scene graph filtering for dynamic environment perception in an LLM-driven robotcited by 2
  9. 2024Knowledge Graphs: The Future of Data Integration and Insightful Discoverycited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026SAFIRE: Safety-Critical Benchmark for Fine-grained Fire and Smoke Understanding in Multimodal LLMs
  2. 2023Enhancing Emergency Decision-making with Knowledge Graphs and Large Language Models
  3. 2026Hazard or Anomaly? Evaluating VLMs for Understanding Dangers and Discrepancies
  4. 2025DetectiumFire: A Comprehensive Multi-modal Dataset Bridging Vision and Language for Fire Understanding
  5. 2026Distilling Vision-Language Models for On-Device Fire Understanding
  6. 2025Graphormer-Guided Task Planning: Beyond Static Rules with LLM Safety Perception
  7. 2025Scene Graph-Guided Generative AI Framework for Synthesizing and Evaluating Industrial Hazard Scenarios
  8. 2025Embodied Hazard Mitigation using Vision-Language Models for Autonomous Mobile Robots