Guessing human intentions to avoid dangerous situations in caregiving robots
Not on the map. Why?
Abstract (arXiv)
For robots to interact socially, they must interpret human intentions and anticipate their potential outcomes accurately. This is particularly important for social robots designed for human care, which may face potentially dangerous situations for people, such as unseen obstacles in their way, that should be avoided. This paper explores the Artificial Theory of Mind (ATM) approach to inferring and interpreting human intentions. We propose an algorithm that detects risky situations for humans, selecting a robot action that removes the danger in real time. We use the simulation-based approach to ATM and adopt the 'like-me' policy to assign intentions and actions to people. Using this strategy, the robot can detect and act with a high rate of success under time-constrained situations. The algorithm has been implemented as part of an existing robotics cognitive architecture and tested in simulation scenarios. Three experiments have been conducted to test the implementation's robustness, precision and real-time response, including a simulated scenario, a human-in-the-loop hybrid configuration and a real-world scenario.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 29 of its 77 references that are in the map. First posted on arXiv 24 Mar 2024.
Builds on
29 of 77 references.
References · 29
- 2017Mask R-CNNcited by 7,259
- 2015You Only Look Once: Unified, Real-Time Object Detectioncited by 4,829
- 2015ORB-SLAM: a Versatile and Accurate Monocular SLAM Systemcited by 983
- 2021ByteTrack: Multi-Object Tracking by Associating Every Detection Boxcited by 812
- 2016Past, Present, and Future of Simultaneous Localization And Mapping: Towards the Robust-Perception Agecited by 405
- 2023ConceptGraphs: Open-Vocabulary 3D Scene Graphs for Perception and Planningcited by 357
- 20193D Scene Graph: A Structure for Unified Semantics, 3D Space, and Cameracited by 280
- 2019Kimera: an Open-Source Library for Real-Time Metric-Semantic Localization and Mappingcited by 181
- 2022Hydra: A Real-time Spatial Perception System for 3D Scene Graph Construction and Optimizationcited by 175
- 2021SceneGraphFusion: Incremental 3D Scene Graph Prediction from RGB-D Sequencescited by 159
- 2021Kimera: from SLAM to Spatial Perception with 3D Dynamic Scene Graphscited by 144
- 2016SemanticFusion: Dense 3D Semantic Mapping with Convolutional Neural Networkscited by 134
17 more
- 2019HorizonNet: Learning Room Layout with 1D Representation and Pano Stretch Data Augmentationcited by 107
- 2019PanopticFusion: Online Volumetric Semantic Mapping at the Level of Stuff and Thingscited by 97
- 2018LayoutNet: Reconstructing the 3D Room Layout from a Single RGB Imagecited by 94
- 2016Revisiting Active Perceptioncited by 90
- 2024Open3DSG: Open-Vocabulary 3D Scene Graphs from Point Clouds with Queryable Objects and Open-Set Relationshipscited by 76
- 2018Holistic 3D Scene Parsing and Reconstruction from a Single RGB Imagecited by 69
- 2022A Survey on Active Simultaneous Localization and Mapping: State of the Art and New Frontierscited by 62
- 2023Foundations of Spatial Perception for Robotics: Hierarchical Representations and Real-time Systemscited by 60
- 2018FloorNet: A Unified Framework for Floorplan Reconstruction from 3D Scanscited by 35
- 2023A Survey on Socially Aware Robot Navigation: Taxonomy and Future Challengescited by 35
- 2023Context-Aware Entity Grounding with Open-Vocabulary 3D Scene Graphscited by 33
- 2022Situational Graphs for Robot Navigation in Structured Indoor Environmentscited by 21
- 2021From SLAM to Situational Awareness: Challenges and Surveycited by 14
- 2022Semantic Visual Simultaneous Localization and Mapping: A Surveycited by 7
- 2020Lifelong update of semantic maps in dynamic environmentscited by 3
- 2022Joint Multi-Person Body Detection and Orientation Estimation via One Unified Embeddingcited by 3
- 2023Graph-based Global Robot Localization Informing Situational Graphs with Architectural Graphscited by 3
Built on by
Not cited yet.