Human-Aware Robot Behaviour in Self-Driving Labs
Not on the map. Why?
Abstract (arXiv)
Self-driving laboratories (SDLs) are rapidly transforming research in chemistry and materials science to accelerate new discoveries. Mobile robot chemists (MRCs) play a pivotal role by autonomously navigating the lab to transport samples, effectively connecting synthesis, analysis, and characterisation equipment. The instruments within an SDL are typically designed or retrofitted to be accessed by both human and robotic chemists, ensuring operational flexibility and integration between manual and automated workflows. In many scenarios, human and robotic chemists may need to use the same equipment simultaneously. Currently, MRCs rely on simple LiDAR-based obstruction detection, which forces the robot to passively wait if a human is present. This lack of situational awareness leads to unnecessary delays and inefficient coordination in time-critical automated workflows in human-robot shared labs. To address this, we present an initial study of an embodied, AI-driven perception method that facilitates proactive human-robot interaction in shared-access scenarios. Our method features a hierarchical human intention prediction model that allows the robot to distinguish between preparatory actions (waiting) and transient interactions (accessing the instrument). Our results demonstrate that the proposed approach enhances efficiency by enabling proactive human-robot interaction, streamlining coordination, and potentially increasing the efficiency of autonomous scientific labs.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 12 of its 21 references that are in the map. First posted on arXiv 9 Mar 2026.
Builds on
12 of 21 references.
References · 12
- 2023GPT-4 Technical Reportcited by 18,396
- 2023Visual Instruction Tuningcited by 7,869
- 2023A Survey on Multimodal Large Language Modelscited by 909
- 2024ORGANA: A Robotic Assistant for Automated Chemistry Experimentation and Characterizationcited by 61
- 2024VLM-Social-Nav: Socially Aware Robot Navigation through Scoring using Vision-Language Modelscited by 46
- 2024A Self-Correcting Vision-Language-Action Model for Fast and Slow System Manipulationcited by 21
- 2024OLiVia-Nav: An Online Lifelong Vision Language Approach for Mobile Robot Social Navigationcited by 18
- 2022ARChemist: Autonomous Robotic Chemistry System Architecturecited by 9
- 2022SOLIS: Autonomous Solubility Screening using Deep Neural Networkscited by 6
- 2025PREVENT: Proactive Risk Evaluation and Vigilant Execution of Tasks for Mobile Robotic Chemists using Multi-Modal Behavior Treescited by 2
- 2025Multimodal Behaviour Trees for Robotic Laboratory Task Automationcited by 1
- 2025Intuitive Programming, Adaptive Task Planning, and Dynamic Role Allocation in Human-Robot Collaborationcited by 1
Built on by
Not cited yet.