Transforming a Quadruped into a Guide Robot for the Visually Impaired: Formalizing Wayfinding, Interaction Modeling, and Safety Mechanism
Not on the map. Why?
Abstract (arXiv)
This paper explores the principles for transforming a quadrupedal robot into a guide robot for individuals with visual impairments. A guide robot has great potential to resolve the limited availability of guide animals that are accessible to only two to three percent of the potential blind or visually impaired (BVI) users. To build a successful guide robot, our paper explores three key topics: (1) formalizing the navigation mechanism of a guide dog and a human, (2) developing a data-driven model of their interaction, and (3) improving user safety. First, we formalize the wayfinding task of the human-guide robot team using Markov Decision Processes based on the literature and interviews. Then we collect real human-robot interaction data from three visually impaired and six sighted people and develop an interaction model called the ``Delayed Harness'' to effectively simulate the navigation behaviors of the team. Additionally, we introduce an action shielding mechanism to enhance user safety by predicting and filtering out dangerous actions. We evaluate the developed interaction model and the safety mechanism in simulation, which greatly reduce the prediction errors and the number of collisions, respectively. We also demonstrate the integrated system on a quadrupedal robot with a rigid harness, by guiding users over 100+~m trajectories.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 21 of its 62 references that are in the map. First posted on arXiv 24 Jun 2023.
Builds on
21 of 62 references.
References · 21
- 2017Matterport3D: Learning from RGB-D Data in Indoor Environmentscited by 1,376
- 2019Habitat: A Platform for Embodied AI Researchcited by 1,191
- 2018On Evaluation of Embodied Navigation Agentscited by 547
- 2017Safe Reinforcement Learning via Shieldingcited by 449
- 2019DD-PPO: Learning Near-Perfect PointGoal Navigators from 2.5 Billion Framescited by 362
- 2018Crowd-Robot Interaction: Crowd-aware Robot Navigation with Attention-based Deep Reinforcement Learningcited by 175
- 2020iGibson 1.0: a Simulation Environment for Interactive Tasks in Large Realistic Scenescited by 155
- 2022Safe Reinforcement Learning by Imagining the Near Futurecited by 67
- 2021Safe Multi-Agent Reinforcement Learning via Shieldingcited by 61
- 2020Motion Planning and Control for Mobile Robot Navigation Using Machine Learning: a Surveycited by 58
- 2021Success Weighted by Completion Time: A Dynamics-Aware Evaluation Criteria for Embodied Navigationcited by 22
- 2021Robotic Guide Dog: Leading a Human with Leash-Guided Hybrid Physical Interactioncited by 16
9 more
- 2021Learning to Navigate Sidewalks in Outdoor Environmentscited by 15
- 2021Improving Safety in Deep Reinforcement Learning using Unsupervised Action Planningcited by 7
- 2022Quadruped Guidance Robot for the Visually Impaired: A Comfort-Based Approachcited by 7
- 2022System Configuration and Navigation of a Guide Dog Robot: Toward Animal Guide Dog-Level Guiding Workcited by 7
- 2021Flying Guide Dog: Walkable Path Discovery for the Visually Impaired Utilizing Drones and Transformer-based Semantic Segmentationcited by 5
- 2021Benchmarking Augmentation Methods for Learning Robust Navigation Agents: the Winning Entry of the 2021 iGibson Challengecited by 5
- 2019Hierarchical and Safe Motion Control for Cooperative Locomotion of Robotic Guide Dogs and Humans: A Hybrid Systems Approachcited by 4
- 2023Exploring Levels of Control for a Navigation Assistant for Blind Travelerscited by 3
- 2021Quadrupedal Robotic Guide Dog with Vocal Human-Robot Interactioncited by 1
Built on by
Citing papers per year: 2023: 1; 2024: 0; 2025: 1; 2026: 2.
4 papers.
- 2025GuideNav: User-Informed Development of a Vision-Only Robotic Navigation Assistant For Blind Travelerscited by 4
- 2023Seeing-Eye Quadruped Navigation with Force Responsive Locomotion Controlcited by 3
- 2026GuideFetch: A Task Coordination Framework for Concurrent Navigation and Object Retrieval in Assistive Robot Dogscited by 1
- 2026Lightweight and Resource-Efficient Perception for Robotic Guide Dogscited by 0
- 2026Lightweight and Resource-Efficient Perception for Robotic Guide Dogs2 Oct 2026
- 2026GuideFetch: A Task Coordination Framework for Concurrent Navigation and Object Retrieval in Assistive Robot Dogs18 Aug 2026
- 2025GuideNav: User-Informed Development of a Vision-Only Robotic Navigation Assistant For Blind Travelers5 Dec 2025
- 2023Seeing-Eye Quadruped Navigation with Force Responsive Locomotion Control8 Sep 2023