Independence in the Home: A Wearable Interface for a Person with Quadriplegia to Teleoperate a Mobile Manipulator
Not on the map. Why?
Abstract (arXiv)
Teleoperation of mobile manipulators within a home environment can significantly enhance the independence of individuals with severe motor impairments, allowing them to regain the ability to perform self-care and household tasks. There is a critical need for novel teleoperation interfaces to offer effective alternatives for individuals with impairments who may encounter challenges in using existing interfaces due to physical limitations. In this work, we iterate on one such interface, HAT (Head-Worn Assistive Teleoperation), an inertial-based wearable integrated into any head-worn garment. We evaluate HAT through a 7-day in-home study with Henry Evans, a non-speaking individual with quadriplegia who has participated extensively in assistive robotics studies. We additionally evaluate HAT with a proposed shared control method for mobile manipulators termed Driver Assistance and demonstrate how the interface generalizes to other physical devices and contexts. Our results show that HAT is a strong teleoperation interface across key metrics including efficiency, errors, learning curve, and workload. Code and videos are located on our project website.
Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). First posted on arXiv 22 Dec 2023.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2024: 3; 2025: 4; 2026: 1.
8 papers.
- 2024VoicePilot: Harnessing LLMs as Speech Interfaces for Physically Assistive Robotscited by 16
- 2024EMGBench: Benchmarking Out-of-Distribution Generalization and Adaptation for Electromyographycited by 7
- 2025FEAST: A Flexible Mealtime-Assistance System Towards In-the-Wild Personalizationcited by 7
- 2025EgoCHARM: Resource-Efficient Hierarchical Activity Recognition using an Egocentric IMU Sensorcited by 3
- 2024Towards an LLM-Based Speech Interface for Robot-Assisted Feedingcited by 2
- 2025LAMS: LLM-Driven Automatic Mode Switching for Assistive Teleoperationcited by 2
- 2025Casper: Inferring Diverse Intents for Assistive Teleoperation with Vision Language Modelscited by 1
- 2026SAPS: Shared Autonomy for Policy Steering by Blending Teleoperation with a Pretrained VLAcited by 1
- 2026SAPS: Shared Autonomy for Policy Steering by Blending Teleoperation with a Pretrained VLA14 Jun 2026
- 2025FEAST: A Flexible Mealtime-Assistance System Towards In-the-Wild Personalization17 Jun 2025
- 2025Casper: Inferring Diverse Intents for Assistive Teleoperation with Vision Language Models17 Jun 2025
- 2025EgoCHARM: Resource-Efficient Hierarchical Activity Recognition using an Egocentric IMU Sensor24 Apr 2025
- 2025LAMS: LLM-Driven Automatic Mode Switching for Assistive Teleoperation15 Jan 2025
- 2024EMGBench: Benchmarking Out-of-Distribution Generalization and Adaptation for Electromyography31 Oct 2024
- 2024Towards an LLM-Based Speech Interface for Robot-Assisted Feeding27 Oct 2024
- 2024VoicePilot: Harnessing LLMs as Speech Interfaces for Physically Assistive Robots5 Apr 2024