# Enabling Intuitive Human-Robot Teaming Using Augmented Reality and Gesture Control

arXiv: https://arxiv.org/abs/1909.06415 · HTML: https://mlsanity.com/paper/1909.06415/

## Key facts

- Cited by 2 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 13 Sep 2019.

## Built on by (most cited first, 2 of 2)

- [Virtual, Augmented, and Mixed Reality for Human-Robot Interaction: A Survey and Virtual Design Element Taxonomy](https://mlsanity.com/paper/2202.11249/) (2022)
- [Body Gesture Recognition to Control a Social Robot](https://mlsanity.com/paper/2206.07538/) (2022)

## Abstract (arXiv)

Human-robot teaming offers great potential because of the opportunities to combine strengths of heterogeneous agents. However, one of the critical challenges in realizing an effective human-robot team is efficient information exchange - both from the human to the robot as well as from the robot to the human. In this work, we present and analyze an augmented reality-enabled, gesture-based system that supports intuitive human-robot teaming through improved information exchange. Our proposed system requires no external instrumentation aside from human-wearable devices and shows promise of real-world applicability for service-oriented missions. Additionally, we present preliminary results from a pilot study with human participants, and highlight lessons learned and open research questions that may help direct future development, fielding, and experimentation of autonomous HRI systems.