# AI Challenges in Human-Robot Cognitive Teaming

arXiv: https://arxiv.org/abs/1707.04775 · HTML: https://mlsanity.com/paper/1707.04775/

## Key facts

- Cited by 9 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 15 Jul 2017.

## Built on by (most cited first, 9 of 9)

- [On the Emergence of Symmetrical Reality](https://mlsanity.com/paper/2401.15132/) (2024)
- [A Survey on Human-AI Collaboration with Large Foundation Models](https://mlsanity.com/paper/2403.04931/) (2024)
- [Perspective-corrected Spatial Referring Expression Generation for Human-Robot Interaction](https://mlsanity.com/paper/2104.01558/) (2021)
- [Towards Teachable Autotelic Agents](https://mlsanity.com/paper/2105.11977/) (2021)
- [Generating Active Explicable Plans in Human-Robot Teaming](https://mlsanity.com/paper/2109.08834/) (2021)
- [One-shot Policy Elicitation via Semantic Reward Manipulation](https://mlsanity.com/paper/2101.01860/) (2021)
- [Why Robots Are Bad at Detecting Their Mistakes: Limitations of Miscommunication Detection in Human-Robot Dialogue](https://mlsanity.com/paper/2506.20268/) (2025)
- [Towards Action Model Learning for Player Modeling](https://mlsanity.com/paper/2103.05682/) (2021)
- [Teaching Drones on the Fly: Can Emotional Feedback Serve as Learning Signal for Training Artificial Agents?](https://mlsanity.com/paper/2202.09634/) (2022)

## Abstract (arXiv)

Among the many anticipated roles for robots in the future is that of being a human teammate. Aside from all the technological hurdles that have to be overcome with respect to hardware and control to make robots fit to work with humans, the added complication here is that humans have many conscious and subconscious expectations of their teammates - indeed, we argue that teaming is mostly a cognitive rather than physical coordination activity. This introduces new challenges for the AI and robotics community and requires fundamental changes to the traditional approach to the design of autonomy. With this in mind, we propose an update to the classical view of the intelligent agent architecture, highlighting the requirements for mental modeling of the human in the deliberative process of the autonomous agent. In this article, we outline briefly the recent efforts of ours, and others in the community, towards developing cognitive teammates along these guidelines.