Perspective Taking in Deep Reinforcement Learning Agents
Not on the map. Why?
Abstract (arXiv)
Perspective taking is the ability to take the point of view of another agent. This skill is not unique to humans as it is also displayed by other animals like chimpanzees. It is an essential ability for social interactions, including efficient cooperation, competition, and communication. Here we present our progress toward building artificial agents with such abilities. We implemented a perspective taking task inspired by experiments done with chimpanzees. We show that agents controlled by artificial neural networks can learn via reinforcement learning to pass simple tests that require perspective taking capabilities. We studied whether this ability is more readily learned by agents with information encoded in allocentric or egocentric form for both their visual perception and motor actions. We believe that, in the long run, building better artificial agents with perspective taking ability can help us develop artificial intelligence that is more human-like and easier to communicate with.
Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). First posted on arXiv 3 Jul 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 1; 2022: 1; 2023: 2; 2024: 0; 2025: 1; 2026: 2.
7 papers.
- 2022Mind the gap: Challenges of deep learning approaches to Theory of Mindcited by 21
- 2021Visual Perspective Taking for Opponent Behavior Modelingcited by 6
- 2023Emergence of Adaptive Circadian Rhythms in Deep Reinforcement Learningcited by 1
- 2025How well can LLMs provide planning feedback in grounded environments?cited by 1
- 2023Latent Emission-Augmented Perspective-Taking (LEAPT) for Human-Robot Interactioncited by 0
- 2026The Observer-Situation Lattice: A Unified Formal Basis for Perspective-Aware Cognitioncited by 0
- 2026Beyond the Cartesian Illusion: Testing Two-Stage Multi-Modal Theory of Mind under Perceptual Bottleneckscited by 0
- 2026Beyond the Cartesian Illusion: Testing Two-Stage Multi-Modal Theory of Mind under Perceptual Bottlenecks18 May 2026
- 2026The Observer-Situation Lattice: A Unified Formal Basis for Perspective-Aware Cognition2 Mar 2026
- 2025How well can LLMs provide planning feedback in grounded environments?11 Sep 2025
- 2023Latent Emission-Augmented Perspective-Taking (LEAPT) for Human-Robot Interaction12 Aug 2023
- 2023Emergence of Adaptive Circadian Rhythms in Deep Reinforcement Learning22 Jul 2023
- 2022Mind the gap: Challenges of deep learning approaches to Theory of Mind30 Mar 2022
- 2021Visual Perspective Taking for Opponent Behavior Modeling11 May 2021