Robot Learning Theory of Mind through Self-Observation: Exploiting the Intentions-Beliefs Synergy
Not on the map. Why?
Abstract (arXiv)
In complex environments, where the human sensory system reaches its limits, our behaviour is strongly driven by our beliefs about the state of the world around us. Accessing others' beliefs, intentions, or mental states in general, could thus allow for more effective social interactions in natural contexts. Yet these variables are not directly observable. Theory of Mind (TOM), the ability to attribute to other agents' beliefs, intentions, or mental states in general, is a crucial feature of human social interaction and has become of interest to the robotics community. Recently, new models that are able to learn TOM have been introduced. In this paper, we show the synergy between learning to predict low-level mental states, such as intentions and goals, and attributing high-level ones, such as beliefs. Assuming that learning of beliefs can take place by observing own decision and beliefs estimation processes in partially observable environments and using a simple feed-forward deep learning model, we show that when learning to predict others' intentions and actions, faster and more accurate predictions can be acquired if beliefs attribution is learnt simultaneously with action and intentions prediction. We show that the learning performance improves even when observing agents with a different decision process and is higher when observing beliefs-driven chunks of behaviour. We propose that our architectural approach can be relevant for the design of future adaptive social robots that should be able to autonomously understand and assist human partners in novel natural environments and tasks.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 17 of its 63 references that are in the map. First posted on arXiv 17 Oct 2022.
Builds on
17 of 63 references.
References · 17
- 2017An Overview of Multi-Task Learning in Deep Neural Networkscited by 791
- 2020Object Goal Navigation using Goal-Oriented Semantic Explorationcited by 421
- 2020Multi-Task Learning with Deep Neural Networks: A Surveycited by 374
- 2018Machine Theory of Mindcited by 222
- 2020The EPIC-KITCHENS Dataset: Collection, Challenges and Baselinescited by 221
- 2019Probabilistic Recursive Reasoning for Multi-Agent Reinforcement Learningcited by 68
- 2017A Dataset for Developing and Benchmarking Active Visioncited by 50
- 2019On the Feasibility of Learning, Rather than Assuming, Human Biases for Reward Inferencecited by 49
- 2022Mind the gap: Challenges of deep learning approaches to Theory of Mindcited by 21
- 2019Emergence of Exploratory Look-Around Behaviors through Active Observation Completioncited by 14
- 2021Deep Interpretable Models of Theory of Mindcited by 13
- 2020StylePredict: Machine Theory of Mind for Human Driver Behavior From Trajectoriescited by 11
5 more
- 2019Interactive AI with a Theory of Mindcited by 7
- 2022Learning Theory of Mind via Dynamic Traits Attributioncited by 5
- 2019Proactive Intention Recognition for Joint Human-Robot Search and Rescue Missions through Monte-Carlo Planning in POMDP Environmentscited by 4
- 2019Functional advantages of an adaptive Theory of Mind for robotics: a review of current architecturescited by 4
- 2019Transferring Adaptive Theory of Mind to social robots: insights from developmental psychology to roboticscited by 1
Built on by
Citing papers per year: 2023: 1; 2024: 0; 2025: 1.
2 papers.