On the Origins of Self-Modeling
Not on the map. Why?
Abstract (arXiv)
Self-Modeling is the process by which an agent, such as an animal or machine, learns to create a predictive model of its own dynamics. Once captured, this self-model can then allow the agent to plan and evaluate various potential behaviors internally using the self-model, rather than using costly physical experimentation. Here, we quantify the benefits of such self-modeling against the complexity of the robot. We find a R2 =0.90 correlation between the number of degrees of freedom a robot has, and the added value of self-modeling as compared to a direct learning baseline. This result may help motivate self modeling in increasingly complex robotic systems, as well as shed light on the origins of self-modeling, and ultimately self-awareness, in animals and humans.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 10 of its 19 references that are in the map. First posted on arXiv 5 Sep 2022.
Builds on
10 of 19 references.
References · 10
- 2017Proximal Policy Optimization Algorithmscited by 14,441
- 2015Continuous control with deep reinforcement learningcited by 3,279
- 2019When to Trust Your Model: Model-Based Policy Optimizationcited by 753
- 2018Learning Dexterous In-Hand Manipulationcited by 643
- 2019Model-Based Reinforcement Learning for Ataricited by 495
- 2017Emergence of Locomotion Behaviours in Rich Environmentscited by 159
- 2017Imagination-Augmented Agents for Deep Reinforcement Learningcited by 137
- 2017Recurrent Environment Simulatorscited by 68
- 2018Learning Awareness Modelscited by 13
- 2018Policy Optimization with Model-based Explorationscited by 5
Built on by
Citing papers per year: 2023: 1; 2024: 0; 2025: 0; 2026: 1.
2 papers.