Emergence of Physical Intelligence via Controllable Information Production
Not on the map. Why?
Abstract (arXiv)
Intrinsic Motivation (IM) aims to train agents without external rewards, enabling useful behavior to emerge from the agent's interaction with its environment alone. However, the dominant IM approaches rely on information-theoretic quantities with designer-chosen variables, introducing bias and lacking a principled connection to dynamics or optimal control (OC). We introduce Controllable Information Production (CIP), a new foundation for IM explicitly grounded in dynamical systems and OC. CIP measures the rate at which an agent produces information, capturing controllable complexity without external knowledge or bias. CIP unifies IM and OC into a single framework, formalizing physical intelligence as the control of information production. It further reveals connections between the structure of the value function and Kolmogorov-Sinai entropy. CIP consistently outperforms prior IM methods on standard benchmarks in robot learning and solves tasks they fail on, including humanoid self-righting. These results support a general organizing principle: physical intelligence emerges from driving systems toward the edge of controllable chaos.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 22 of its 47 references that are in the map. First posted on arXiv 30 Jan 2026.
Builds on
22 of 47 references.
References · 22
- 2021Convex optimizationcited by 2,479
- 2023Mastering Diverse Domains through World Modelscited by 1,193
- 2018Exploration by Random Network Distillationcited by 966
- 2018Diversity is All You Need: Learning Skills without a Reward Functioncited by 734
- 2023TD-MPC2: Scalable, Robust World Models for Continuous Controlcited by 482
- 2019Dynamics-Aware Unsupervised Discovery of Skillscited by 308
- 2023MimicGen: A Data Generation System for Scalable Robot Learning using Human Demonstrationscited by 308
- 2019DiffTaichi: Differentiable Programming for Physical Simulationcited by 248
- 2021URLB: Unsupervised Reinforcement Learning Benchmarkcited by 138
- 2025Training Agents Inside of Scalable World Modelscited by 122
- 2019End-to-End Robotic Reinforcement Learning without Reward Engineeringcited by 115
- 2020Sample-efficient Cross-Entropy Method for Real-time Planningcited by 90
10 more
- 2018GPU-Accelerated Robotic Simulation for Distributed Reinforcement Learningcited by 77
- 2024MaxInfoRL: Boosting exploration in reinforcement learning through information gain maximizationcited by 30
- 2022Dojo: A Differentiable Physics Engine for Roboticscited by 24
- 2017Unsupervised Real-Time Control through Variational Empowermentcited by 17
- 2022Intrinsic Motivation in Dynamical Control Systemscited by 7
- 2024Automatic Environment Shaping is the Next Frontier in RLcited by 6
- 2023Machine-learning optimized measurements of chaotic dynamical systems via the information bottleneckcited by 3
- 2025Whole-Body Model-Predictive Control of Legged Robots with MuJoCocited by 3
- 2025Decentralized Traffic Flow Optimization Through Intrinsic Motivationcited by 1
- 2025ARMimic: Learning Robotic Manipulation from Passive Human Demonstrations in Augmented Realitycited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.