Empowerment -- an Introduction
Not on the map. Why?
Abstract (arXiv)
This book chapter is an introduction to and an overview of the information-theoretic, task independent utility function "Empowerment", which is defined as the channel capacity between an agent's actions and an agent's sensors. It quantifies how much influence and control an agent has over the world it can perceive. This book chapter discusses the general idea behind empowerment as an intrinsic motivation and showcases several previous applications of empowerment to demonstrate how empowerment can be applied to different sensor-motor configuration, and how the same formalism can lead to different observed behaviors. Furthermore, we also present a fast approximation for empowerment in the continuous domain.
Key facts. Cited by 65 papers in the map (data through 7 Oct 2026). First posted on arXiv 7 Oct 2013.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2018: 2; 2019: 0; 2020: 0; 2021: 16; 2022: 6; 2023: 6; 2024: 5; 2025: 15; 2026: 15.
65 papers.
Sort:
By area:
- 2018Reward learning from human preferences and demonstrations in Ataricited by 314
- 2021Causal Influence Detection for Improving Efficiency in Reinforcement Learningcited by 70
- 2021Exploration in Deep Reinforcement Learning: From Single-Agent to Multiagent Domaincited by 57
- 2021Towards Robust Bisimulation Metric Learningcited by 49
- 2021MADE: Exploration via Maximizing Deviation from Explored Regionscited by 40
- 2018Adversarial Imitation via Variational Inverse Reinforcement Learningcited by 36
- 2021The Information Geometry of Unsupervised Reinforcement Learningcited by 36
- 2024MaxInfoRL: Boosting exploration in reinforcement learning through information gain maximizationcited by 30
- 2025Characterizing AI Agents for Alignment and Governancecited by 30
- 2022An information-theoretic perspective on intrinsic motivation in reinforcement learning: a surveycited by 25
- 2021Beyond Fine-Tuning: Transferring Behavior in Reinforcement Learningcited by 21
- 2021Mutual Information State Intrinsic Controlcited by 18
38 more
- 2021Active Hierarchical Exploration with Stable Subgoal Representation Learningcited by 17
- 2021Understanding the World Through Actioncited by 17
- 2021Learn Goal-Conditioned Policy with Intrinsic Motivation for Deep Reinforcement Learningcited by 15
- 2021Variational Empowerment as Representation Learning for Goal-Based Reinforcement Learningcited by 15
- 2024Learning to Assist Humans without Inferring Rewardscited by 12
- 2021Braxlines: Fast and Interactive Toolkit for RL-driven Behavior Engineering beyond Reward Maximizationcited by 11
- 2023CLUE: Calibrated Latent Guidance for Offline Reinforcement Learningcited by 11
- 2023Variational Curriculum Reinforcement Learning for Unsupervised Discovery of Skillscited by 8
- 2022Intrinsic Motivation in Dynamical Control Systemscited by 7
- 2023Hierarchical Empowerment: Towards Tractable Empowerment-Based Skill Learningcited by 7
- 2025SOMBRL: Scalable and Optimistic Model-Based RLcited by 7
- 2021Explore and Control with Adversarial Surprisecited by 6
- 2023Leveraging Jumpy Models for Planning and Fast Learning in Robotic Domainscited by 6
- 2023Controlled Diversity with Preference : Towards Learning a Diverse Set of Desired Skillscited by 6
- 2025Intrinsically-Motivated Humans and Agents in Open-World Explorationcited by 6
- 2025From Curiosity to Competence: How World Models Interact with the Dynamics of Explorationcited by 5
- 2021Unsupervised Skill-Discovery and Skill-Learning in Minecraftcited by 4
- 2024BAMDP Shaping: a Unified Framework for Intrinsic Motivation and Reward Shapingcited by 4
- 2025Towards Empowerment Gain through Causal Structure Learning in Model-Based RLcited by 4
- 2021Learning Task Agnostic Skills with Data-driven Guidancecited by 3
- 2022Learning how to Interact with a Complex Interface using Hierarchical Reinforcement Learningcited by 3
- 2025Sample-efficient and Scalable Exploration in Continuous-Time RLcited by 3
- 2022The Paradox of Choice: Using Attention in Hierarchical Reinforcement Learningcited by 2
- 2022Empowered Neural Cellular Automatacited by 2
- 2025On Efficient Bayesian Exploration in Model-Based Reinforcement Learningcited by 2
- 2025Agent-centric learning: from external reward maximization to internal knowledge curationcited by 2
- 2025Estimating the Empowerment of Language Model Agentscited by 2
- 2025Training LLM Agents to Empower Humanscited by 2
- 2025Empowerment Gain and Causal Model Construction: Children and adults are sensitive to controllability and variability in their causal interventionscited by 2
- 2026Intelligence from Learnable Noveltycited by 2
- 2021Experimental Evidence that Empowerment May Drive Exploration in Sparse-Reward Environmentscited by 1
- 2023Selection for short-term empowerment accelerates the evolution of homeostatic neural cellular automatacited by 1
- 2024Latent-Predictive Empowerment: Measuring Empowerment without a Simulatorcited by 1
- 2024SuPLE: Robot Learning with Lyapunov Rewardscited by 1
- 2025Information-Theoretic Policy Pre-Training with Empowermentcited by 1
- 2026A Mathematical Theory of Agency and Intelligencecited by 1
- 2026Constructive Alignment: Governing Preference Dynamics in Human-AI Interactioncited by 1
- 2022Intrinsically motivated option learning: a comparative study of recent methodscited by 0
50 most cited of 65 All 65 (JSON)
- 2026Belief-Based Maximum Occupancy Principle and Active Inference30 Sep 2026
- 2026Learning to Zoom Efficiently with a Contrastive Curriculum2 Sep 2026
- 2026What Is Worth Representing? Representational Empowerment for Continual Model Construction2 Sep 2026
- 2026Individual Disempowerment through an Advice Channel: Control Loss when Influence is Endogenous14 Aug 2026
- 2026Capability-Gated Planning: Cost-to-Goal Discovery and the Limits of Myopic Experiment Selection5 Aug 2026
- 2026Intelligence from Learnable Novelty20 Jul 2026
- 2026Generalised Bellman recurrence and three dualities in sequential decision-making20 Jul 2026
- 2026Learning to Choose: An Empowerment-Guided Multi-Agent System with semantic communication for Adaptive Method Selection28 May 2026
- 2026Unifying Goal-Conditioned RL and Unsupervised Skill Learning via Control-Maximization7 May 2026
- 2026Interoceptive machine framework: Toward interoception-inspired regulatory architectures in artificial intelligence27 Apr 2026
- 2026Multi-Agent Empowerment and Emergence of Complex Behavior in Groups22 Apr 2026
- 2026Constructive Alignment: Governing Preference Dynamics in Human-AI Interaction1 Apr 2026
38 more
- 2026C-STEP: Continuous Space-Time Empowerment for Physics-informed Safe Reinforcement Learning of Mobile Agents25 Mar 2026
- 2026The Informational Cost of Agency: A Bounded Measure of Interaction Efficiency for Deployed Reinforcement Learning1 Mar 2026
- 2026A Mathematical Theory of Agency and Intelligence26 Feb 2026
- 2025Empowerment Gain and Causal Model Construction: Children and adults are sensitive to controllability and variability in their causal interventions9 Dec 2025
- 2025SOMBRL: Scalable and Optimistic Model-Based RL25 Nov 2025
- 2025When Assisting One Disempowers Another6 Nov 2025
- 2025Sample-efficient and Scalable Exploration in Continuous-Time RL28 Oct 2025
- 2025Training LLM Agents to Empower Humans15 Oct 2025
- 2025Information-Theoretic Policy Pre-Training with Empowerment7 Oct 2025
- 2025Estimating the Empowerment of Language Model Agents26 Sep 2025
- 2025Agent-centric learning: from external reward maximization to internal knowledge curation29 Jul 2025
- 2025From Curiosity to Competence: How World Models Interact with the Dynamics of Exploration10 Jul 2025
- 2025On Efficient Bayesian Exploration in Model-Based Reinforcement Learning3 Jul 2025
- 2025Characterizing AI Agents for Alignment and Governance30 Apr 2025
- 2025Intrinsically-Motivated Humans and Agents in Open-World Exploration31 Mar 2025
- 2025Graceful forgetting: Memory as a process16 Feb 2025
- 2025Towards Empowerment Gain through Causal Structure Learning in Model-Based RL14 Feb 2025
- 2025Towards a Formal Theory of the Need for Competence via Computational Intrinsic Motivation11 Feb 2025
- 2024MaxInfoRL: Boosting exploration in reinforcement learning through information gain maximization16 Dec 2024
- 2024SuPLE: Robot Learning with Lyapunov Rewards20 Nov 2024
- 2024Learning to Assist Humans without Inferring Rewards4 Nov 2024
- 2024Latent-Predictive Empowerment: Measuring Empowerment without a Simulator15 Oct 2024
- 2024BAMDP Shaping: a Unified Framework for Intrinsic Motivation and Reward Shaping9 Sep 2024
- 2023Variational Curriculum Reinforcement Learning for Unsupervised Discovery of Skills30 Oct 2023
- 2023Hierarchical Empowerment: Towards Tractable Empowerment-Based Skill Learning6 Jul 2023
- 2023CLUE: Calibrated Latent Guidance for Offline Reinforcement Learning23 Jun 2023
- 2023Selection for short-term empowerment accelerates the evolution of homeostatic neural cellular automata24 May 2023
- 2023Controlled Diversity with Preference : Towards Learning a Diverse Set of Desired Skills7 Mar 2023
- 2023Leveraging Jumpy Models for Planning and Fast Learning in Robotic Domains24 Feb 2023
- 2022Intrinsic Motivation in Dynamical Control Systems29 Dec 2022
- 2022An information-theoretic perspective on intrinsic motivation in reinforcement learning: a survey19 Sep 2022
- 2022Intrinsically motivated option learning: a comparative study of recent methods13 Jun 2022
- 2022Empowered Neural Cellular Automata27 Apr 2022
- 2022Learning how to Interact with a Complex Interface using Hierarchical Reinforcement Learning21 Apr 2022
- 2022The Paradox of Choice: Using Attention in Hierarchical Reinforcement Learning24 Jan 2022
- 2021Towards Robust Bisimulation Metric Learning27 Oct 2021
- 2021Understanding the World Through Action24 Oct 2021
- 2021Braxlines: Fast and Interactive Toolkit for RL-driven Behavior Engineering beyond Reward Maximization10 Oct 2021
50 newest of 65 All 65 (JSON)
- 2025Estimating the Empowerment of Language Model Agentscited by 2
- 2025Training LLM Agents to Empower Humanscited by 2
- 2026C-STEP: Continuous Space-Time Empowerment for Physics-informed Safe Reinforcement Learning of Mobile Agentscited by 0
- 2026Learning to Choose: An Empowerment-Guided Multi-Agent System with semantic communication for Adaptive Method Selectioncited by 0
- 2026Learning to Choose: An Empowerment-Guided Multi-Agent System with semantic communication for Adaptive Method Selection28 May 2026
- 2026C-STEP: Continuous Space-Time Empowerment for Physics-informed Safe Reinforcement Learning of Mobile Agents25 Mar 2026
- 2025Training LLM Agents to Empower Humans15 Oct 2025
- 2025Estimating the Empowerment of Language Model Agents26 Sep 2025
- 2021Causal Influence Detection for Improving Efficiency in Reinforcement Learningcited by 70
- 2021Exploration in Deep Reinforcement Learning: From Single-Agent to Multiagent Domaincited by 57
- 2021Towards Robust Bisimulation Metric Learningcited by 49
- 2021MADE: Exploration via Maximizing Deviation from Explored Regionscited by 40
- 2021The Information Geometry of Unsupervised Reinforcement Learningcited by 36
- 2024MaxInfoRL: Boosting exploration in reinforcement learning through information gain maximizationcited by 30
- 2025Characterizing AI Agents for Alignment and Governancecited by 30
- 2022An information-theoretic perspective on intrinsic motivation in reinforcement learning: a surveycited by 25
- 2021Beyond Fine-Tuning: Transferring Behavior in Reinforcement Learningcited by 21
- 2021Mutual Information State Intrinsic Controlcited by 18
- 2021Active Hierarchical Exploration with Stable Subgoal Representation Learningcited by 17
- 2021Understanding the World Through Actioncited by 17
12 most cited of 55 All 55 (JSON)
- 2026Belief-Based Maximum Occupancy Principle and Active Inference30 Sep 2026
- 2026Learning to Zoom Efficiently with a Contrastive Curriculum2 Sep 2026
- 2026What Is Worth Representing? Representational Empowerment for Continual Model Construction2 Sep 2026
- 2026Individual Disempowerment through an Advice Channel: Control Loss when Influence is Endogenous14 Aug 2026
- 2026Capability-Gated Planning: Cost-to-Goal Discovery and the Limits of Myopic Experiment Selection5 Aug 2026
- 2026Intelligence from Learnable Novelty20 Jul 2026
- 2026Generalised Bellman recurrence and three dualities in sequential decision-making20 Jul 2026
- 2026Unifying Goal-Conditioned RL and Unsupervised Skill Learning via Control-Maximization7 May 2026
- 2026Interoceptive machine framework: Toward interoception-inspired regulatory architectures in artificial intelligence27 Apr 2026
- 2026Multi-Agent Empowerment and Emergence of Complex Behavior in Groups22 Apr 2026
- 2026The Informational Cost of Agency: A Bounded Measure of Interaction Efficiency for Deployed Reinforcement Learning1 Mar 2026
- 2026A Mathematical Theory of Agency and Intelligence26 Feb 2026
12 newest of 55 All 55 (JSON)