mlsanityData to 14 Oct 2026

Universal AI maximizes Variational Empowerment

arXiv 2502.15820 ↗First posted 20 Feb 2025cs.AI cs.LG stat.MLcited by 2

On the map: Deep reinforcement learning methods → Deep RL algorithms and representations

Abstract (arXiv)

This paper presents a theoretical framework unifying AIXI -- a model of universal AI -- with variational empowerment as an intrinsic drive for exploration. We build on the existing framework of Self-AIXI -- a universal learning agent that predicts its own actions -- by showing how one of its established terms can be interpreted as a variational empowerment objective. We further demonstrate that universal AI's planning process can be cast as minimizing expected variational free energy (the core principle of active Inference), thereby revealing how universal AI agents inherently balance goal-directed behavior with uncertainty reduction curiosity). Moreover, we argue that power-seeking tendencies of universal AI agents can be explained not only as an instrumental strategy to secure future reward, but also as a direct consequence of empowerment maximization -- i.e. the agent's intrinsic drive to maintain or expand its own controllability in uncertain environments. Our main contribution is to show how these intrinsic motivations (empowerment, curiosity) systematically lead universal AI agents to seek and sustain high-optionality states. We prove that Self-AIXI asymptotically converges to the same performance as AIXI under suitable conditions, and highlight that its power-seeking behavior emerges naturally from both reward maximization and curiosity-driven exploration. Since AIXI can be view as a Bayes-optimal mathematical formulation for Artificial General Intelligence (AGI), our result can be useful for further discussion on AI safety and the controllability of AGI.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in Deep RL algorithms and representations, one of 15 directions in Deep reinforcement learning methods. Builds on 4 of its 12 references that are in the map. First posted on arXiv 20 Feb 2025.

Builds on

4 of 12 references.

References · 4

  1. 2016Variational Intrinsic Controlcited by 267
  2. 2015Variational Information Maximisation for Intrinsically Motivated Reinforcement Learningcited by 144
  3. 2019Optimal Policies Tend to Seek Powercited by 119
  4. 2019A free energy principle for a particular physicscited by 40

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Active Inference: A method for Phenotyping Agency in AI systems?
  2. 2025Information-Theoretic Policy Pre-Training with Empowerment
  3. 2025Embedded Universal Predictive Intelligence: a coherent framework for multi-agent learning
  4. 2025The Missing Reward: Active Inference in the Era of Experience
  5. 2021Information is Power: Intrinsic Control via Information Capture
  6. 2025Model-Based Soft Maximization of Suitable Metrics of Long-Term Human Power
  7. 2026The Tao of Agency: Autotelic AI, Embedded Agency and Dissolution of the Self
  8. 2026Self-Aware Recursively Self-Improving Agents for Personal Singularity: A Goal-, Scope-, Tool-, and Benchmark-Driven Multi-Agent Architecture