Active Inference: A method for Phenotyping Agency in AI systems?
On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks
Abstract (arXiv)
The proliferation of agentic artificial intelligence has outpaced the conceptual tools needed to characterize agency in computational systems. Prevailing definitions mainly rely on autonomy and goal-directedness. Here, we argue for a minimal notion open to principled inspection given three criteria: intentionality as action grounded in beliefs and desires, rationality as normatively coherent action entailed by a world model, and explainability as action causally traceable to internal states; we subsequently instantiate these as a partially observable Markov decision process under a variational framework wherein posterior beliefs, prior preferences, and the minimization of expected free energy jointly constitute an agentic action chain. Using a canonical T-maze paradigm, we evidence how empowerment, formulated as the channel capacity between actions and anticipated observations, serves as an operational metric that distinguishes zero-, intermediate-, and high-agency phenotypes through structural manipulations of the generative model. We conclude by arguing that as agents engage in epistemic foraging to resolve ambiguity, the governance controls that remain effective must shift systematically from external constraints to the internal modulation of prior preferences, offering a principled, variational bridge from computational phenotyping to AI governance strategy
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 9 of its 39 references that are in the map. First posted on arXiv 25 Apr 2026.
Builds on
9 of 39 references.
References · 9
- 2016The Mythos of Model Interpretabilitycited by 721
- 2023Learning Universal Policies via Text-Guided Video Generationcited by 522
- 2023TD-MPC2: Scalable, Robust World Models for Continuous Controlcited by 512
- 2024Understanding World or Predicting Future? A Comprehensive Survey of World Modelscited by 166
- 2015Variational Information Maximisation for Intrinsically Motivated Reinforcement Learningcited by 144
- 2020Active inference on discrete state-spaces: a synthesiscited by 92
- 2020Reinforcement Learning through Active Inferencecited by 47
- 2019A World unto Itself: Human Communication as Active Inferencecited by 11
- 2024Key Safety Design Overview in AI-driven Autonomous Vehiclescited by 4
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2024Active Inference as a Model of Agency
- 2025Is the `Agent' Paradigm a Limiting Framework for Next-Generation Intelligent Systems?
- 2026Intentionality is a Design Decision: Measuring Functional Intentionality for Accountable AI Systems
- 2026The Tao of Agency: Autotelic AI, Embedded Agency and Dissolution of the Self
- 2025Agentic AI Needs a Systems Theory
- 2025Universal AI maximizes Variational Empowerment
- 2025LIMI: Less is More for Agency
- 2026One Gate Is Not Enough: Composing Stateful Pre-Action Controls for Agentic AI