# Sophisticated Inference

arXiv: https://arxiv.org/abs/2006.04120 · HTML: https://mlsanity.com/paper/2006.04120/

## Key facts

- Cited by 56 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 7 Jun 2020.

## Built on by (most cited first, 30 of 56)

- [Active Inference in Robotics and Artificial Agents: Survey and Challenges](https://mlsanity.com/paper/2112.01871/) (2021)
- [pymdp: A Python library for active inference in discrete state spaces](https://mlsanity.com/paper/2201.03904/) (2022)
- [The Free Energy Principle for Perception and Action: A Deep Learning Perspective](https://mlsanity.com/paper/2207.06415/) (2022)
- [Designing Ecosystems of Intelligence from First Principles](https://mlsanity.com/paper/2212.01354/) (2022)
- [Contrastive Active Inference](https://mlsanity.com/paper/2110.10083/) (2021)
- [Branching Time Active Inference: the theory and its generality](https://mlsanity.com/paper/2111.11107/) (2021)
- [On efficient computation in active inference](https://mlsanity.com/paper/2307.00504/) (2023)
- [An empirical evaluation of active inference in multi-armed bandits](https://mlsanity.com/paper/2101.08699/) (2021)
- [R-AIF: Solving Sparse-Reward Robotic Tasks from Pixels with Active Inference and World Models](https://mlsanity.com/paper/2409.14216/) (2024)
- [Expected Free Energy-based Planning as Variational Inference](https://mlsanity.com/paper/2504.14898/) (2025)
- [Branching Time Active Inference: empirical study and complexity class analysis](https://mlsanity.com/paper/2111.11276/) (2021)
- [Supervised structure learning](https://mlsanity.com/paper/2311.10300/) (2023)
- [Active Inference for Stochastic Control](https://mlsanity.com/paper/2108.12245/) (2021)
- [Active Inference and Epistemic Value in Graphical Models](https://mlsanity.com/paper/2109.00541/) (2021)
- [Interpreting Dynamical Systems as Bayesian Reasoners](https://mlsanity.com/paper/2112.13523/) (2021)
- [Geometric Methods for Sampling, Optimisation, Inference and Adaptive Agents](https://mlsanity.com/paper/2203.10592/) (2022)
- [A Message Passing Realization of Expected Free Energy Minimization](https://mlsanity.com/paper/2508.02197/) (2025)
- [ODAR: Principled Adaptive Routing for LLM Reasoning via Active Inference](https://mlsanity.com/paper/2602.23681/) (2026)
- [Realising Synthetic Active Inference Agents, Part I: Epistemic Objectives and Graphical Specification Language](https://mlsanity.com/paper/2306.08014/) (2023)
- [Integrating cognitive map learning and active inference for planning in ambiguous environments](https://mlsanity.com/paper/2308.08307/) (2023)
- [Active Inference and Intentional Behaviour](https://mlsanity.com/paper/2312.07547/) (2023)
- [On Predictive planning and counterfactual learning in active inference](https://mlsanity.com/paper/2403.12417/) (2024)
- [Value of Information and Reward Specification in Active Inference and POMDPs](https://mlsanity.com/paper/2408.06542/) (2024)
- [Active Inference and Human--Computer Interaction](https://mlsanity.com/paper/2412.14741/) (2024)
- [Bounded rationality for relaxing best response and mutual consistency: The Quantal Hierarchy model of decision-making](https://mlsanity.com/paper/2106.15844/) (2021)
- [Successor Representation Active Inference](https://mlsanity.com/paper/2207.09897/) (2022)
- [Toward Design of Synthetic Active Inference Agents by Mere Mortals](https://mlsanity.com/paper/2307.14145/) (2023)
- [Possible Principles for Aligned Structure Learning Agents](https://mlsanity.com/paper/2410.00258/) (2024)
- [Active inference and artificial reasoning](https://mlsanity.com/paper/2512.21129/) (2025)
- [Active Inference Tree Search in Large POMDPs](https://mlsanity.com/paper/2103.13860/) (2021)

## Abstract (arXiv)

Active inference offers a first principle account of sentient behaviour, from which special and important cases can be derived, e.g., reinforcement learning, active learning, Bayes optimal inference, Bayes optimal design, etc. Active inference resolves the exploitation-exploration dilemma in relation to prior preferences, by placing information gain on the same footing as reward or value. In brief, active inference replaces value functions with functionals of (Bayesian) beliefs, in the form of an expected (variational) free energy. In this paper, we consider a sophisticated kind of active inference, using a recursive form of expected free energy. Sophistication describes the degree to which an agent has beliefs about beliefs. We consider agents with beliefs about the counterfactual consequences of action for states of affairs and beliefs about those latent states. In other words, we move from simply considering beliefs about 'what would happen if I did that' to 'what would I believe about what would happen if I did that'. The recursive form of the free energy functional effectively implements a deep tree search over actions and outcomes in the future. Crucially, this search is over sequences of belief states, as opposed to states per se. We illustrate the competence of this scheme, using numerical simulations of deep decision problems.