A Message Passing Realization of Expected Free Energy Minimization
Not on the map. Why?
Abstract (arXiv)
We present a message passing approach to Expected Free Energy (EFE) minimization on factor graphs, based on the theory introduced in arXiv:2504.14898. By reformulating EFE minimization as Variational Free Energy minimization with epistemic priors, we transform a combinatorial search problem into a tractable inference problem solvable through standard variational techniques. Applying our message passing method to factorized state-space models enables efficient policy inference. We evaluate our method on environments with epistemic uncertainty: a stochastic gridworld and a partially observable Minigrid task. Agents using our approach consistently outperform conventional KL-control agents on these tasks, showing more robust planning and efficient exploration under uncertainty. In the stochastic gridworld environment, EFE-minimizing agents avoid risky paths, while in the partially observable minigrid setting, they conduct more systematic information-seeking. This approach bridges active inference theory with practical implementations, providing empirical evidence for the efficiency of epistemic priors in artificial agents.
Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Builds on 13 of its 39 references that are in the map. First posted on arXiv 4 Aug 2025.
Builds on
13 of 39 references.
References · 13
- 2016Variational Inference: A Review for Statisticianscited by 1,472
- 2018Reinforcement Learning and Control as Probabilistic Inference: Tutorial and Reviewcited by 482
- 2023Minigrid & Miniworld: Modular & Customizable Reinforcement Learning Environments for Goal-Oriented Taskscited by 327
- 2020Active inference on discrete state-spaces: a synthesiscited by 92
- 2020Sophisticated Inferencecited by 56
- 2021Reactive Message Passing for Scalable Bayesian Inferencecited by 16
- 2021Branching Time Active Inference: the theory and its generalitycited by 15
- 2023On efficient computation in active inferencecited by 15
- 2024Active Inference as a Model of Agencycited by 12
- 2025Expected Free Energy-based Planning as Variational Inferencecited by 10
- 2024What type of inference is planning?cited by 9
- 2021Active Inference for Stochastic Controlcited by 6
Built on by
Citing papers per year: 2025: 1; 2026: 4.
5 papers.
- 2026Active Inference for Physical AI Agents -- An Engineering Perspectivecited by 2
- 2026What Type of Inference is Active Inference?cited by 2
- 2025Active Inference is a Subtype of Variational Inferencecited by 0
- 2026Sophisticated Policies from Epistemic Priorscited by 0
- 2026Expected free energy as an information constraint on the Bethe Lagrangiancited by 0
- 2026Expected free energy as an information constraint on the Bethe Lagrangian17 Aug 2026
- 2026Sophisticated Policies from Epistemic Priors21 Jul 2026
- 2026What Type of Inference is Active Inference?3 Jun 2026
- 2026Active Inference for Physical AI Agents -- An Engineering Perspective21 Mar 2026
- 2025Active Inference is a Subtype of Variational Inference24 Nov 2025