On the Relationship Between Active Inference and Control as Inference
Not on the map. Why?
Abstract (arXiv)
Active Inference (AIF) is an emerging framework in the brain sciences which suggests that biological agents act to minimise a variational bound on model evidence. Control-as-Inference (CAI) is a framework within reinforcement learning which casts decision making as a variational inference problem. While these frameworks both consider action selection through the lens of variational inference, their relationship remains unclear. Here, we provide a formal comparison between them and demonstrate that the primary difference arises from how value is incorporated into their respective generative models. In the context of this comparison, we highlight several ways in which these frameworks can inform one another.
Key facts. Cited by 42 papers in the map (data through 7 Oct 2026). First posted on arXiv 23 Jun 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 12; 2022: 6; 2023: 5; 2024: 7; 2025: 5; 2026: 7.
42 papers.
Sort:
By area:
- 2021Active Inference in Robotics and Artificial Agents: Survey and Challengescited by 52
- 2022Predictive Coding: Towards a Future of Deep Learning beyond Backpropagation?cited by 45
- 2022pymdp: A Python library for active inference in discrete state spacescited by 39
- 2023World Models and Predictive Coding for Cognitive and Developmental Robotics: Frontiers and Challengescited by 35
- 2026Maximum Likelihood Reinforcement Learningcited by 29
- 2022Hybrid Predictive Coding: Inferring, Fast and Slowcited by 25
- 2022The Free Energy Principle for Perception and Action: A Deep Learning Perspectivecited by 24
- 2021Multimodal VAE Active Inference Controllercited by 21
- 2021Contrastive Active Inferencecited by 21
- 2023On efficient computation in active inferencecited by 15
- 2024Active Inference as a Model of Agencycited by 12
- 2021Understanding the Origin of Information-Seeking Exploration in Probabilistic Objectives for Controlcited by 10
30 more
- 2023A Unified View on Solving Objective Mismatch in Model-Based Reinforcement Learningcited by 9
- 2021Active Inference for Stochastic Controlcited by 6
- 2021Adaptation through prediction: multisensory active inference torque controlcited by 6
- 2021Chance-Constrained Active Inferencecited by 5
- 2021A Whole Brain Probabilistic Generative Model: Toward Realizing Cognitive Architectures for Developmental Robotscited by 4
- 2024Value of Information and Reward Specification in Active Inference and POMDPscited by 4
- 2021Online reinforcement learning with sparse rewards through an active inference capsulecited by 3
- 2021Towards Stochastic Fault-tolerant Control using Precision Learning and Active Inferencecited by 3
- 2022Successor Representation Active Inferencecited by 3
- 2023Habits and goals in synergy: a variational Bayesian framework for behaviorcited by 3
- 2021A Unified View of Algorithms for Path Planning Using Probabilistic Inference on Factor Graphscited by 1
- 2023Life-inspired Interoceptive Artificial Intelligence for Autonomous and Adaptive Agentscited by 1
- 2024Limitations of Agents Simulated by Predictive Modelscited by 1
- 2025Emergence of Goal-Directed Behaviors via Active Inference with Self-Priorcited by 1
- 2026Active Inference as a Convex Markov Decision Processcited by 1
- 2021On Solving a Stochastic Shortest-Path Markov Decision Process as Probabilistic Inferencecited by 0
- 2022Efficient search of active inference policy spaces using k-meanscited by 0
- 2024Deep hybrid models: infer and plan in a dynamic worldcited by 0
- 2024When in Doubt, Think Slow: Iterative Reasoning with Latent Imaginationcited by 0
- 2024Hybrid Recurrent Models Support Emergent Descriptions for Hierarchical Planning and Controlcited by 0
- 2024Learning in Hybrid Active Inference Modelscited by 0
- 2025A memory-based active inference model of DishBrain-like adaptive behaviourcited by 0
- 2025Is the `Agent' Paradigm a Limiting Framework for Next-Generation Intelligent Systems?cited by 0
- 2025Graph Distance as Surprise: Free Energy Minimization in Knowledge Graph Reasoningcited by 0
- 2025EcoNet: Multiagent Planning and Control Of Household Energy Resources Using Active Inferencecited by 0
- 2026Distributional Active Inferencecited by 0
- 2026Mind Dreamer: Untethering Imagination via Active Causal Intervention on Latent Manifoldscited by 0
- 2026Expected Free Energy as Belief-Dependent Utility for rho-POMDPscited by 0
- 2026Generalised Bellman recurrence and three dualities in sequential decision-makingcited by 0
- 2026Active Inference as Context Acquisition for AI Agentscited by 0
- 2026Active Inference as a Convex Markov Decision Process22 Jul 2026
- 2026Generalised Bellman recurrence and three dualities in sequential decision-making20 Jul 2026
- 2026Expected Free Energy as Belief-Dependent Utility for rho-POMDPs18 Jul 2026
- 2026Active Inference as Context Acquisition for AI Agents8 Jun 2026
- 2026Mind Dreamer: Untethering Imagination via Active Causal Intervention on Latent Manifolds15 May 2026
- 2026Maximum Likelihood Reinforcement Learning2 Feb 2026
- 2026Distributional Active Inference28 Jan 2026
- 2025EcoNet: Multiagent Planning and Control Of Household Energy Resources Using Active Inference14 Dec 2025
- 2025Graph Distance as Surprise: Free Energy Minimization in Knowledge Graph Reasoning1 Dec 2025
- 2025Is the `Agent' Paradigm a Limiting Framework for Next-Generation Intelligent Systems?13 Sep 2025
- 2025A memory-based active inference model of DishBrain-like adaptive behaviour9 Aug 2025
- 2025Emergence of Goal-Directed Behaviors via Active Inference with Self-Prior15 Apr 2025
30 more
- 2024Learning in Hybrid Active Inference Models2 Sep 2024
- 2024Hybrid Recurrent Models Support Emergent Descriptions for Hierarchical Planning and Control20 Aug 2024
- 2024Value of Information and Reward Specification in Active Inference and POMDPs13 Aug 2024
- 2024When in Doubt, Think Slow: Iterative Reasoning with Latent Imagination23 Feb 2024
- 2024Limitations of Agents Simulated by Predictive Models8 Feb 2024
- 2024Deep hybrid models: infer and plan in a dynamic world1 Feb 2024
- 2024Active Inference as a Model of Agency23 Jan 2024
- 2023A Unified View on Solving Objective Mismatch in Model-Based Reinforcement Learning10 Oct 2023
- 2023Life-inspired Interoceptive Artificial Intelligence for Autonomous and Adaptive Agents12 Sep 2023
- 2023On efficient computation in active inference2 Jul 2023
- 2023Habits and goals in synergy: a variational Bayesian framework for behavior11 Apr 2023
- 2023World Models and Predictive Coding for Cognitive and Developmental Robotics: Frontiers and Challenges14 Jan 2023
- 2022Efficient search of active inference policy spaces using k-means6 Sep 2022
- 2022Successor Representation Active Inference20 Jul 2022
- 2022The Free Energy Principle for Perception and Action: A Deep Learning Perspective13 Jul 2022
- 2022Hybrid Predictive Coding: Inferring, Fast and Slow5 Apr 2022
- 2022Predictive Coding: Towards a Future of Deep Learning beyond Backpropagation?18 Feb 2022
- 2022pymdp: A Python library for active inference in discrete state spaces11 Jan 2022
- 2021Adaptation through prediction: multisensory active inference torque control13 Dec 2021
- 2021Active Inference in Robotics and Artificial Agents: Survey and Challenges3 Dec 2021
- 2021Contrastive Active Inference19 Oct 2021
- 2021Towards Stochastic Fault-tolerant Control using Precision Learning and Active Inference13 Sep 2021
- 2021On Solving a Stochastic Shortest-Path Markov Decision Process as Probabilistic Inference13 Sep 2021
- 2021Active Inference for Stochastic Control27 Aug 2021
- 2021A Unified View of Algorithms for Path Planning Using Probabilistic Inference on Factor Graphs19 Jun 2021
- 2021Online reinforcement learning with sparse rewards through an active inference capsule4 Jun 2021
- 2021A Whole Brain Probabilistic Generative Model: Toward Realizing Cognitive Architectures for Developmental Robots15 Mar 2021
- 2021Understanding the Origin of Information-Seeking Exploration in Probabilistic Objectives for Control11 Mar 2021
- 2021Multimodal VAE Active Inference Controller7 Mar 2021
- 2021Chance-Constrained Active Inference17 Feb 2021
- 2021Active Inference in Robotics and Artificial Agents: Survey and Challengescited by 52
- 2022Predictive Coding: Towards a Future of Deep Learning beyond Backpropagation?cited by 45
- 2022pymdp: A Python library for active inference in discrete state spacescited by 39
- 2026Maximum Likelihood Reinforcement Learningcited by 29
- 2022Hybrid Predictive Coding: Inferring, Fast and Slowcited by 25
- 2022The Free Energy Principle for Perception and Action: A Deep Learning Perspectivecited by 24
- 2021Multimodal VAE Active Inference Controllercited by 21
- 2021Contrastive Active Inferencecited by 21
- 2023On efficient computation in active inferencecited by 15
- 2021Understanding the Origin of Information-Seeking Exploration in Probabilistic Objectives for Controlcited by 10
- 2023A Unified View on Solving Objective Mismatch in Model-Based Reinforcement Learningcited by 9
- 2021Active Inference for Stochastic Controlcited by 6
12 most cited of 36 All 36 (JSON)
- 2026Active Inference as a Convex Markov Decision Process22 Jul 2026
- 2026Generalised Bellman recurrence and three dualities in sequential decision-making20 Jul 2026
- 2026Expected Free Energy as Belief-Dependent Utility for rho-POMDPs18 Jul 2026
- 2026Mind Dreamer: Untethering Imagination via Active Causal Intervention on Latent Manifolds15 May 2026
- 2026Maximum Likelihood Reinforcement Learning2 Feb 2026
- 2026Distributional Active Inference28 Jan 2026
- 2025EcoNet: Multiagent Planning and Control Of Household Energy Resources Using Active Inference14 Dec 2025
- 2025Graph Distance as Surprise: Free Energy Minimization in Knowledge Graph Reasoning1 Dec 2025
- 2025A memory-based active inference model of DishBrain-like adaptive behaviour9 Aug 2025
- 2025Emergence of Goal-Directed Behaviors via Active Inference with Self-Prior15 Apr 2025
- 2024Learning in Hybrid Active Inference Models2 Sep 2024
- 2024Hybrid Recurrent Models Support Emergent Descriptions for Hierarchical Planning and Control20 Aug 2024
12 newest of 36 All 36 (JSON)