mlsanityData to 7 Oct 2026

The free energy principle for action and perception: A mathematical review

arXiv 1705.09156 ↗First posted 24 May 2017q-bio.NCcited by 66

Not on the map. Why?

Abstract (arXiv)

The 'free energy principle' (FEP) has been suggested to provide a unified theory of the brain, integrating data and theory relating to action, perception, and learning. The theory and implementation of the FEP combines insights from Helmholtzian 'perception as inference', machine learning theory, and statistical thermodynamics. Here, we provide a detailed mathematical evaluation of a suggested biologically plausible implementation of the FEP that has been widely used to develop the theory. Our objectives are (i) to describe within a single article the mathematical structure of this implementation of the FEP; (ii) provide a simple but complete agent-based model utilising the FEP; (iii) disclose the assumption structure of this implementation of the FEP to help elucidate its significance for the brain sciences.

Key facts. Cited by 66 papers in the map (data through 7 Oct 2026). First posted on arXiv 24 May 2017.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 17; 2022: 18; 2023: 9; 2024: 6; 2025: 11; 2026: 5.

66 papers.

Sort:

By area:

  1. 2022RL with KL penalties is better viewed as Bayesian inferencecited by 130
  2. 2022On Reinforcement Learning and Distribution Matching for Fine-Tuning Language Models with no Catastrophic Forgettingcited by 80
  3. 2021Predictive Coding: a Theoretical and Experimental Reviewcited by 74
  4. 2021Active Inference in Robotics and Artificial Agents: Survey and Challengescited by 52
  5. 2022Predictive Coding: Towards a Future of Deep Learning beyond Backpropagation?cited by 45
  6. 2023World Models and Predictive Coding for Cognitive and Developmental Robotics: Frontiers and Challengescited by 35
  7. 2022Backpropagation at the Infinitesimal Inference Limit of Energy-Based Models: Unifying Predictive Coding, Equilibrium Propagation, and Contrastive Hebbian Learningcited by 26
  8. 2022Hybrid Predictive Coding: Inferring, Fast and Slowcited by 25
  9. 2022The Free Energy Principle for Perception and Action: A Deep Learning Perspectivecited by 24
  10. 2021Multimodal VAE Active Inference Controllercited by 21
  11. 2022A Stable, Fast, and Fully Automatic Learning Algorithm for Predictive Coding Networkscited by 21
  12. 2021On the relationship between predictive coding and backpropagationcited by 20
38 more
  1. 2022A Theoretical Framework for Inference and Learning in Predictive Coding Networkscited by 16
  2. 2022Predictive Coding beyond Gaussian Distributionscited by 16
  3. 2023CASP-Net: Rethinking Video Saliency Prediction from an Audio-VisualConsistency Perceptual Perspectivecited by 15
  4. 2021Applications of the Free Energy Principle to Machine Learning and Neurosciencecited by 9
  5. 2023Predictive Coding as a Neuromorphic Alternative to Backpropagation: A Critical Evaluationcited by 8
  6. 2022Complex behavior from intrinsic motivation to occupy action-state path spacecited by 7
  7. 2024Predictive Coding Networks and Inference Learning: Tutorial and Surveycited by 7
  8. 2021Bayesian brains and the R'enyi divergencecited by 6
  9. 2021Adaptation through prediction: multisensory active inference torque controlcited by 6
  10. 2021Neuroscience-inspired perception-action in robotics: applying active inference for state estimation, control and self-perceptioncited by 5
  11. 2022Preventing Deterioration of Classification Accuracy in Predictive Coding Networkscited by 5
  12. 2022On the Relationship Between Variational Inference and Auto-Associative Memorycited by 4
  13. 2023Attention: Marginal Probability is All You Need?cited by 4
  14. 2021An active inference model of collective intelligencecited by 3
  15. 2021Habitual and Reflective Control in Hierarchical Predictive Codingcited by 3
  16. 2021Towards Stochastic Fault-tolerant Control using Precision Learning and Active Inferencecited by 3
  17. 2021PredProp: Bidirectional Stochastic Optimization with Precision Weighted Predictive Codingcited by 3
  18. 2022Successor Representation Active Inferencecited by 3
  19. 2022Free energy model of emotional valence in dual-process perceptionscited by 3
  20. 2023Curvature-Sensitive Predictive Coding with Approximate Laplace Monte Carlocited by 3
  21. 2023Utility Theory based Cognitive Modeling in the Application of Robotics: A Surveycited by 3
  22. 2024Possible Principles for Aligned Structure Learning Agentscited by 3
  23. 2021Bidirectional Interaction between Visual and Motor Generative Models using Predictive Coding and Active Inferencecited by 2
  24. 2022Compositional Active Inference II: Polynomial Dynamics. Approximate Inference Doctrinescited by 2
  25. 2022A Neural Active Inference Model of Perceptual-Motor Learningcited by 2
  26. 2023Stochastic Surprisal: An inferential measurement of Free Energy in Neural Networkscited by 2
  27. 2025Bayesian Predictive Codingcited by 2
  28. 2025Adaptive Bayesian Single-Shot Quantum Sensingcited by 2
  29. 2025The Missing Reward: Active Inference in the Era of Experiencecited by 2
  30. 2026On the Infinite Width and Depth Limits of Predictive Coding Networkscited by 2
  31. 2021Realising Active Inference in Variational Message Passing: the Outcome-blind Certainty Seekercited by 1
  32. 2021A Predictive Coding Account for Chaotic Itinerancycited by 1
  33. 2021A Unified View of Algorithms for Path Planning Using Probabilistic Inference on Factor Graphscited by 1
  34. 2021A Mathematical Walkthrough and Discussion of the Free Energy Principlecited by 1
  35. 2022Mapping Husserlian phenomenology onto active inferencecited by 1
  36. 2023Learning in Deep Factor Graphs with Gaussian Belief Propagationcited by 1
  37. 2023Modeling arousal potential of epistemic emotions using Bayesian information gain: Inquiry cycle driven by free energy fluctuationscited by 1
  38. 2024Active Inference for Self-Organizing Multi-LLM Systems: A Bayesian Thermodynamic Approach to Adaptationcited by 1

50 most cited of 66 All 66 (JSON)