mlsanityData to 14 Oct 2026

Information as Maximum-Caliber Deviation: A bridge between Integrated Information Theory and the Free Energy Principle

arXiv 2605.12536 ↗First posted 3 May 2026q-bio.NC cs.AI cs.ITcited by 0

Not on the map. Why?

Abstract (arXiv)

The Free Energy Principle (FEP) is a leading framework for mathematically modeling self-organization and learning, while Integrated Information Theory (IIT) is a computational ontology of consciousness oriented around irreducible cause and effect. While conceptual unifications have been proposed and appear to be supported by empirical findings, the absence of a rigorous mathematical mapping places upper bounds on their precision and testability. This work proposes that information can be defined as the deviation psi of realized dynamics from a constrained maximum-caliber (MaxCal) path ensemble over a finite time horizon. Under this definition, each of the cause/effect repertoires central to IIT 3.0 emerge directly from MaxCal variational principles, allowing IIT's phenomenological calculus to be re-derived from constrained entropy-maximization (CMEP). This framework supplies a theoretical bridge to active inference, which is mathematically dual to CMEP under Langevin dynamics, and offers a principled route for extending IIT to new dynamical regimes. When the approach is applied under the Central Limit Theorem (CLT) for Markov chains and via large deviations theory (LDT) to Ising models, information psi is shown to be equivalent to prediction error under accompanying predictive coding models. This may hold relevance to the ``hill-shaped trajectory'' of Phi observed in neuronal cultures adapting to sensory inputs. Together, these results provide a physically and mathematically grounded rationale for studying the convergence of FEP, IIT, and thermodynamic frameworks of cognition such as recent work grounding consciousness in violations of the Fluctuation-Dissipation Theorem (FDT).

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 26 of its 422 references that are in the map. First posted on arXiv 3 May 2026.

Builds on

26 of 422 references.

References · 26

  1. 2013Auto-Encoding Variational Bayescited by 4,053
  2. 2015Variational Inference with Normalizing Flowscited by 2,170
  3. 2018Learning deep representations by mutual information estimation and maximizationcited by 1,273
  4. 2015Deep Learning and the Information Bottleneck Principlecited by 802
  5. 2016Exponential expressivity in deep neural networks through transient chaoscited by 261
  6. 2016Exploring the Limits of Language Modelingcited by 173
  7. 2021Predictive Coding: a Theoretical and Experimental Reviewcited by 77
  8. 2018Yes, but Did It Work?: Evaluating Variational Inferencecited by 53
  9. 2019Deep Active Inference as Variational Policy Gradientscited by 53
  10. 2019Where is the Information in a Deep Neural Network?cited by 42
  11. 2016Variational Boosting: Iteratively Refining Posterior Approximationscited by 37
  12. 2021The edge of chaos: quantum field theory and deep neural networkscited by 24
14 more
  1. 2025Action-Minimization Meets Generative Modeling: Efficient Transition Path Sampling with the Onsager-Machlup Functionalcited by 20
  2. 2024Posterior and variational inference for deep neural networks with heavy-tailed weightscited by 10
  3. 2018Measuring Integrated Information: Comparison of Candidate Measures in Theory and Simulationcited by 7
  4. 2023Online Variational Sequential Monte Carlocited by 5
  5. 2019Beyond integrated information: A taxonomy of information dynamics phenomenacited by 3
  6. 2021The Closure of the Physical, Consciousness and Scientific Practicecited by 2
  7. 2022Unbiased Active Inference for Classical Controlcited by 2
  8. 2024Free Energy Projective Simulation (FEPS): Active inference with interpretabilitycited by 2
  9. 2025Integrated Information Theory: A Consciousness-First Approach to What Existscited by 2
  10. 2020A Non-equilibrium Thermodynamic Framework of Consciousnesscited by 1
  11. 2022Only what exists can cause: An intrinsic powers view of free willcited by 1
  12. 2024On the linear scaling of entropy vs. energy in human brain activity, the Hagedorn temperature and the Zipf lawcited by 1
  13. 2025Understanding the Trade-offs in Accuracy and Uncertainty Quantification: Architecture and Inference Choices in Bayesian Neural Networkscited by 1
  14. 2025Integrated information and predictive processing theories of consciousness: An adversarial collaborative reviewcited by 1

Built on by

Not cited yet.