mlsanityData to 7 Oct 2026

Thermodynamic Limits of Physical Intelligence

arXiv 2602.05463 ↗First posted 5 Feb 2026cs.LG cs.AI cs.ITcited by 0

Not on the map. Why?

Abstract (arXiv)

Modern AI systems achieve remarkable capabilities at the cost of substantial energy consumption. To connect intelligence to physical efficiency, we propose two complementary bits-per-joule metrics under explicit accounting conventions: (1) Thermodynamic Epiplexity per Joule, new bits of structure about a specified environment-instance variable encoded in an agent's state per unit energy, and (2) Empowerment per Joule, sensorimotor channel capacity per expected energetic cost over a fixed horizon. These give two axes of physical intelligence, recognition versus control, but the resulting numbers are benchmark-relative rather than universal. Drawing on stochastic thermodynamics, we formulate a Landauer-scale closed-cycle benchmark for epiplexity acquisition by combining a thermodynamic-learning inequality with data processing, and clarify why boundary closure is required; conversely, a decoupling construction shows that without such assumptions information gain and in-boundary dissipation need not be tightly linked. For empirical settings where the latent structure variable is unavailable, we recommend compute-bounded MDL epiplexity / compression-gain surrogates. Finally, we propose a unified efficiency framework with a minimal checklist of conventions for relative bits-per-joule comparisons, and give a compact language-model reporting example.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 6 of its 17 references that are in the map. First posted on arXiv 5 Feb 2026.

Builds on

6 of 17 references.

References · 6

  1. 2023Pythia: A Suite for Analyzing Large Language Models Across Training and Scalingcited by 1,734
  2. 2026From Entropy to Epiplexity: Rethinking Information for Computationally Bounded Intelligencecited by 39
  3. 2024Transformers As Approximations of Solomonoff Inductioncited by 6
  4. 2025Large Language Models as Computable Approximations to Solomonoff Inductioncited by 6
  5. 2025Universal AI maximizes Variational Empowermentcited by 2
  6. 2023Scenarios and branch points to future machine intelligencecited by 1

Built on by

Not cited yet.