Why We Care About Understanding: Competence through Predictive Compression
Not on the map. Why?
Abstract (arXiv)
What is the relation between understanding and compression, and why does human understanding take such a heavily compressed form? Across information theory, machine learning, and AI research, a substantial tradition identifies understanding with compression-a thought captured in Gregory Chaitin's dictum that "comprehension is compression." Philosophers, by contrast, have characterized understanding in terms of grasping connections, giving explanations, and handling novelty. This paper bridges the two pictures through three interlocking theses. The first concerns the concept of understanding: it serves as an efficient proxy for a distinctive form of robust competence, enabling us to identify whom to trust and whom to learn from. The second concerns the state of understanding: to understand a domain is to possess a mental model of its relational structure that enables prediction, and what enables prediction enables compression, because what becomes predictable need not be stored separately. Compression is therefore not identical with comprehension, but its representational shadow. The third concerns the characteristically human form of understanding: the fiduciary and transmission functions highlighted by the first thesis impose pressures of demonstrability and transmissibility that drive human understanding toward principled simplicity. The resulting framework explains both the appeal and the limits of compressionist accounts of understanding while shedding light on the inscrutability of AI systems.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 6 of its 74 references that are in the map. First posted on arXiv 4 Sep 2026.
Builds on
6 of 74 references.
References · 6
- 2023Language Modeling Is Compressioncited by 225
- 2025Tracing the Representation Geometry of Language Models from Pretraining to Post-trainingcited by 35
- 2025From Tokens to Thoughts: How LLMs and Humans Trade Compression for Meaningcited by 25
- 2021From Kepler to Newton: Explainable AI for Sciencecited by 13
- 2026A Model of Understanding in Deep Learning Systemscited by 2
- 2025Noumenal Labs White Paper: How To Build A Braincited by 1
Built on by
Not cited yet.