Atomic Units of X: The Compression Layer of Intelligence
Not on the map. Why?
Abstract (arXiv)
This paper proposes a theoretical and empirical framework for understanding intelligence as a process of atomic compression and compositional reuse. It argues that scalable cognitive, biological, computational, and organisational systems reduce complexity by organising information into reusable units that can be recombined into higher-order structures. The central contribution is the Compression Calculus, a formal framework for comparing surface evidence with atomic representations and for describing how abstraction can compound across layers. The framework is evaluated on large, multi-source software corpora under an open-world concept model, showing substantial evidence-to-concept consolidation in two large projects, while a smaller third project remains below the target threshold. The analysis further identifies important boundary conditions: consolidation depends on corpus scale, evidence-unit definition, and concept identity, and the observed reduction is driven primarily by within-corpus recurrence rather than cross-source recurrence. The paper also develops a representational account of the meaning gap in contemporary generative systems, describing latent, context-dependent conceptual approximations as soft atoms that lack the persistent identity and compositional constraints of stable atomic units. This motivates an architectural view in which large language models function as dynamic fusion engines that navigate and compose persistent conceptual structures rather than serving as the sole repository of those structures.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 20 of its 66 references that are in the map. First posted on arXiv 14 Jul 2026.
Builds on
20 of 66 references.
References · 20
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
- 2020Scaling Laws for Neural Language Modelscited by 6,586
- 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,182
- 2023Self-RAG: Learning to Retrieve, Generate, and Critique through Self-Reflectioncited by 1,839
- 2023Gorilla: Large Language Model Connected with Massive APIscited by 1,332
- 2019BERT Rediscovers the Classical NLP Pipelinecited by 1,059
- 2020A Primer in BERTology: What we know about how BERT workscited by 815
- 2024RAPTOR: Recursive Abstractive Processing for Tree-Organized Retrievalcited by 532
- 2020Efficient Intent Detection with Dual Sentence Encoderscited by 433
- 2019An Evaluation Dataset for Intent Classification and Out-of-Scope Predictioncited by 386
- 2020Neurosymbolic AI: The 3rd Wavecited by 255
8 more
- 2023Language Modeling Is Compressioncited by 225
- 2020Logic Tensor Networkscited by 199
- 2022MASSIVE: A 1M-Example Multilingual Natural Language Understanding Dataset with 51 Typologically-Diverse Languagescited by 146
- 2023Modular Deep Learningcited by 83
- 2020Compositional Generalization via Neural-Symbolic Stack Machinescited by 80
- 2022A Neuro-vector-symbolic Architecture for Solving Raven's Progressive Matricescited by 64
- 2023LILO: Learning Interpretable Libraries by Compressing and Documenting Codecited by 49
- 2023Modularity in Deep Learning: A Surveycited by 3
Built on by
Not cited yet.