Natural Language Syntax Complies with the Free-Energy Principle
Not on the map. Why?
Abstract (arXiv)
Natural language syntax yields an unbounded array of hierarchically structured expressions. We claim that these are used in the service of active inference in accord with the free-energy principle (FEP). While conceptual advances alongside modelling and simulation work have attempted to connect speech segmentation and linguistic communication with the FEP, we extend this program to the underlying computations responsible for generating syntactic objects. We argue that recently proposed principles of economy in language design - such as "minimal search" criteria from theoretical syntax - adhere to the FEP. This affords a greater degree of explanatory power to the FEP - with respect to higher language functions - and offers linguistics a grounding in first principles with respect to computability. We show how both tree-geometric depth and a Kolmogorov complexity estimate (recruiting a Lempel-Ziv compression algorithm) can be used to accurately predict legal operations on syntactic workspaces, directly in line with formulations of variational free energy minimization. This is used to motivate a general principle of language design that we term Turing-Chomsky Compression (TCC). We use TCC to align concerns of linguists with the normative account of self-organization furnished by the FEP, by marshalling evidence from theoretical linguistics and psycholinguistics to ground core principles of efficient syntactic computation within active inference.
Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). Builds on 7 of its 292 references that are in the map. First posted on arXiv 27 Oct 2022.
Builds on
7 of 292 references.
References · 7
- 2014Deep Learning in Neural Networks: An Overviewcited by 765
- 2019A World unto Itself: Human Communication as Active Inferencecited by 11
- 2018How Robust are Deep Neural Networks?cited by 10
- 2019Topological Analysis of Syntactic Structurescited by 9
- 2017Language Design as Information Renormalizationcited by 6
- 2020Neural dynamics under active inference: plausibility and efficiency of information processingcited by 5
- 2013LT^2C^2: A language of thought with Turing-computable Kolmogorov complexitycited by 1
Built on by
Citing papers per year: 2023: 1; 2024: 2; 2025: 2; 2026: 2.
7 papers.
- 2023A Sentence is Worth a Thousand Pictures: Can Large Language Models Understand Hum4n L4ngu4ge and the W0rld behind W0rds?cited by 17
- 2024Syntactic Language Change in English and German: Metrics, Parsers, and Convergencescited by 3
- 2024A Comparative Investigation of Compositional Syntax and Semantics in DALL-E 2cited by 2
- 2026Neurocomputational Mechanisms of Syntactic Transfer in Bilingual Sentence Productioncited by 1
- 2025Merge-based syntax is mediated by distinct neurocognitive mechanisms: A clustering analysis of comprehension abilities in 84,000 individuals with language deficits across nine languagescited by 0
- 2025Graph Distance as Surprise: Free Energy Minimization in Knowledge Graph Reasoningcited by 0
- 2026A Game Theoretic Free Energy Analysis of Higher Order Synergy in Attention Heads of Large Language Modelscited by 0
- 2026A Game Theoretic Free Energy Analysis of Higher Order Synergy in Attention Heads of Large Language Models10 May 2026
- 2026Neurocomputational Mechanisms of Syntactic Transfer in Bilingual Sentence Production26 Jan 2026
- 2025Graph Distance as Surprise: Free Energy Minimization in Knowledge Graph Reasoning1 Dec 2025
- 2025Merge-based syntax is mediated by distinct neurocognitive mechanisms: A clustering analysis of comprehension abilities in 84,000 individuals with language deficits across nine languages4 Aug 2025
- 2024A Comparative Investigation of Compositional Syntax and Semantics in DALL-E 218 Mar 2024
- 2024Syntactic Language Change in English and German: Metrics, Parsers, and Convergences18 Feb 2024
- 2023A Sentence is Worth a Thousand Pictures: Can Large Language Models Understand Hum4n L4ngu4ge and the W0rld behind W0rds?26 Jul 2023