Psychosis involves a deficit of information compression in connected speech
Not on the map. Why?
Abstract (arXiv)
Large language models (LLMs) with human-like performance on linguistic tasks have transformed the study of language in neurodiverse conditions. LLMs provide representations of linguistic input in the form of high-dimensional vectors (embeddings), and next-token predictions computed from these embeddings. Previous crosslinguistic evidence suggests a complexity reduction in the form of both lower intrinsic dimensionality (ID) of LLM representations and higher mean surprisal (prediction error) in psychosis. We hypothesized that these metrics reflect a general deficit of information compression in psychosis, linked to grammatical organization as what enables predictions in language.We operationalized surprisal difference as the difference between surprisal as estimated from word frequency and surprisal as based on a contextual LM, which is sensitive to grammatical organization over and above lexical concepts. Using a dataset of 144 Turkish speakers, including 106 patients with schizophrenia-spectrum disorders (SSD) - 56 with chronic schizophrenia (SZH), 33 with first-episode psychosis (FEP), and 17 with schizoaffective disorder (SZA) - and 38 healthy controls. We report: (1) Surprisal difference is attenuated in all clinical groups relative to controls, independently of word count; (2) Compressibility (intrinsic dimension) is reduced in SZH and FEP; (3) Syntactic complexity and compressibility both predict surprisal difference. These results, further refining an alteration in the geometry of the semantic space in psychosis as previously attested, suggest a broader deficit in information compression in this disorder, with a mechanistic underpinning in the operations of grammar.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 13 of its 36 references that are in the map. First posted on arXiv 14 Sep 2026.
Builds on
13 of 36 references.
References · 13
- 2018Estimating the intrinsic dimension of datasets by a minimal neighborhood informationcited by 246
- 2022Training Trajectories of Language Models Across Scalescited by 80
- 2021Scikit-dimension: a Python package for intrinsic dimension estimationcited by 68
- 2021Interpreting neural computations by examining intrinsic and embedding dimensionality of neural activitycited by 24
- 2022DADApy: Distance-based Analysis of DAta-manifolds in Pythoncited by 22
- 2020The optimality of syntactic dependency distancescited by 15
- 2024Entropy and type-token ratio in gigaword corporacited by 6
- 2021Distributional Results for Model-Based Intrinsic Dimension Estimatorscited by 5
- 2024Scale adaptive and robust intrinsic dimension estimation via optimal neighbourhood identificationcited by 3
- 2025A general framework for adaptive nonparametric dimensionality reductioncited by 1
- 2025Unveiling Intrinsic Dimension of Texts: from Academic Abstract to Creative Storycited by 1
- 2026Lyapunov Spectral Analysis of Speech Embedding Trajectories in Psychosiscited by 1
Built on by
Not cited yet.