The Linguistic Architecture of Reflective Thought: Evaluation of a Large Language Model as a Tool to Isolate the Formal Structure of Mentalization
On the map: LLM reasoning → Reasoning benchmarks and evaluation
Abstract (arXiv)
Background: Mentalization integrates cognitive, affective, and intersubjective components. Large Language Models (LLMs) display an increasing ability to generate reflective texts, raising questions regarding the relationship between linguistic form and mental representation. This study assesses the extent to which a single LLM can reproduce the linguistic structure of mentalization according to the parameters of Mentalization-Based Treatment (MBT). Methods: Fifty dialogues were generated between human participants and an LLM configured in standard mode. Five psychiatrists trained in MBT, working under blinded conditions, evaluated the mentalization profiles produced by the model along the four MBT axes, assigning Likert-scale scores for evaluative coherence, argumentative coherence, and global quality. Inter-rater agreement was estimated using ICC(3,1). Results: Mean scores (3.63-3.98) and moderate standard deviations indicate a high level of structural coherence in the generated profiles. ICC values (0.60-0.84) show substantial-to-high agreement among raters. The model proved more stable in the Implicit-Explicit and Self-Other dimensions, while presenting limitations in the integration of internal states and external contexts. The profiles were coherent and clinically interpretable yet characterized by affective neutrality.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Reasoning benchmarks and evaluation, one of 17 directions in LLM reasoning. Builds on 0 of its 7 references that are in the map. First posted on arXiv 20 Nov 2025.
Builds on
0 of 7 references.
No references here yet.
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2023Rethinking Large Language Models in Mental Health Applications
- 2023Investigating the Efficacy of Large Language Models in Reflective Assessment Methods through Chain of Thoughts Prompting
- 2025The Homogenizing Effect of Large Language Models on Human Expression and Thought
- 2023The Cultural Psychology of Large Language Models: Is ChatGPT a Holistic or Analytic Thinker?
- 2023Cognitive Reframing of Negative Thoughts through Human-Language Model Interaction
- 2025XToM: Exploring the Multilingual Theory of Mind for Large Language Models
- 2026Toward Contemplative LLM: A Modular Framework for Evaluating and Enhancing LLM Alignment in Mental Health
- 2025From Five Dimensions to Many: Large Language Models as Precise and Interpretable Psychological Profilers