UniCog: Uncovering Cognitive Abilities of LLMs through Latent Mind Space Analysis
Not on the map. Why?
Abstract (arXiv)
A growing body of research suggests that the cognitive processes of large language models (LLMs) differ fundamentally from those of humans. However, existing interpretability methods remain limited in explaining how cognitive abilities are engaged during LLM reasoning. In this paper, we propose UniCog, a unified framework that analyzes LLM cognition via a latent mind space. Formulated as a latent variable model, UniCog encodes diverse abilities from dense model activations into sparse, disentangled latent dimensions. Through extensive analysis on six advanced LLMs, including DeepSeek-V3.2 and GPT-4o, we reveal a Pareto principle of LLM cognition, where a shared reasoning core is complemented by ability-specific signatures. Furthermore, we discover that reasoning failures often manifest as anomalous intensity in latent activations. These findings opens a new paradigm in LLM analysis, providing a cognition grounded view of reasoning dynamics. Finally, leveraging these insights, we introduce a latent-informed candidate prioritization strategy, which improves reasoning performance by up to 7.5% across challenging benchmarks. Our code is available at https://github.com/milksalute/unicog.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 17 of its 44 references that are in the map. First posted on arXiv 25 Jan 2026.
Builds on
17 of 44 references.
References · 17
- 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,708
- 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,371
- 2016Pointer Sentinel Mixture Modelscited by 3,096
- 2013Deep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Mapscited by 2,371
- 2021Probing Classifiers: Promises, Shortcomings, and Advancescited by 876
- 2023Towards Automated Circuit Discovery for Mechanistic Interpretabilitycited by 724
- 2022Large Language Models are Better Reasoners with Self-Verificationcited by 307
- 2017Variational Inference of Disentangled Latent Concepts from Unlabeled Observationscited by 241
- 2024GSM-Plus: A Comprehensive Benchmark for Evaluating the Robustness of LLMs as Mathematical Problem Solverscited by 158
- 2024How Large Language Models Encode Context Knowledge? A Layer-Wise Probing Studycited by 64
- 2018Structured Disentangled Representationscited by 62
- 2025Cognitive Foundations for Reasoning and Their Manifestation in LLMscited by 26
5 more
- 2024An Investigation of Neuron Activation as a Unified Lens to Explain Chain-of-Thought Eliciting Arithmetic Reasoning of LLMscited by 20
- 2025CogMath: Assessing LLMs' Authentic Mathematical Ability from a Human Cognitive Perspectivecited by 4
- 2025CoreEval: Automatically Building Contamination-Resilient Datasets with Real-World Knowledge toward Reliable LLM Evaluationcited by 3
- 2025Verifying Large Language Models' Reasoning Paths via Correlation Matrix Rankcited by 2
- 2025Foundation of Intelligence: Review of Math Word Problems from Human Cognition Perspectivecited by 1
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2025Mapping the Minds of LLMs: A Graph-Based Analysis of Reasoning LLM
- 2026LLM Reasoning Is Latent, Not the Chain of Thought
- 2025Beyond Chains of Thought: Benchmarking Latent-Space Reasoning Abilities in Large Language Models
- 2024Beyond Accuracy: Evaluating the Reasoning Behavior of Large Language Models -- A Survey
- 2025How and Why LLMs Generalize: A Fine-Grained Analysis of LLM Reasoning from Cognitive Behaviors to Low-Level Patterns
- 2025Decoupling Knowledge and Reasoning in LLMs: An Exploration Using Cognitive Dual-System Theory
- 2025Cognitive Mirrors: Exploring the Diverse Functional Roles of Attention Heads in LLM Reasoning
- 2026ReEfBench: Quantifying the Reasoning Efficiency of LLMs