Cognitive Dark Matter: Measuring What AI Misses
Not on the map. Why?
Abstract (arXiv)
We propose that the jagged intelligence landscape of modern AI systems arises from a missing training signal that we call ``cognitive dark matter'' (CDM): brain functions that meaningfully shape behavior yet are hard to infer from behavior alone. We identify key CDM domains---metacognition, cognitive flexibility, lifelong learning, abductive reasoning, social and common-sense reasoning, and emotional intelligence---and present evidence CDM-loaded functions are largely unmeasured in current AI benchmarks, and that large-scale neuroscience training datasets which could be used to instill these capabilities do not yet exist. We then outline a research program centered on three complementary data types designed to surface CDM for model training: (i) latent variables from large-scale cognitive models, (ii) process-tracing data such as eye-tracking and think-aloud protocols, and (iii) paired neural--behavioral data. These data will enable AI training on cognitive process rather than behavioral outcome alone, producing models with more general, less jagged intelligence. As a dual benefit, the same data will advance our understanding of human intelligence itself.
Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). First posted on arXiv 3 Mar 2026.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2026: 5.
5 papers.
- 2026Reason to Play: Behavioral and Brain Alignment Between Frontier LRMs and Human Game Learnerscited by 1
- 2026Implicit Rule Induction with Test-Time Task Embeddings in ARC-like Taskscited by 1
- 2026How Much is Brain Data Worth for Machine Learning?cited by 0
- 2026Using profiles of cognitive capability to assess AI suitability for workplace taskscited by 0
- 2026PotARCin: Multi-Dimensional Evaluation of Skill Acquisition in Abstract Reasoning Taskscited by 0
- 2026PotARCin: Multi-Dimensional Evaluation of Skill Acquisition in Abstract Reasoning Tasks23 Sep 2026
- 2026Implicit Rule Induction with Test-Time Task Embeddings in ARC-like Tasks18 Sep 2026
- 2026Using profiles of cognitive capability to assess AI suitability for workplace tasks26 Aug 2026
- 2026How Much is Brain Data Worth for Machine Learning?10 May 2026
- 2026Reason to Play: Behavioral and Brain Alignment Between Frontier LRMs and Human Game Learners8 May 2026