mlsanityData to 14 Oct 2026

Modular Cognitive Architecture Emerges in Large Language Models

arXiv 2608.13567 ↗First posted 27 Jun 2026cs.AI cs.CL cs.LGcited by 3

Not on the map. Why?

Abstract (arXiv)

The human brain exhibits a striking degree of functional specialization, with distinct networks supporting language, formal reasoning, reasoning about other minds, and reasoning about the physical world. Is this modular organization a fundamental principle of how intelligent systems must be built, or an evolutionary accident specific to biological brains? Here, we test whether a similar organization emerges in Large Language Models--another class of intelligent systems created through a very different optimization process. Using circuit analyses across N=46 tasks spanning four cognitive domains (language, formal reasoning, social reasoning, physical reasoning), we find that LLMs develop a modular architecture that mirrors the human brain: tasks drawing on the same network in humans recruit overlapping neurons in LLMs, whereas tasks drawing on different networks recruit distinct neurons. The convergent emergence of modularity in brains and neural networks suggests that it may be a fundamental property of intelligent systems.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 23 of its 57 references that are in the map. First posted on arXiv 27 Jun 2026.

Builds on

23 of 57 references.

References · 23

  1. 2024The Llama 3 Herd of Modelscited by 14,715
  2. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
  3. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
  4. 2017Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layercited by 3,509
  5. 2022Locating and Editing Factual Associations in GPTcited by 2,691
  6. 2021Knowledge Neurons in Pretrained Transformerscited by 601
  7. 2019BLiMP: The Benchmark of Linguistic Minimal Pairs for Englishcited by 564
  8. 20242 OLMo 2 Furiouscited by 340
  9. 2023Attribution Patching Outperforms Automated Circuit Discoverycited by 209
  10. 2023How does GPT-2 compute greater-than?: Interpreting mathematical abilities in a pre-trained language modelcited by 202
  11. 2024Fine-Tuning Enhances Existing Mechanisms: A Case Study on Entity Trackingcited by 149
  12. 2017Learning to Generate Reviews and Discovering Sentimentcited by 148
11 more
  1. 2025REASONING GYM: Reasoning Environments for Reinforcement Learning with Verifiable Rewardscited by 130
  2. 2020Are Neural Nets Modular? Inspecting Functional Modularity Through Differentiable Weight Maskscited by 98
  3. 2019The emergence of number and syntax units in LSTM language modelscited by 94
  4. 2023A Mechanistic Interpretation of Arithmetic Reasoning in Language Models using Causal Mediation Analysiscited by 89
  5. 2021PROST: Physical Reasoning of Objects through Space and Timecited by 48
  6. 2025Large Language Models Pass the Turing Testcited by 48
  7. 2023NEWTON: Are Large Language Models Capable of Physical Reasoning?cited by 45
  8. 2025Are formal and functional linguistic mechanisms dissociated in language models?cited by 11
  9. 2025Different types of syntactic agreement recruit the same units within large language modelscited by 8
  10. 2026Discovering Functionally Selective Brain Regions with a Deep Topographic Multimodal Modelcited by 2
  11. 2026Discovering Decoupled Functional Modules in Large Language Modelscited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 3.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Mixture of Cognitive Reasoners: Modular Reasoning with Brain-Like Specialization
  2. 2026A Brain-like Synergistic Core in LLMs Drives Behaviour and Learning
  3. 2025Advances and Challenges in Foundation Agents: From Brain-Inspired Intelligence to Evolutionary, Collaborative, and Safe Systems
  4. 2023Emergent Modularity in Pre-trained Transformers
  5. 2024The LLM Language Network: A Neuroscientific Approach for Identifying Causally Task-Relevant Units
  6. 2025Three tiers of computation in transformers and in brain architectures
  7. 2026Looking Inside LLMs: Small-World Connectivity as a Signature of Reasoning Performance
  8. 2025Towards Cognitive Synergy in LLM-Based Multi-Agent Systems: Integrating Theory of Mind and Critical Evaluation