mlsanityData to 14 Oct 2026

Unraveling the cognitive patterns of Large Language Models through module communities

arXiv 2508.18192 ↗First posted 25 Aug 2025cs.AI cs.CL cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Large Language Models (LLMs) have reshaped our world with significant advancements in science, engineering, and society through applications ranging from scientific discoveries and medical diagnostics to Chatbots. Despite their ubiquity and utility, the underlying mechanisms of LLM remain concealed within billions of parameters and complex structures, making their inner architecture and cognitive processes challenging to comprehend. We address this gap by adopting approaches to understanding emerging cognition in biology and developing a network-based framework that links cognitive skills, LLM architectures, and datasets, ushering in a paradigm shift in foundation model analysis. The skill distribution in the module communities demonstrates that while LLMs do not strictly parallel the focalized specialization observed in specific biological systems, they exhibit unique communities of modules whose emergent skill patterns partially mirror the distributed yet interconnected cognitive organization seen in avian and small mammalian brains. Our numerical results highlight a key divergence from biological systems to LLMs, where skill acquisition benefits substantially from dynamic, cross-regional interactions and neural plasticity. By integrating cognitive science principles with machine learning, our framework provides new insights into LLM interpretability and suggests that effective fine-tuning strategies should leverage distributed learning dynamics rather than rigid modular interventions.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 24 of its 97 references that are in the map. First posted on arXiv 25 Aug 2025.

Builds on

24 of 97 references.

References · 24

  1. 2020Language Models are Few-Shot Learnerscited by 32,419
  2. 2020Measuring Massive Multitask Language Understandingcited by 7,963
  3. 2021TruthfulQA: Measuring How Models Mimic Human Falsehoodscited by 2,975
  4. 2022Learn to Explain: Multimodal Reasoning via Thought Chains for Science Question Answeringcited by 1,919
  5. 2018CommonsenseQA: A Question Answering Challenge Targeting Commonsense Knowledgecited by 1,822
  6. 2023SparseGPT: Massive Language Models Can Be Accurately Pruned in One-Shotcited by 1,121
  7. 2019Are Sixteen Heads Really Better than One?cited by 816
  8. 2023A Simple and Effective Pruning Approach for Large Language Modelscited by 800
  9. 2019MathQA: Towards Interpretable Math Word Problem Solving with Operation-Based Formalismscited by 662
  10. 2023LLM-Pruner: On the Structural Pruning of Large Language Modelscited by 650
  11. 2020Recipes for building an open-domain chatbotcited by 593
  12. 2022Is GPT-3 a Good Data Annotator?cited by 208
12 more
  1. 2022Thinking Fast and Slow in Large Language Modelscited by 137
  2. 2023Skill-it! A Data-Driven Skills Framework for Understanding and Training Language Modelscited by 121
  3. 2023Task-Specific Skill Localization in Fine-tuned Language Modelscited by 105
  4. 2019EigenDamage: Structured Pruning in the Kronecker-Factored Eigenbasiscited by 98
  5. 2019BAM! Born-Again Multi-Task Networks for Natural Language Understandingcited by 85
  6. 2024Metacognitive Capabilities of LLMs: An Exploration in Mathematical Problem Solvingcited by 84
  7. 2024CogBench: a large language model walks into a psychology labcited by 63
  8. 2023Instruction-tuning Aligns LLMs to the Human Braincited by 40
  9. 2023Visual Writing Prompts: Character-Grounded Story Generation with Curated Image Sequencescited by 31
  10. 2020Minimum adjusted Rand index for two clusterings of a given sizecited by 13
  11. 2015A novel plasticity rule can explain the development of sensorimotor intelligencecited by 3
  12. 2023Divergences between Language Models and Human Brainscited by 3

Built on by

Not cited yet.