mlsanityData to 14 Oct 2026

Beyond Individuals: Collective Predictive Coding for Memory, Attention, and the Emergence of Language

arXiv 2508.15859 ↗First posted 20 Aug 2025q-bio.NC cs.AI cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

This commentary extends the discussion by Parr et al. on memory and attention beyond individual cognitive systems. From the perspective of the Collective Predictive Coding (CPC) hypothesis -- a framework for understanding these faculties and the emergence of language at the group level -- we introduce a hypothetical idea: that language, with its embedded distributional semantics, serves as a collectively formed external representation. CPC generalises the concepts of individual memory and attention to the collective level. This offers a new perspective on how shared linguistic structures, which may embrace collective world models learned through next-word prediction, emerge from and shape group-level cognition.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 8 of its 15 references that are in the map. First posted on arXiv 20 Aug 2025.

Builds on

8 of 15 references.

References · 8

  1. 2017Attention Is All You Needcited by 60,361
  2. 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,718
  3. 2018Symbol Emergence in Cognitive Developmental Systems: a Surveycited by 39
  4. 2023World Models and Predictive Coding for Cognitive and Developmental Robotics: Frontiers and Challengescited by 36
  5. 2022Emergent Communication through Metropolis-Hastings Naming Game with Deep Generative Modelscited by 16
  6. 2024Generative Emergent Communication: Large Language Model is a Collective World Modelcited by 15
  7. 2024Constructive Approach to Bidirectional Influence between Qualia Structure and Language Emergencecited by 5
  8. 2025System 0/1/2/3: Quad-process theory for multi-timescale embodied collective cognitive systemscited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026GroupToM-Bench: Benchmarking Group Theory of Mind and Nonlinear Social Emergence in MLLMs
  2. 2025In Dialogue with Intelligence: Rethinking Large Language Models as Collective Knowledge
  3. 2025The Emergence of Abstract Thought in Large Language Models Beyond Any Language
  4. 2025The Mechanistic Emergence of Symbol Grounding in Language Models
  5. 2025The Homogenizing Effect of Large Language Models on Human Expression and Thought
  6. 2025Language and Experience: A Computational Model of Social Learning in Complex Tasks
  7. 2026Abstraction Induces the Brain Alignment of Language and Speech Models
  8. 2020Emergent Communication with World Models