mlsanityData to 7 Oct 2026

Cooperation Is All You Need

arXiv 2305.10449 ↗First posted 16 May 2023cs.LG cs.AI cs.NEcited by 3

Not on the map. Why?

Abstract (arXiv)

Going beyond 'dendritic democracy', we introduce a 'democracy of local processors', termed Cooperator. Here we compare their capabilities when used in permutation invariant neural networks for reinforcement learning (RL), with machine learning algorithms based on Transformers, such as ChatGPT. Transformers are based on the long standing conception of integrate-and-fire 'point' neurons, whereas Cooperator is inspired by recent neurobiological breakthroughs suggesting that the cellular foundations of mental life depend on context-sensitive pyramidal neurons in the neocortex which have two functionally distinct points. Weshow that when used for RL, an algorithm based on Cooperator learns far quicker than that based on Transformer, even while having the same number of parameters.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 5 of its 29 references that are in the map. First posted on arXiv 16 May 2023.

Builds on

5 of 29 references.

References · 5

  1. 2017Attention Is All You Needcited by 59,932
  2. 2021Attention Mechanisms in Computer Vision: A Surveycited by 232
  3. 2021The Sensory Neuron as a Transformer: Permutation-Invariant Neural Networks for Reinforcement Learningcited by 50
  4. 2022A comparison of partial information decompositions using data from real and simulated layer 5b pyramidal cellscited by 5
  5. 2022Context-sensitive neocortical neurons transform the effectiveness and efficiency of neural information processingcited by 5

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 1; 2025: 1; 2026: 1.

3 papers.