mlsanityData to 7 Oct 2026

A brain basis of dynamical intelligence for AI and computational neuroscience

arXiv 2105.07284 ↗First posted 15 May 2021q-bio.NC cs.AIcited by 1

Not on the map. Why?

Abstract (arXiv)

The deep neural nets of modern artificial intelligence (AI) have not achieved defining features of biological intelligence, including abstraction, causal learning, and energy-efficiency. While scaling to larger models has delivered performance improvements for current applications, more brain-like capacities may demand new theories, models, and methods for designing artificial learning systems. Here, we argue that this opportunity to reassess insights from the brain should stimulate cooperation between AI research and theory-driven computational neuroscience (CN). To motivate a brain basis of neural computation, we present a dynamical view of intelligence from which we elaborate concepts of sparsity in network structure, temporal dynamics, and interactive learning. In particular, we suggest that temporal dynamics, as expressed through neural synchrony, nested oscillations, and flexible sequences, provide a rich computational layer for reading and updating hierarchical models distributed in long-term memory networks. Moreover, embracing agent-centered paradigms in AI and CN will accelerate our understanding of the complex dynamics and behaviors that build useful world models. A convergence of AI/CN theories and objectives will reveal dynamical principles of intelligence for brains and engineered learning systems. This article was inspired by our symposium on dynamical neuroscience and machine learning at the 6th Annual US/NIH BRAIN Initiative Investigators Meeting.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 31 of its 180 references that are in the map. First posted on arXiv 15 May 2021.

Builds on

31 of 180 references.

References · 31

  1. 2020Language Models are Few-Shot Learnerscited by 32,199
  2. 2014Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modelingcited by 2,341
  3. 2018The Lottery Ticket Hypothesis: Finding Sparse, Trainable Neural Networkscited by 2,250
  4. 2018Exploration by Random Network Distillationcited by 966
  5. 2020It's Not Just Size That Matters: Small Language Models Are Also Few-Shot Learnerscited by 668
  6. 2019Deep Double Descent: Where Bigger Models and More Data Hurtcited by 667
  7. 2020Pruning neural networks without any data by iteratively conserving synaptic flowcited by 475
  8. 2020Agent57: Outperforming the Atari Human Benchmarkcited by 300
  9. 2016Training Deep Spiking Neural Networks using Backpropagationcited by 203
  10. 2020The Computational Limits of Deep Learningcited by 188
  11. 2020The Hardware Lotterycited by 160
  12. 2018Assessing the Scalability of Biologically-Motivated Deep Learning Algorithms and Architecturescited by 100
19 more
  1. 2016Towards deep learning with segregated dendritescited by 71
  2. 2020The Unreasonable Effectiveness of Deep Learning in Artificial Intelligencecited by 57
  3. 2017Linking connectivity, dynamics and computations in low-rank recurrent neural networkscited by 51
  4. 2014Deep Neural Networks Rival the Representation of Primate IT Cortex for Core Visual Object Recognitioncited by 50
  5. 2017Dense Associative Memory is Robust to Adversarial Inputscited by 45
  6. 2019How Can We Be So Dense? The Benefits of Using Highly Sparse Representationscited by 45
  7. 2019Deep learning tools for the measurement of animal behavior in neurosciencecited by 44
  8. 2020Brain-Inspired Learning on Neuromorphic Substratescited by 35
  9. 2017Equivalence of Equilibrium Propagation and Recurrent Backpropagationcited by 31
  10. 2017BP-STDP: Approximating Backpropagation using Spike Timing Dependent Plasticitycited by 23
  11. 2020BS4NN: Binarized Spiking Neural Networks with Temporal Coding and Learningcited by 20
  12. 2019Generative models as parsimonious descriptions of sensorimotor loopscited by 11
  13. 2020Activation Relaxation: A Local Dynamical Approximation to Backpropagation in the Braincited by 11
  14. 2019Deep Learning for Cognitive Neurosciencecited by 7
  15. 2019What is the dynamical regime of cerebral cortex?cited by 6
  16. 2020On the role of theory and modeling in neurosciencecited by 5
  17. 2020Exploring Exploration: Comparing Children with RL Agents in Unified Environmentscited by 5
  18. 2014Untangling cross-frequency coupling in neurosciencecited by 3
  19. 2019Cognitive swarming in complex environments with attractor dynamics and oscillatory computingcited by 2

Built on by

Cited by year

Citing papers per year: 2021: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2024The brain versus AI: World-model-based versatile circuit computation underlying diverse functions in the neocortex and cerebellum
  2. 2025The brain-AI convergence: Predictive and generative world models for general-purpose computation
  3. 2025State Space Models Naturally Produce Time Cell and Oscillatory Behaviors and Scale to Abstract Cognitive Functions
  4. 2025Advances and Challenges in Foundation Agents: From Brain-Inspired Intelligence to Evolutionary, Collaborative, and Safe Systems
  5. 2025The Dragon Hatchling: The Missing Link between the Transformer and Models of the Brain
  6. 2025Neural Brain: A Neuroscience-inspired Framework for Embodied Agents
  7. 2025Nature's Insight: A Novel Framework and Comprehensive Analysis of Agentic Reasoning Through the Lens of Neuroscience
  8. 2026Integrative neurocybernetic modeling in the era of large-scale neuroscience