mlsanityData to 14 Oct 2026

Updating the standard neuron model in artificial neural networks

arXiv 2605.30370 ↗First posted 19 May 2026cs.NE cs.AI cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

From their inception in the 1950s, artificial neural networks (ANNs) started using the so-called point neuron model then prevalent in neuroscience, hoping that this analogy would allow for a better emulation of brain function. Over the years the neuroscience literature has shown that the point neuron model is too simplistic to properly represent many fundamental neural processes; however, the standard neuron model in ANNs still remains the same. Here we substitute it by a very recent model of cortical cells and demonstrate through theoretical analyses and experimental results how, simply by using a more realistic neural unit element without augmenting the number of parameters, the resulting ANNs offer a number of important advantages that include increases in expressivity, robustness and learning speed, and a reduction in memorization and the amount of training data needed.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 23 of its 50 references that are in the map. First posted on arXiv 19 May 2026.

Builds on

23 of 50 references.

References · 23

  1. 2017Attention Is All You Needcited by 60,361
  2. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
  3. 2017Towards Deep Learning Models Resistant to Adversarial Attackscited by 6,415
  4. 2017Fashion-MNIST: a Novel Image Dataset for Benchmarking Machine Learning Algorithmscited by 4,349
  5. 2024Eyes Wide Shut? Exploring the Visual Shortcomings of Multimodal LLMscited by 735
  6. 2019Deep Equilibrium Modelscited by 615
  7. 2020What Neural Networks Memorize and Why: Discovering the Long Tail via Influence Estimationcited by 497
  8. 2017Wild Patterns: Ten Years After the Rise of Adversarial Machine Learningcited by 414
  9. 2020Torchattacks: A PyTorch Repository for Adversarial Attackscited by 158
  10. 2018Improving DNN Robustness to Adversarial Attacks using Jacobian Regularizationcited by 88
  11. 2022Toward Next-Generation Artificial Intelligence: Catalyzing the NeuroAI Revolutioncited by 78
  12. 2021Attractor and integrator networks in the braincited by 61
11 more
  1. 2023Neither hype nor gloom do DNNs justicecited by 40
  2. 2023Memorization Through the Lens of Curvature of Loss Function Around Samplescited by 27
  3. 2021Avoiding Catastrophe: Active Dendrites Enable Multi-Task Learning in Dynamic Environmentscited by 25
  4. 2023TorchDEQ: A Library for Deep Equilibrium Modelscited by 21
  5. 2022Pixle: a fast and effective black-box attack based on rearranging pixelscited by 20
  6. 2021The mathematics of adversarial attacks in AI -- Why deep learning is unstable despite the existence of stable neural networkscited by 16
  7. 2021The Feasibility and Inevitability of Stealth Attackscited by 12
  8. 2023The Quest for an Integrated Set of Neural Mechanisms Underlying Object Recognition in Primatescited by 8
  9. 2024Dendrites endow artificial neural networks with accurate, robust and parameter-efficient learningcited by 7
  10. 2023Leveraging dendritic properties to advance machine learning and neuro-inspired computingcited by 6
  11. 2024Unconditional stability of a recurrent neural circuit implementing divisive normalizationcited by 4

Built on by

Not cited yet.