mlsanityData to 14 Oct 2026

Can Biologically Plausible Temporal Credit Assignment Rules Match BPTT for Neural Similarity? E-prop as an Example

arXiv 2506.06904 ↗First posted 7 Jun 2025cs.NE cs.AI q-bio.NCcited by 1

Not on the map. Why?

Abstract (arXiv)

Understanding how the brain learns may be informed by studying biologically plausible learning rules. These rules, often approximating gradient descent learning to respect biological constraints such as locality, must meet two critical criteria to be considered an appropriate brain model: (1) good neuroscience task performance and (2) alignment with neural recordings. While extensive research has assessed the first criterion, the second remains underexamined. Employing methods such as Procrustes analysis on well-known neuroscience datasets, this study demonstrates the existence of a biologically plausible learning rule -- namely e-prop, which is based on gradient truncation and has demonstrated versatility across a wide range of tasks -- that can achieve neural data similarity comparable to Backpropagation Through Time (BPTT) when matched for task accuracy. Our findings also reveal that model architecture and initial conditions can play a more significant role in determining neural similarity than the specific learning rule. Furthermore, we observe that BPTT-trained models and their biologically plausible counterparts exhibit similar dynamical properties at comparable accuracies. These results underscore the substantial progress made in developing biologically plausible learning rules, highlighting their potential to achieve both competitive task performance and neural data similarity.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 50 of its 110 references that are in the map. First posted on arXiv 7 Jun 2025.

Builds on

50 of 110 references.

References · 50

  1. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
  2. 2019Similarity of Neural Network Representations Revisitedcited by 1,755
  3. 2022Transformers learn in-context by gradient descentcited by 732
  4. 2018On Lazy Training in Differentiable Programmingcited by 675
  5. 2017Evolution Strategies as a Scalable Alternative to Reinforcement Learningcited by 574
  6. 2020Kernel and Rich Regimes in Overparametrized Modelscited by 306
  7. 2022The Forward-Forward Algorithm: Some Preliminary Investigationscited by 266
  8. 2016Equilibrium Propagation: Bridging the Gap Between Energy-Based Models and Backpropagationcited by 259
  9. 2023Getting aligned on representational alignmentcited by 143
  10. 2023Similarity of Neural Network Models: A Survey of Functional and Representational Measurescited by 131
  11. 2021Generalized Shape Metrics on Neural Representationscited by 112
  12. 2018Dendritic cortical microcircuits approximate the backpropagation algorithmcited by 97
38 more
  1. 2022Reliability of CKA as a Similarity Measure in Deep Learningcited by 87
  2. 2018Eligibility Traces and Plasticity on Behavioral Time Scales: Experimental Support of neoHebbian Three-Factor Learning Rulescited by 67
  3. 2019Universality and individuality in neural dynamics across large populations of recurrent networkscited by 61
  4. 2021Neural population geometry: An approach for understanding biological and artificial neural networkscited by 52
  5. 2022Holomorphic Equilibrium Propagation Computes Exact Gradients Through Finite Size Oscillationscited by 42
  6. 2023Neither hype nor gloom do DNNs justicecited by 40
  7. 2019A Unified Framework of Online Learning Algorithms for Training Recurrent Neural Networkscited by 38
  8. 2020Geometric compression of invariant manifolds in neural netscited by 28
  9. 2020Artificial neural networks for neuroscientists: A primercited by 26
  10. 2023Beyond Geometry: Comparing the Temporal Structure of Computation in Neural Circuits with Dynamical Similarity Analysiscited by 23
  11. 2024Learned feature representations are biased by complexity, learning order, position, and morecited by 23
  12. 2020The interplay between randomness and structure during learning in RNNscited by 20
  13. 2022Single-phase deep learning in cortico-cortical networkscited by 19
  14. 2022The Influence of Learning Rule on Representation Dynamics in Wide Neural Networkscited by 19
  15. 2020A Practical Sparse Approximation for Real Time Recurrent Learningcited by 18
  16. 2023Soft Matching Distance: A metric on neural representations that captures single-neuron tuningcited by 18
  17. 2024What Representational Similarity Measures Imply about Decodable Informationcited by 18
  18. 2022Representational dissimilarity metric spaces for stochastic neural networkscited by 17
  19. 2017full-FORCE: A Target-Based Method for Training Recurrent Networkscited by 16
  20. 2022The least-control principle for local learning at equilibriumcited by 16
  21. 2023How connectivity structure shapes rich and lazy learning in neural circuitscited by 15
  22. 2023Duality of Bures and Shape Distances with Implications for Comparing Neural Representationscited by 15
  23. 2023The Topology and Geometry of Neural Representationscited by 14
  24. 2017Predicting non-linear dynamics by stable local learning in a recurrent spiking neural networkcited by 13
  25. 2022Continual task learning in natural and artificial agentscited by 12
  26. 2023Aligned and oblique dynamics in recurrent neural networkscited by 10
  27. 2024Differentiable Optimization of Similarity Scores Between Models and Brainscited by 10
  28. 2020Identifying Learning Rules From Neural Network Observablescited by 9
  29. 2019Cortical credit assignment by Hebbian, neuromodulatory and inhibitory plasticitycited by 8
  30. 2021Charting and navigating the space of solutions for recurrent neural networkscited by 8
  31. 2022Biologically-plausible backpropagation through arbitrary timespans via local neuromodulatorscited by 7
  32. 2022Distinguishing Learning Rules with Brain Machine Interfacescited by 5
  33. 2023Estimating Shape Distances on Neural Representations with Limited Samplescited by 4
  34. 2024Comparing noisy neural population dynamics using optimal transport distancescited by 4
  35. 2022Beyond accuracy: generalization properties of bio-plausible temporal credit assignment rulescited by 3
  36. 2020New Light on Cortical Neuropeptides and Synaptic Network Plasticitycited by 2
  37. 2021Current State and Future Directions for Learning in Biological Recurrent Neural Networks: A Perspective Piececited by 2
  38. 2021Probing the relationship between linear dynamical systems and low-rank recurrent neural network modelscited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.