Excitatory/Inhibitory Balance Emerges as a Key Factor for RBN Performance, Overriding Attractor Dynamics
Not on the map. Why?
Abstract (arXiv)
Reservoir computing provides a time and cost-efficient alternative to traditional learning methods.Critical regimes, known as the "edge of chaos," have been found to optimize computational performance in binary neural networks. However, little attention has been devoted to studying reservoir-to-reservoir variability when investigating the link between connectivity, dynamics, and performance. As physical reservoir computers become more prevalent, developing a systematic approach to network design is crucial. In this article, we examine Random Boolean Networks (RBNs) and demonstrate that specific distribution parameters can lead to diverse dynamics near critical points. We identify distinct dynamical attractors and quantify their statistics, revealing that most reservoirs possess a dominant attractor. We then evaluate performance in two challenging tasks, memorization and prediction, and find that a positive excitatory balance produces a critical point with higher memory performance. In comparison, a negative inhibitory balance delivers another critical point with better prediction performance. Interestingly, we show that the intrinsic attractor dynamics have little influence on performance in either case.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 8 of its 60 references that are in the map. First posted on arXiv 2 Aug 2023.
Builds on
8 of 60 references.
References · 8
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2018Rapid Time Series Prediction with a Hardware-Based Reservoir Computercited by 14
- 2018Analysis of structure and dynamics in three-neuron motifscited by 11
- 2016Investigating echo state networks dynamics by means of recurrence analysiscited by 8
- 2020P-CRITICAL: A Reservoir Autoregulation Plasticity Rule for Neuromorphic Hardwarecited by 3
- 2015The topology of the directed clique complex as a network invariantcited by 2
- 2016Memory and Information Processing in Recurrent Neural Networkscited by 2
- 2017Avalanches and Generalized Memory Associativity in a Network Model for Conscious and Unconscious Mental Functioningcited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Fractal and Chaotic Activation Functions in Echo State Networks: Preprocessing Topology Governs the Echo State Property
- 2025Dynamics and Computational Principles of Echo State Networks: A Mathematical Perspective
- 2026Phases in a class of associative memories via hidden neurons
- 2025Emergence of hybrid computational dynamics through reinforcement learning
- 2026On the Role of Preprocessing and Memristor Dynamics in Reservoir Computing for Image Classification
- 2023Stochastic Collapse: How Gradient Noise Attracts SGD Dynamics Towards Simpler Subnetworks
- 2023Regularization, early-stopping and dreaming: a Hopfield-like setup to address generalization and overfitting
- 2026Integer-State Dynamics of Quantized Spiking Neural Networks for Efficient Hardware Acceleration