mlsanityData to 14 Oct 2026

Boosting Reservoir Computing with Brain-inspired Adaptive Dynamics

arXiv 2504.12480 ↗First posted 16 Apr 2025cs.NE cs.LG q-bio.NCcited by 0

Not on the map. Why?

Abstract (arXiv)

Reservoir computers (RCs) provide a computationally efficient alternative to deep learning while also offering a framework for incorporating brain-inspired computational principles. By using an internal neural network with random, fixed connections-the 'reservoir'-and training only the output weights, RCs simplify the training process but remain sensitive to the choice of hyperparameters that govern activation functions and network architecture. Moreover, typical RC implementations overlook a critical aspect of neuronal dynamics: the balance between excitatory and inhibitory (E-I) signals, which is essential for robust brain function. We show that RCs characteristically perform best in balanced or slightly over-inhibited regimes, outperforming excitation-dominated ones. To reduce the need for precise hyperparameter tuning, we introduce a self-adapting mechanism that locally adjusts E/I balance to achieve target neuronal firing rates, improving performance by up to 130% in tasks like memory capacity and time series prediction compared with globally tuned RCs. Incorporating brain-inspired heterogeneity in target neuronal firing rates further reduces the need for fine-tuning hyperparameters and enables RCs to excel across linear and non-linear tasks. These results support a shift from static optimization to dynamic adaptation in reservoir design, demonstrating how brain-inspired mechanisms improve RC performance and robustness while deepening our understanding of neural computation.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 14 of its 59 references that are in the map. First posted on arXiv 16 Apr 2025.

Builds on

14 of 59 references.

References · 14

  1. 2018Hybrid Forecasting of Chaotic Processes: Using Machine Learning in Conjunction with a Knowledge-Based Modelcited by 57
  2. 2016Efficient multivariate entropy estimation via k-nearest neighbour distancescited by 28
  3. 2020Do Reservoir Computers Work Best at the Edge of Chaos?cited by 17
  4. 2021Parallel Machine Learning for Forecasting the Dynamics of Complex Networkscited by 17
  5. 2016Bayesian optimization of hyper-parameters in reservoir computingcited by 13
  6. 2022Biological neurons act as generalization filters in reservoir computingcited by 12
  7. 2017Optimal modularity and memory capacity of neural reservoirscited by 8
  8. 2020Bayesian optimisation of large-scale photonic reservoir computerscited by 7
  9. 2021Unveiling the role of plasticity rules in reservoir computingcited by 7
  10. 2023Learning Reservoir Dynamics with Temporal Self-Modulationcited by 4
  11. 2014Dynamic Balance of Excitation and Inhibition in Human and Monkey Neocortexcited by 3
  12. 2022RcTorch: a PyTorch Reservoir Computing Package with Automated Hyper-Parameter Optimizationcited by 3
2 more
  1. 2023Tuning the activation function to optimize the forecast horizon of a reservoir computercited by 2
  2. 2022Benchmarking Learning Efficiency in Deep Reservoir Computingcited by 1

Built on by

Not cited yet.