# Effective Training Principles of Physical Reservoirs

arXiv: https://arxiv.org/abs/2606.10130 · HTML: https://mlsanity.com/paper/2606.10130/

## Key facts

- No citing papers in the map yet (data through 14 Oct 2026).
- Builds on 4 of its 31 references that are in the map.
- First posted on arXiv 8 Jun 2026.

## Builds on (most cited first, 4 of 4)

- [Optimizing Memory in Reservoir Computers](https://mlsanity.com/paper/2201.01605/) (2022)
- [Embedding Theory of Reservoir Computing and Reducing Reservoir Network Using Time Delays](https://mlsanity.com/paper/2303.09042/) (2023)
- [Adding Filters to Improve Reservoir Computer Performance](https://mlsanity.com/paper/2008.10633/) (2020)
- [Sensitivity-Guided Framework for Pruned and Quantized Reservoir Computing Accelerators](https://mlsanity.com/paper/2603.08737/) (2026)

## Abstract (arXiv)

Reservoir computers benefit from the inherent complexity of optical phenomena, which provide rich, often nonlinear dynamics. However, training directly on the reservoir's output renders the system prone to overfitting and computationally inefficient during the training phase. In this work, we investigate strategies to mitigate overfitting and reduce computational overhead through output pruning and regularization. We compare loss-minimizing search methods (Equal Search and Branch and Bound) against an output-oriented statistical filtering approach (Variance Filter) and random pruning, highlighting advantages and disadvantages of each approach and the overall importance of informed reservoir output sampling, particularly for a shrinking latent space. We further demonstrate that enforcing readout selection across the full output spectrum improves performance, especially for non-iterative methods. Additionally, we examine L1 and L2 regularization techniques (LASSO and ridge regression), both of which significantly enhance performance on highly nonlinear tasks such as the Spiral Benchmark. While our methods are of general use, results are obtained from and discussed exemplarily for a nonlinear fiber-optical extreme learning machine. Overall, this study provides a deep analysis of the reservoirs' hidden-layer filtering mechanisms and the output-layer training, enabling optimized performance in physical reservoir computing systems.
