mlsanityData to 7 Oct 2026

Rethinking Reservoir Pruning: A Dynamical Perspective for Echo State Networks

arXiv 2608.04593 ↗First posted 5 Aug 2026cs.LG cs.AI math.DScited by 0

Not on the map. Why?

Abstract (arXiv)

Echo State Networks (ESNs) offer an efficient framework for temporal prediction, but their randomly initialized reservoirs are often over-parameterized and dynamically redundant. Existing pruning methods largely rely on static connectivity or activation statistics, which may overlook neurons that shape input-driven state transitions. We propose Dynamical Mode Pruning (DMP), a reservoir pruning method that ranks neurons by their contribution to dominant transition modes obtained from a trajectory-averaged Jacobian Gramian. DMP removes low-impact units and retrains only the readout. Experiments on chaotic and real-world time-series benchmarks show that DMP improves or preserves forecasting accuracy while reducing redundant reservoir components. Our results suggest that dynamical influence is a useful criterion for reservoir refinement beyond static structural importance alone.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 18 of its 45 references that are in the map. First posted on arXiv 5 Aug 2026.

Builds on

18 of 45 references.

References · 18

  1. 2018The Lottery Ticket Hypothesis: Finding Sparse, Trainable Neural Networkscited by 2,250
  2. 2015Learning both Weights and Connections for Efficient Neural Networkscited by 1,998
  3. 2020What is the State of Neural Network Pruning?cited by 578
  4. 2023ZipLM: Inference-Aware Structured Pruning of Language Modelscited by 46
  5. 2022SPDY: Accurate Pruning with Speedup Guaranteescited by 34
  6. 2021Topology-Aware Network Pruning using Multi-stage Graph Embedding and Reinforcement Learningcited by 30
  7. 2022Sparse Double Descent: Where Network Pruning Aggravates Overfittingcited by 26
  8. 2022Data-Efficient Structured Pruning via Submodular Optimizationcited by 22
  9. 2023Fantastic Weights and How to Find Them: Where to Prune in Dynamic Sparse Trainingcited by 16
  10. 2019One-Shot Pruning of Recurrent Neural Networks by Jacobian Spectrum Evaluationcited by 14
  11. 2016Centrality Measures in Networkscited by 11
  12. 2024Layer-Adaptive State Pruning for Deep State Space Modelscited by 10
6 more
  1. 2016Investigating echo state networks dynamics by means of recurrence analysiscited by 8
  2. 2024No Free Prune: Information-Theoretic Barriers to Pruning at Initializationcited by 8
  3. 2018Chasing the Echo State Propertycited by 5
  4. 2024BMRS: Bayesian Model Reduction for Structured Pruningcited by 2
  5. 2025Minimal Deterministic Echo State Networks Outperform Random Reservoirs in Learning Chaotic Dynamicscited by 2
  6. 2026Centrality-Based Pruning for Efficient Echo State Networkscited by 1

Built on by

Not cited yet.