Reservoir Computing Universality With Stochastic Inputs
Not on the map. Why?
Abstract (arXiv)
The universal approximation properties with respect to L p -type criteria of three important families of reservoir computers with stochastic discrete-time semi-infinite inputs is shown. First, it is proved that linear reservoir systems with either polynomial or neural network readout maps are universal. More importantly, it is proved that the same property holds for two families with linear readouts, namely, trigonometric state-affine systems and echo state networks, which are the most widely used reservoir systems in applications. The linearity in the readouts is a key feature in supervised machine learning applications. It guarantees that these systems can be used in high-dimensional situations and in the presence of large datasets. The L p criteria used in this paper allow the formulation of universality results that do not necessarily impose almost sure uniform boundedness in the inputs or the fading memory property in the filter that needs to be approximated.
Key facts. Cited by 48 papers in the map (data through 7 Oct 2026). First posted on arXiv 7 Jul 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 6; 2022: 7; 2023: 10; 2024: 12; 2025: 7; 2026: 6.
48 papers.
Sort:
- 2021Next Generation Reservoir Computingcited by 160
- 2021Optimal Stopping via Randomized Neural Networkscited by 26
- 2022Designing Universal Causal Deep Learning Models: The Geometric (Hyper)Transformercited by 22
- 2022Designing Universal Causal Deep Learning Models: The Case of Infinite-Dimensional Dynamical Systems from Stochastic Analysiscited by 22
- 2023A Survey on Reservoir Computing and its Interdisciplinary Applications Beyond Traditional Machine Learningcited by 22
- 2021Model-free inference of unseen attractors: Reconstructing phase space features from a single noisy trajectory using reservoir computingcited by 21
- 2021Learning strange attractors with reservoir systemscited by 16
- 2023A Brief Survey on the Approximation Theory for Sequence Modellingcited by 15
- 2023Universal Approximation Theorem and error bounds for quantum neural networks and quantum reservoirscited by 15
- 2022Learning unseen coexisting attractorscited by 12
- 2022Catch-22s of reservoir computingcited by 11
- 2024Controlling Chaos Using Edge Computing Hardwarecited by 11
36 more
- 2023Inverse Approximation Theory for Nonlinear Recurrent Neural Networkscited by 10
- 2024Infinite-dimensional next-generation reservoir computingcited by 9
- 2022Reservoir kernels and Volterra seriescited by 8
- 2023Infinite-dimensional reservoir computingcited by 7
- 2022Universality and approximation bounds for echo state networks with random weightscited by 5
- 2023Memory of recurrent networks: Do we compute it right?cited by 5
- 2024Positional Encoding Helps Recurrent Neural Networks Handle a Large Vocabularycited by 5
- 2025Feedback-driven recurrent quantum neural network universalitycited by 5
- 2024Stochastic Reservoir Computerscited by 4
- 2024Universal randomised signatures for generative time series modellingcited by 4
- 2021Nonlinear Autoregression with Convergent Dynamics on Novel Computational Platformscited by 3
- 2021Master memory function for delay-based reservoir computers with single-variable dynamicscited by 3
- 2024State-space systems as dynamic generative modelscited by 3
- 2024Universality of Real Minimal Complexity Reservoircited by 3
- 2024RandNet-Parareal: a time-parallel PDE solver using Random Neural Networkscited by 3
- 2025Asymptotic evaluation of the information processing capacity in reservoir computingcited by 3
- 2023Effect of temporal resolution on the reproduction of chaotic dynamics via reservoir computingcited by 2
- 2023Reservoir Computing with Error Correction: Long-term Behaviors of Stochastic Dynamical Systemscited by 2
- 2023Improving the Performance of Echo State Networks Through State Feedbackcited by 2
- 2025Adaptive Nonlinear Vector Autoregression: Robust Forecasting for Noisy Chaotic Time Seriescited by 2
- 2022Universal Time-Uniform Trajectory Approximation for Random Dynamical Systems with Recurrent Neural Networkscited by 1
- 2023Refined Kolmogorov Complexity of Analog, Evolving and Stochastic Recurrent Neural Networkscited by 1
- 2024Universality of reservoir systems with recurrent neural networkscited by 1
- 2024Separation capacity of linear reservoirs with random connectivity matrixcited by 1
- 2025Frozen in Time: Parameter-Efficient Time Series Transformers via Reservoir-Induced Feature Expansion and Fixed Random Dynamicscited by 1
- 2024Estimation of AMOC transition probabilities using a machine learning based rare-event algorithmcited by 0
- 2024Unsupervised Reservoir Computing for Multivariate Denoising of Severely Contaminated Signalscited by 0
- 2025A tensor network approach for chaotic time series predictioncited by 0
- 2025A Solvable Molecular Switch Model for Stable Temporal Information Processingcited by 0
- 2025Symplectic Representation of Legendre Dynamicscited by 0
- 2026ParalESN: Enabling parallel information processing in Reservoir Computingcited by 0
- 2026Recurrent Quantum Feature Maps for Reservoir Computingcited by 0
- 2026Data-Specific Hyper-Parameter Design: A Paradigm Shift in Reservoir Computingcited by 0
- 2026Kolmogorov-Arnold Reservoir Computingcited by 0
- 2026NeuralChaos: Optimal Adapted Approximation of Square Integrable Predictable Processescited by 0
- 2026Free-Probability Kernels for Zero-Rollout Hyperparameter Selection in Reservoir Computingcited by 0
- 2026Free-Probability Kernels for Zero-Rollout Hyperparameter Selection in Reservoir Computing21 Aug 2026
- 2026NeuralChaos: Optimal Adapted Approximation of Square Integrable Predictable Processes15 Jul 2026
- 2026Kolmogorov-Arnold Reservoir Computing18 Jun 2026
- 2026Data-Specific Hyper-Parameter Design: A Paradigm Shift in Reservoir Computing24 May 2026
- 2026Recurrent Quantum Feature Maps for Reservoir Computing3 Apr 2026
- 2026ParalESN: Enabling parallel information processing in Reservoir Computing29 Jan 2026
- 2025Symplectic Representation of Legendre Dynamics22 Dec 2025
- 2025Frozen in Time: Parameter-Efficient Time Series Transformers via Reservoir-Induced Feature Expansion and Fixed Random Dynamics25 Aug 2025
- 2025A Solvable Molecular Switch Model for Stable Temporal Information Processing21 Aug 2025
- 2025Adaptive Nonlinear Vector Autoregression: Robust Forecasting for Noisy Chaotic Time Series11 Jul 2025
- 2025Feedback-driven recurrent quantum neural network universality19 Jun 2025
- 2025A tensor network approach for chaotic time series prediction23 May 2025
36 more
- 2025Asymptotic evaluation of the information processing capacity in reservoir computing15 Feb 2025
- 2024Infinite-dimensional next-generation reservoir computing13 Dec 2024
- 2024RandNet-Parareal: a time-parallel PDE solver using Random Neural Networks9 Nov 2024
- 2024Universality of Real Minimal Complexity Reservoir15 Aug 2024
- 2024Unsupervised Reservoir Computing for Multivariate Denoising of Severely Contaminated Signals26 Jul 2024
- 2024Universal randomised signatures for generative time series modelling14 Jun 2024
- 2024Stochastic Reservoir Computers20 May 2024
- 2024Controlling Chaos Using Edge Computing Hardware8 May 2024
- 2024Separation capacity of linear reservoirs with random connectivity matrix26 Apr 2024
- 2024State-space systems as dynamic generative models12 Apr 2024
- 2024Universality of reservoir systems with recurrent neural networks4 Mar 2024
- 2024Positional Encoding Helps Recurrent Neural Networks Handle a Large Vocabulary31 Jan 2024
- 2024Estimation of AMOC transition probabilities using a machine learning based rare-event algorithm19 Jan 2024
- 2023Improving the Performance of Echo State Networks Through State Feedback23 Dec 2023
- 2023Refined Kolmogorov Complexity of Analog, Evolving and Stochastic Recurrent Neural Networks29 Sep 2023
- 2023A Survey on Reservoir Computing and its Interdisciplinary Applications Beyond Traditional Machine Learning27 Jul 2023
- 2023Universal Approximation Theorem and error bounds for quantum neural networks and quantum reservoirs24 Jul 2023
- 2023Inverse Approximation Theory for Nonlinear Recurrent Neural Networks30 May 2023
- 2023Memory of recurrent networks: Do we compute it right?2 May 2023
- 2023Reservoir Computing with Error Correction: Long-term Behaviors of Stochastic Dynamical Systems1 May 2023
- 2023Infinite-dimensional reservoir computing2 Apr 2023
- 2023A Brief Survey on the Approximation Theory for Sequence Modelling27 Feb 2023
- 2023Effect of temporal resolution on the reproduction of chaotic dynamics via reservoir computing27 Jan 2023
- 2022Reservoir kernels and Volterra series30 Dec 2022
- 2022Universal Time-Uniform Trajectory Approximation for Random Dynamical Systems with Recurrent Neural Networks15 Nov 2022
- 2022Designing Universal Causal Deep Learning Models: The Case of Infinite-Dimensional Dynamical Systems from Stochastic Analysis24 Oct 2022
- 2022Catch-22s of reservoir computing18 Oct 2022
- 2022Learning unseen coexisting attractors28 Jul 2022
- 2022Universality and approximation bounds for echo state networks with random weights12 Jun 2022
- 2022Designing Universal Causal Deep Learning Models: The Geometric (Hyper)Transformer31 Jan 2022
- 2021Master memory function for delay-based reservoir computers with single-variable dynamics28 Aug 2021
- 2021Nonlinear Autoregression with Convergent Dynamics on Novel Computational Platforms18 Aug 2021
- 2021Learning strange attractors with reservoir systems11 Aug 2021
- 2021Model-free inference of unseen attractors: Reconstructing phase space features from a single noisy trajectory using reservoir computing6 Aug 2021
- 2021Next Generation Reservoir Computing14 Jun 2021
- 2021Optimal Stopping via Randomized Neural Networks28 Apr 2021
- 2021Next Generation Reservoir Computingcited by 160
- 2021Optimal Stopping via Randomized Neural Networkscited by 26
- 2022Designing Universal Causal Deep Learning Models: The Geometric (Hyper)Transformercited by 22
- 2022Designing Universal Causal Deep Learning Models: The Case of Infinite-Dimensional Dynamical Systems from Stochastic Analysiscited by 22
- 2023A Survey on Reservoir Computing and its Interdisciplinary Applications Beyond Traditional Machine Learningcited by 22
- 2021Model-free inference of unseen attractors: Reconstructing phase space features from a single noisy trajectory using reservoir computingcited by 21
- 2021Learning strange attractors with reservoir systemscited by 16
- 2023A Brief Survey on the Approximation Theory for Sequence Modellingcited by 15
- 2023Universal Approximation Theorem and error bounds for quantum neural networks and quantum reservoirscited by 15
- 2022Learning unseen coexisting attractorscited by 12
- 2022Catch-22s of reservoir computingcited by 11
- 2024Controlling Chaos Using Edge Computing Hardwarecited by 11
12 most cited of 48 All 48 (JSON)
- 2026Free-Probability Kernels for Zero-Rollout Hyperparameter Selection in Reservoir Computing21 Aug 2026
- 2026NeuralChaos: Optimal Adapted Approximation of Square Integrable Predictable Processes15 Jul 2026
- 2026Kolmogorov-Arnold Reservoir Computing18 Jun 2026
- 2026Data-Specific Hyper-Parameter Design: A Paradigm Shift in Reservoir Computing24 May 2026
- 2026Recurrent Quantum Feature Maps for Reservoir Computing3 Apr 2026
- 2026ParalESN: Enabling parallel information processing in Reservoir Computing29 Jan 2026
- 2025Symplectic Representation of Legendre Dynamics22 Dec 2025
- 2025Frozen in Time: Parameter-Efficient Time Series Transformers via Reservoir-Induced Feature Expansion and Fixed Random Dynamics25 Aug 2025
- 2025A Solvable Molecular Switch Model for Stable Temporal Information Processing21 Aug 2025
- 2025Adaptive Nonlinear Vector Autoregression: Robust Forecasting for Noisy Chaotic Time Series11 Jul 2025
- 2025Feedback-driven recurrent quantum neural network universality19 Jun 2025
- 2025A tensor network approach for chaotic time series prediction23 May 2025
12 newest of 48 All 48 (JSON)