Fading memory echo state networks are universal
Not on the map. Why?
Abstract (arXiv)
Echo state networks (ESNs) have been recently proved to be universal approximants for input/output systems with respect to various L p-type criteria. When 1≤ p< ∞, only p-integrability hypotheses need to be imposed, while in the case p=∞ a uniform boundedness hypotheses on the inputs is required. This note shows that, in the last case, a universal family of ESNs can be constructed that contains exclusively elements that have the echo state and the fading memory properties. This conclusion could not be drawn with the results and methods available so far in the literature.
Key facts. Cited by 32 papers in the map (data through 14 Oct 2026). First posted on arXiv 22 Oct 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 2; 2022: 5; 2023: 8; 2024: 6; 2025: 6; 2026: 5.
32 papers.
Sort:
By area:
- 2021Robust Optimization and Validation of Echo State Networks for learning chaotic dynamicscited by 27
- 2022Designing Universal Causal Deep Learning Models: The Geometric (Hyper)Transformercited by 22
- 2022Designing Universal Causal Deep Learning Models: The Case of Infinite-Dimensional Dynamical Systems from Stochastic Analysiscited by 22
- 2021Learning strange attractors with reservoir systemscited by 17
- 2023Universal Approximation Theorem and error bounds for quantum neural networks and quantum reservoirscited by 16
- 2023A Brief Survey on the Approximation Theory for Sequence Modellingcited by 15
- 2023Inverse Approximation Theory for Nonlinear Recurrent Neural Networkscited by 11
- 2024Infinite-dimensional next-generation reservoir computingcited by 9
- 2022Reservoir kernels and Volterra seriescited by 8
- 2023Infinite-dimensional reservoir computingcited by 7
- 2023Memory of recurrent networks: Do we compute it right?cited by 6
- 2022Universality and approximation bounds for echo state networks with random weightscited by 5
20 more
- 2025Feedback-driven recurrent quantum neural network universalitycited by 5
- 2024State-space systems as dynamic generative modelscited by 3
- 2025Role of scrambling and noise in temporal information processing with quantum systemscited by 3
- 2025Stochastic dynamics learning with state-space systemscited by 3
- 2023Reservoir Computing with Error Correction: Long-term Behaviors of Stochastic Dynamical Systemscited by 2
- 2024Approximation Rates and VC-Dimension Bounds for (P)ReLU MLP Mixture of Expertscited by 2
- 2024On the choice of the non-trainable internal weights in random feature mapscited by 2
- 2024Fading memory and the convolution theoremcited by 2
- 2022Universal Time-Uniform Trajectory Approximation for Random Dynamical Systems with Recurrent Neural Networkscited by 1
- 2023Refined Kolmogorov Complexity of Analog, Evolving and Stochastic Recurrent Neural Networkscited by 1
- 2024Universality of reservoir systems with recurrent neural networkscited by 1
- 2026On Dominant Manifolds in Reservoir Computing Networkscited by 1
- 2023Change Point Detection with Conceptorscited by 0
- 2025On the dimension of pullback attractors in recurrent neural networkscited by 0
- 2025A tensor network approach for chaotic time series predictioncited by 0
- 2025Fractal and Chaotic Activation Functions in Echo State Networks: Preprocessing Topology Governs the Echo State Propertycited by 0
- 2026Data-Specific Hyper-Parameter Design: A Paradigm Shift in Reservoir Computingcited by 0
- 2026Kolmogorov-Arnold Reservoir Computingcited by 0
- 2026NeuralChaos: Optimal Adapted Approximation of Square Integrable Predictable Processescited by 0
- 2026A KKL Observer Perspective on Reservoir Computingcited by 0
- 2026A KKL Observer Perspective on Reservoir Computing3 Oct 2026
- 2026NeuralChaos: Optimal Adapted Approximation of Square Integrable Predictable Processes15 Jul 2026
- 2026Kolmogorov-Arnold Reservoir Computing18 Jun 2026
- 2026Data-Specific Hyper-Parameter Design: A Paradigm Shift in Reservoir Computing24 May 2026
- 2026On Dominant Manifolds in Reservoir Computing Networks7 Apr 2026
- 2025Fractal and Chaotic Activation Functions in Echo State Networks: Preprocessing Topology Governs the Echo State Property16 Dec 2025
- 2025Stochastic dynamics learning with state-space systems11 Aug 2025
- 2025Feedback-driven recurrent quantum neural network universality19 Jun 2025
- 2025A tensor network approach for chaotic time series prediction23 May 2025
- 2025Role of scrambling and noise in temporal information processing with quantum systems15 May 2025
- 2025On the dimension of pullback attractors in recurrent neural networks20 Jan 2025
- 2024Infinite-dimensional next-generation reservoir computing13 Dec 2024
20 more
- 2024Fading memory and the convolution theorem14 Aug 2024
- 2024On the choice of the non-trainable internal weights in random feature maps7 Aug 2024
- 2024State-space systems as dynamic generative models12 Apr 2024
- 2024Universality of reservoir systems with recurrent neural networks4 Mar 2024
- 2024Approximation Rates and VC-Dimension Bounds for (P)ReLU MLP Mixture of Experts5 Feb 2024
- 2023Refined Kolmogorov Complexity of Analog, Evolving and Stochastic Recurrent Neural Networks29 Sep 2023
- 2023Change Point Detection with Conceptors11 Aug 2023
- 2023Universal Approximation Theorem and error bounds for quantum neural networks and quantum reservoirs24 Jul 2023
- 2023Inverse Approximation Theory for Nonlinear Recurrent Neural Networks30 May 2023
- 2023Memory of recurrent networks: Do we compute it right?2 May 2023
- 2023Reservoir Computing with Error Correction: Long-term Behaviors of Stochastic Dynamical Systems1 May 2023
- 2023Infinite-dimensional reservoir computing2 Apr 2023
- 2023A Brief Survey on the Approximation Theory for Sequence Modelling27 Feb 2023
- 2022Reservoir kernels and Volterra series30 Dec 2022
- 2022Universal Time-Uniform Trajectory Approximation for Random Dynamical Systems with Recurrent Neural Networks15 Nov 2022
- 2022Designing Universal Causal Deep Learning Models: The Case of Infinite-Dimensional Dynamical Systems from Stochastic Analysis24 Oct 2022
- 2022Universality and approximation bounds for echo state networks with random weights12 Jun 2022
- 2022Designing Universal Causal Deep Learning Models: The Geometric (Hyper)Transformer31 Jan 2022
- 2021Learning strange attractors with reservoir systems11 Aug 2021
- 2021Robust Optimization and Validation of Echo State Networks for learning chaotic dynamics9 Feb 2021
- 2021Robust Optimization and Validation of Echo State Networks for learning chaotic dynamicscited by 27
- 2022Designing Universal Causal Deep Learning Models: The Geometric (Hyper)Transformercited by 22
- 2022Designing Universal Causal Deep Learning Models: The Case of Infinite-Dimensional Dynamical Systems from Stochastic Analysiscited by 22
- 2021Learning strange attractors with reservoir systemscited by 17
- 2023Universal Approximation Theorem and error bounds for quantum neural networks and quantum reservoirscited by 16
- 2023A Brief Survey on the Approximation Theory for Sequence Modellingcited by 15
- 2023Inverse Approximation Theory for Nonlinear Recurrent Neural Networkscited by 11
- 2024Infinite-dimensional next-generation reservoir computingcited by 9
- 2022Reservoir kernels and Volterra seriescited by 8
- 2023Infinite-dimensional reservoir computingcited by 7
- 2023Memory of recurrent networks: Do we compute it right?cited by 6
- 2022Universality and approximation bounds for echo state networks with random weightscited by 5
12 most cited of 31 All 31 (JSON)
- 2026A KKL Observer Perspective on Reservoir Computing3 Oct 2026
- 2026NeuralChaos: Optimal Adapted Approximation of Square Integrable Predictable Processes15 Jul 2026
- 2026Kolmogorov-Arnold Reservoir Computing18 Jun 2026
- 2026Data-Specific Hyper-Parameter Design: A Paradigm Shift in Reservoir Computing24 May 2026
- 2026On Dominant Manifolds in Reservoir Computing Networks7 Apr 2026
- 2025Fractal and Chaotic Activation Functions in Echo State Networks: Preprocessing Topology Governs the Echo State Property16 Dec 2025
- 2025Stochastic dynamics learning with state-space systems11 Aug 2025
- 2025Feedback-driven recurrent quantum neural network universality19 Jun 2025
- 2025A tensor network approach for chaotic time series prediction23 May 2025
- 2025Role of scrambling and noise in temporal information processing with quantum systems15 May 2025
- 2025On the dimension of pullback attractors in recurrent neural networks20 Jan 2025
- 2024Infinite-dimensional next-generation reservoir computing13 Dec 2024
12 newest of 31 All 31 (JSON)