mlsanityData to 14 Oct 2026

Adaptive Nonlinear Vector Autoregression: Robust Forecasting for Noisy Chaotic Time Series

arXiv 2507.08738 ↗First posted 11 Jul 2025cs.LG cs.AI math.DScited by 2

Not on the map. Why?

Abstract (arXiv)

Nonlinear vector autoregression (NVAR) and reservoir computing (RC) have shown promise in forecasting chaotic dynamical systems, such as the Lorenz-63 model and El Nino-Southern Oscillation. However, their reliance on fixed nonlinear transformations - polynomial expansions in NVAR or random feature maps in RC - limits their adaptability to high noise or complex real-world data. Furthermore, these methods also exhibit poor scalability in high-dimensional settings due to costly matrix inversion during optimization. We propose a data-adaptive NVAR model that combines delay-embedded linear inputs with features generated by a shallow, trainable multilayer perceptron (MLP). Unlike standard NVAR and RC models, the MLP and linear readout are jointly trained using gradient-based optimization, enabling the model to learn data-driven nonlinearities, while preserving a simple readout structure and improving scalability. Initial experiments across multiple chaotic systems, tested under noise-free and synthetically noisy conditions, showed that the adaptive model outperformed in predictive accuracy the standard NVAR, a leaky echo state network (ESN) - the most common RC model - and a hybrid ESN, thereby showing robust forecasting under noisy conditions.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 13 of its 56 references that are in the map. First posted on arXiv 11 Jul 2025.

Builds on

13 of 56 references.

References · 13

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  3. 2019Optuna: A Next-generation Hyperparameter Optimization Frameworkcited by 2,501
  4. 2018Scalable and accurate deep learning for electronic health recordscited by 280
  5. 2021Next Generation Reservoir Computingcited by 160
  6. 2015Learning to Diagnose with LSTM Recurrent Neural Networkscited by 99
  7. 2018Hybrid Forecasting of Chaotic Processes: Using Machine Learning in Conjunction with a Knowledge-Based Modelcited by 57
  8. 2018Reservoir Computing Universality With Stochastic Inputscited by 48
  9. 2016Predicting Clinical Events by Combining Static and Dynamic Information Using Recurrent Neural Networkscited by 9
  10. 2024Infinite-dimensional next-generation reservoir computingcited by 9
  11. 2025Learning dynamical systems with hit-and-run random feature mapscited by 8
  12. 2024Revisiting the Necessity of Graph Learning and Common Graph Benchmarkscited by 3
1 more
  1. 2024Predicting Chaotic System Behavior using Machine Learning Techniquescited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 2.

2 papers.