Neural Predictive Control to Coordinate Discrete- and Continuous-Time Models for Time-Series Analysis with Control-Theoretical Improvements
Not on the map. Why?
Abstract (arXiv)
Deep sequence models have achieved notable success in time-series analysis, such as interpolation and forecasting. Recent advances move beyond discrete-time architectures like Recurrent Neural Networks (RNNs) toward continuous-time formulations such as the family of Neural Ordinary Differential Equations (Neural ODEs). Generally, they have shown that capturing the underlying dynamics is beneficial for generic tasks like interpolation, extrapolation, and classification. However, existing methods approximate the dynamics using unconstrained neural networks, which struggle to adapt reliably under distributional shifts. In this paper, we recast time-series problems as the continuous ODE-based optimal control problem. Rather than learning dynamics solely from data, we optimize control actions that steer ODE trajectories toward task objectives, bringing control-theoretical performance guarantees. To achieve this goal, we need to (1) design the appropriate control actions and (2) apply effective optimal control algorithms. As the actions should contain rich context information, we propose to employ the discrete-time model to process past sequences and generate actions, leading to a coordinate model to extract long-term temporal features to modulate short-term continuous dynamics. During training, we apply model predictive control to plan multi-step future trajectories, minimize a task-specific cost, and greedily select the optimal current action. We show that, under mild assumptions, this multi-horizon optimization leads to exponential convergence to infinite-horizon solutions, indicating that the coordinate model can gain robust and generalizable performance. Extensive experiments on diverse time-series datasets validate our method's superior generalization and adaptability compared to state-of-the-art baselines.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 33 of its 69 references that are in the map. First posted on arXiv 3 Aug 2025.
Builds on
33 of 69 references.
References · 33
- 2017Attention Is All You Needcited by 60,361
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2018Neural Ordinary Differential Equationscited by 3,779
- 2021Efficiently Modeling Long Sequences with Structured State Spacescited by 2,465
- 2014Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modelingcited by 2,367
- 2020Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecastingcited by 2,169
- 2022Simplified State Space Layers for Sequence Modelingcited by 788
- 2016Recurrent Neural Networks for Multivariate Time Series with Missing Valuescited by 554
- 2020Neural Controlled Differential Equations for Irregular Time Seriescited by 506
- 2022Hungry Hungry Hippos: Towards Language Modeling with State Space Modelscited by 499
- 2022Transformers in Time Series: A Surveycited by 497
- 2022On the Parameterization and Initialization of Diagonal State Space Modelscited by 424
21 more
- 2019Augmented Neural ODEscited by 397
- 2019GRU-ODE-Bayes: Continuous modeling of sporadically-observed time seriescited by 231
- 2020Dissecting Neural ODEscited by 153
- 2020Neural Rough Differential Equations for Long Time Seriescited by 143
- 2021Modeling Irregular Time Series with Continuous Recurrent Unitscited by 103
- 2021Stable Neural ODE with Lyapunov-Stable Equilibrium Points for Defending Against Adversarial Attackscited by 91
- 2017Maximum Principle Based Algorithms for Deep Learningcited by 78
- 2018A Mean-Field Optimal Control Formulation of Deep Learningcited by 67
- 2021Neural ODE control for classification, approximation and transportcited by 57
- 2022LyaNet: A Lyapunov Framework for Training Neural ODEscited by 44
- 2019Deep learning as optimal control problems: models and numerical methodscited by 34
- 2017Discrete Event, Continuous Time RNNscited by 31
- 2021Attentive Neural Controlled Differential Equations for Time-series Classification and Forecastingcited by 29
- 2023Neural Continuous-Discrete State Space Models for Irregularly-Sampled Time Seriescited by 29
- 2019Deep Learning Theory Review: An Optimal Control and Dynamical Systems Perspectivecited by 27
- 2021KNODE-MPC: A Knowledge-based Data-driven Predictive Control Framework for Aerial Robotscited by 26
- 2025ExARNN: An Environment-Driven Adaptive RNN for Learning Non-Stationary Power Dynamicscited by 8
- 2020Robust Deep Learning as Optimal Control: Insights and Convergence Guaranteescited by 7
- 2020An unsupervised deep learning approach in solving partial integro-differential equationscited by 5
- 2023Multi-Step Model Predictive Safety Filters: Reducing Chattering by Increasing the Prediction Horizoncited by 5
- 2025External Data-Enhanced Meta-Representation for Adaptive Probabilistic Load Forecastingcited by 3
Built on by
Citing papers per year: 2025: 1; 2026: 2.
3 papers.