Data-driven Prediction of General Hamiltonian Dynamics via Learning Exactly-Symplectic Maps
Not on the map. Why?
Abstract (arXiv)
We consider the learning and prediction of nonlinear time series generated by a latent symplectic map. A special case is (not necessarily separable) Hamiltonian systems, whose solution flows give such symplectic maps. For this special case, both generic approaches based on learning the vector field of the latent ODE and specialized approaches based on learning the Hamiltonian that generates the vector field exist. Our method, however, is different as it does not rely on the vector field nor assume its existence; instead, it directly learns the symplectic evolution map in discrete time. Moreover, we do so by representing the symplectic map via a generating function, which we approximate by a neural network (hence the name GFNN). This way, our approximation of the evolution map is always exactly symplectic. This additional geometric structure allows the local prediction error at each step to accumulate in a controlled fashion, and we will prove, under reasonable assumptions, that the global prediction error grows at most linearly with long prediction time, which significantly improves an otherwise exponential growth. In addition, as a map-based and thus purely data-driven method, GFNN avoids two additional sources of inaccuracies common in vector-field based approaches, namely the error in approximating the vector field by finite difference of the data, and the error in numerical integration of the vector field for making predictions. Numerical experiments further demonstrate our claims.
Key facts. Cited by 41 papers in the map (data through 14 Oct 2026). Builds on 15 of its 54 references that are in the map. First posted on arXiv 9 Mar 2021.
Builds on
15 of 54 references.
References · 15
- 2019Hamiltonian Neural Networkscited by 712
- 2016Error bounds for approximations with deep ReLU networkscited by 574
- 2017PDE-Net: Learning PDEs from Datacited by 311
- 2019Deep Lagrangian Networks: Using Physics as Model Prior for Deep Learningcited by 212
- 2017Hidden Physics Models: Machine Learning of Nonlinear Partial Differential Equationscited by 208
- 2019Symplectic ODE-Net: Learning Hamiltonian Dynamics with Controlcited by 184
- 2019Symplectic Recurrent Neural Networkscited by 150
- 2019Hamiltonian Generative Networkscited by 137
- 2018Data Driven Governing Equations Approximation Using Deep Neural Networkscited by 96
- 2018Multistep Neural Networks for Data-driven Discovery of Nonlinear Dynamical Systemscited by 89
- 2017Extracting Sparse High-Dimensional Dynamics from Limited Datacited by 50
- 2018Nonparametric inference of interaction laws in systems of agents from trajectory datacited by 44
3 more
Built on by
Citing papers per year: 2021: 6; 2022: 7; 2023: 9; 2024: 7; 2025: 8; 2026: 4.
41 papers.
Sort:
- 2021Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series Forecastingcited by 1,676
- 2024SAMformer: Unlocking the Potential of Transformers in Time Series Forecasting with Sharpness-Aware Minimization and Channel-Wise Attentioncited by 44
- 2021Symplectic Learning for Hamiltonian Neural Networkscited by 35
- 2024Zero-shot forecasting of chaotic systemscited by 28
- 2021Structure-preserving Sparse Identification of Nonlinear Dynamics for Data-driven Modelingcited by 27
- 2023Reversible and irreversible bracket-based dynamics for deep graph neural networkscited by 26
- 2022On Numerical Integration in Neural Ordinary Differential Equationscited by 21
- 2025Context parroting: A simple but tough-to-beat baseline for foundation models in scientific machine learningcited by 18
- 2021Locally-symplectic neural networks for learning volume-preserving dynamicscited by 9
- 2021Learning Large-Time-Step Molecular Dynamics with Graph Neural Networkscited by 9
- 2023Lie-Poisson Neural Networks (LPNets): Data-Based Computing of Hamiltonian Systems with Symmetriescited by 9
- 2022Learning Neural Hamiltonian Dynamics: A Methodological Overviewcited by 8
29 more
- 2024Analysing Multi-Task Regression via Random Matrix Theory with Application to Time Series Forecastingcited by 8
- 2023Hamiltonian Neural Networks with Automatic Symmetry Detectioncited by 6
- 2023Implementation and (Inverse Modified) Error Analysis for implicitly-templated ODE-netscited by 6
- 2023Symmetry Preservation in Hamiltonian Systems: Simulation and Learningcited by 6
- 2025Enabling Automatic Differentiation with Mollified Graph Neural Operatorscited by 6
- 2023Recurrences reveal shared causal drivers of complex time seriescited by 5
- 2021Approximation capabilities of measure-preserving neural networkscited by 4
- 2022Learning Trajectories of Hamiltonian Systems with Neural Networkscited by 4
- 2022ModLaNets: Learning Generalisable Dynamics via Modularity and Physical Inductive Biascited by 4
- 2024Symplectic Neural Networks Based on Dynamical Systemscited by 4
- 2024Symplectic Neural Flows for Modeling and Discoverycited by 4
- 2022Bayesian Identification of Nonseparable Hamiltonian Systems Using Stochastic Dynamic Modelscited by 3
- 2024CLPNets: Coupled Lie-Poisson Neural Networks for Multi-Part Hamiltonian Systems with Symmetriescited by 3
- 2026Post-Training in Time Series Foundation Models: A Unifying Frameworkcited by 3
- 2022VPNets: Volume-preserving neural networks for learning source-free dynamicscited by 2
- 2023A hybrid approach for solving the gravitational N-body problem with Artificial Neural Networkscited by 2
- 2025Learning the action for long-time-step simulations of molecular dynamicscited by 2
- 2025Discovering Phase Space Structure in Learned Hamiltonian Systemscited by 2
- 2022Data-driven discovery of non-Newtonian astronomy via learning non-Euclidean Hamiltoniancited by 1
- 2023Separable Hamiltonian Neural Networkscited by 1
- 2023What's Next? Predicting Hamiltonian Dynamics from Discrete Observations of a Vector Fieldcited by 1
- 2025Learning Stochastic Hamiltonian Systems via Stochastic Generating Function Neural Networkcited by 1
- 2025Moment Estimate and Variational Approach for Learning Generalized Diffusion with Non-gradient Structurescited by 1
- 2025Time-adaptive SympNets for separable Hamiltonian systemscited by 1
- 2025Time-adaptive H'enonNets for separable Hamiltonian systemscited by 1
- 2026Frequency-Separable Hamiltonian Neural Network for Multi-Timescale Dynamicscited by 1
- 2024Learning Nonholonomic Dynamics with Constraint Discoverycited by 0
- 2026Latent Lie-Poisson Neural Networks (LLPNNs): Discovering the motion of Lie-Poisson systems through observable data and latent dynamicscited by 0
- 2026Extrapolating the emergence of Hamiltonian chaos with random-feature Hamiltonian neural networkscited by 0
- 2026Extrapolating the emergence of Hamiltonian chaos with random-feature Hamiltonian neural networks31 Jul 2026
- 2026Latent Lie-Poisson Neural Networks (LLPNNs): Discovering the motion of Lie-Poisson systems through observable data and latent dynamics31 Jul 2026
- 2026Post-Training in Time Series Foundation Models: A Unifying Framework22 Jul 2026
- 2026Frequency-Separable Hamiltonian Neural Network for Multi-Timescale Dynamics6 Mar 2026
- 2025Discovering Phase Space Structure in Learned Hamiltonian Systems26 Sep 2025
- 2025Time-adaptive H'enonNets for separable Hamiltonian systems24 Sep 2025
- 2025Time-adaptive SympNets for separable Hamiltonian systems19 Sep 2025
- 2025Moment Estimate and Variational Approach for Learning Generalized Diffusion with Non-gradient Structures3 Aug 2025
- 2025Learning the action for long-time-step simulations of molecular dynamics1 Aug 2025
- 2025Learning Stochastic Hamiltonian Systems via Stochastic Generating Function Neural Network19 Jul 2025
- 2025Context parroting: A simple but tough-to-beat baseline for foundation models in scientific machine learning16 May 2025
- 2025Enabling Automatic Differentiation with Mollified Graph Neural Operators11 Apr 2025
29 more
- 2024Symplectic Neural Flows for Modeling and Discovery21 Dec 2024
- 2024Learning Nonholonomic Dynamics with Constraint Discovery19 Oct 2024
- 2024Zero-shot forecasting of chaotic systems24 Sep 2024
- 2024CLPNets: Coupled Lie-Poisson Neural Networks for Multi-Part Hamiltonian Systems with Symmetries28 Aug 2024
- 2024Symplectic Neural Networks Based on Dynamical Systems19 Aug 2024
- 2024Analysing Multi-Task Regression via Random Matrix Theory with Application to Time Series Forecasting14 Jun 2024
- 2024SAMformer: Unlocking the Potential of Transformers in Time Series Forecasting with Sharpness-Aware Minimization and Channel-Wise Attention15 Feb 2024
- 2023What's Next? Predicting Hamiltonian Dynamics from Discrete Observations of a Vector Field14 Dec 2023
- 2023A hybrid approach for solving the gravitational N-body problem with Artificial Neural Networks31 Oct 2023
- 2023Separable Hamiltonian Neural Networks3 Sep 2023
- 2023Symmetry Preservation in Hamiltonian Systems: Simulation and Learning30 Aug 2023
- 2023Lie-Poisson Neural Networks (LPNets): Data-Based Computing of Hamiltonian Systems with Symmetries29 Aug 2023
- 2023Reversible and irreversible bracket-based dynamics for deep graph neural networks24 May 2023
- 2023Implementation and (Inverse Modified) Error Analysis for implicitly-templated ODE-nets31 Mar 2023
- 2023Recurrences reveal shared causal drivers of complex time series31 Jan 2023
- 2023Hamiltonian Neural Networks with Automatic Symmetry Detection19 Jan 2023
- 2022Data-driven discovery of non-Newtonian astronomy via learning non-Euclidean Hamiltonian30 Sep 2022
- 2022Bayesian Identification of Nonseparable Hamiltonian Systems Using Stochastic Dynamic Models15 Sep 2022
- 2022ModLaNets: Learning Generalisable Dynamics via Modularity and Physical Inductive Bias24 Jun 2022
- 2022On Numerical Integration in Neural Ordinary Differential Equations15 Jun 2022
- 2022VPNets: Volume-preserving neural networks for learning source-free dynamics29 Apr 2022
- 2022Learning Trajectories of Hamiltonian Systems with Neural Networks11 Apr 2022
- 2022Learning Neural Hamiltonian Dynamics: A Methodological Overview28 Feb 2022
- 2021Learning Large-Time-Step Molecular Dynamics with Graph Neural Networks30 Nov 2021
- 2021Locally-symplectic neural networks for learning volume-preserving dynamics19 Sep 2021
- 2021Structure-preserving Sparse Identification of Nonlinear Dynamics for Data-driven Modeling11 Sep 2021
- 2021Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series Forecasting24 Jun 2021
- 2021Symplectic Learning for Hamiltonian Neural Networks22 Jun 2021
- 2021Approximation capabilities of measure-preserving neural networks21 Jun 2021
- 2021Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series Forecastingcited by 1,676
- 2024SAMformer: Unlocking the Potential of Transformers in Time Series Forecasting with Sharpness-Aware Minimization and Channel-Wise Attentioncited by 44
- 2021Symplectic Learning for Hamiltonian Neural Networkscited by 35
- 2024Zero-shot forecasting of chaotic systemscited by 28
- 2021Structure-preserving Sparse Identification of Nonlinear Dynamics for Data-driven Modelingcited by 27
- 2023Reversible and irreversible bracket-based dynamics for deep graph neural networkscited by 26
- 2022On Numerical Integration in Neural Ordinary Differential Equationscited by 21
- 2025Context parroting: A simple but tough-to-beat baseline for foundation models in scientific machine learningcited by 18
- 2021Locally-symplectic neural networks for learning volume-preserving dynamicscited by 9
- 2021Learning Large-Time-Step Molecular Dynamics with Graph Neural Networkscited by 9
- 2023Lie-Poisson Neural Networks (LPNets): Data-Based Computing of Hamiltonian Systems with Symmetriescited by 9
- 2022Learning Neural Hamiltonian Dynamics: A Methodological Overviewcited by 8
12 most cited of 41 All 41 (JSON)
- 2026Extrapolating the emergence of Hamiltonian chaos with random-feature Hamiltonian neural networks31 Jul 2026
- 2026Latent Lie-Poisson Neural Networks (LLPNNs): Discovering the motion of Lie-Poisson systems through observable data and latent dynamics31 Jul 2026
- 2026Post-Training in Time Series Foundation Models: A Unifying Framework22 Jul 2026
- 2026Frequency-Separable Hamiltonian Neural Network for Multi-Timescale Dynamics6 Mar 2026
- 2025Discovering Phase Space Structure in Learned Hamiltonian Systems26 Sep 2025
- 2025Time-adaptive H'enonNets for separable Hamiltonian systems24 Sep 2025
- 2025Time-adaptive SympNets for separable Hamiltonian systems19 Sep 2025
- 2025Moment Estimate and Variational Approach for Learning Generalized Diffusion with Non-gradient Structures3 Aug 2025
- 2025Learning the action for long-time-step simulations of molecular dynamics1 Aug 2025
- 2025Learning Stochastic Hamiltonian Systems via Stochastic Generating Function Neural Network19 Jul 2025
- 2025Context parroting: A simple but tough-to-beat baseline for foundation models in scientific machine learning16 May 2025
- 2025Enabling Automatic Differentiation with Mollified Graph Neural Operators11 Apr 2025
12 newest of 41 All 41 (JSON)