mlsanityData to 14 Oct 2026

Data-driven Prediction of General Hamiltonian Dynamics via Learning Exactly-Symplectic Maps

arXiv 2103.05632 ↗First posted 9 Mar 2021cs.LG cs.NA math.DScited by 41

Not on the map. Why?

Abstract (arXiv)

We consider the learning and prediction of nonlinear time series generated by a latent symplectic map. A special case is (not necessarily separable) Hamiltonian systems, whose solution flows give such symplectic maps. For this special case, both generic approaches based on learning the vector field of the latent ODE and specialized approaches based on learning the Hamiltonian that generates the vector field exist. Our method, however, is different as it does not rely on the vector field nor assume its existence; instead, it directly learns the symplectic evolution map in discrete time. Moreover, we do so by representing the symplectic map via a generating function, which we approximate by a neural network (hence the name GFNN). This way, our approximation of the evolution map is always exactly symplectic. This additional geometric structure allows the local prediction error at each step to accumulate in a controlled fashion, and we will prove, under reasonable assumptions, that the global prediction error grows at most linearly with long prediction time, which significantly improves an otherwise exponential growth. In addition, as a map-based and thus purely data-driven method, GFNN avoids two additional sources of inaccuracies common in vector-field based approaches, namely the error in approximating the vector field by finite difference of the data, and the error in numerical integration of the vector field for making predictions. Numerical experiments further demonstrate our claims.

Key facts. Cited by 41 papers in the map (data through 14 Oct 2026). Builds on 15 of its 54 references that are in the map. First posted on arXiv 9 Mar 2021.

Builds on

15 of 54 references.

References · 15

  1. 2019Hamiltonian Neural Networkscited by 712
  2. 2016Error bounds for approximations with deep ReLU networkscited by 574
  3. 2017PDE-Net: Learning PDEs from Datacited by 311
  4. 2019Deep Lagrangian Networks: Using Physics as Model Prior for Deep Learningcited by 212
  5. 2017Hidden Physics Models: Machine Learning of Nonlinear Partial Differential Equationscited by 208
  6. 2019Symplectic ODE-Net: Learning Hamiltonian Dynamics with Controlcited by 184
  7. 2019Symplectic Recurrent Neural Networkscited by 150
  8. 2019Hamiltonian Generative Networkscited by 137
  9. 2018Data Driven Governing Equations Approximation Using Deep Neural Networkscited by 96
  10. 2018Multistep Neural Networks for Data-driven Discovery of Nonlinear Dynamical Systemscited by 89
  11. 2017Extracting Sparse High-Dimensional Dynamics from Limited Datacited by 50
  12. 2018Nonparametric inference of interaction laws in systems of agents from trajectory datacited by 44
3 more
  1. 2020Nonseparable Symplectic Neural Networkscited by 31
  2. 2019Structure-preserving Method for Reconstructing Unknown Hamiltonian Systems from Trajectory Datacited by 18
  3. 2020Tensorized Transformer for Dynamical Systems Modelingcited by 4

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2021: 6; 2022: 7; 2023: 9; 2024: 7; 2025: 8; 2026: 4.

41 papers.

Sort:

  1. 2021Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series Forecastingcited by 1,676
  2. 2024SAMformer: Unlocking the Potential of Transformers in Time Series Forecasting with Sharpness-Aware Minimization and Channel-Wise Attentioncited by 44
  3. 2021Symplectic Learning for Hamiltonian Neural Networkscited by 35
  4. 2024Zero-shot forecasting of chaotic systemscited by 28
  5. 2021Structure-preserving Sparse Identification of Nonlinear Dynamics for Data-driven Modelingcited by 27
  6. 2023Reversible and irreversible bracket-based dynamics for deep graph neural networkscited by 26
  7. 2022On Numerical Integration in Neural Ordinary Differential Equationscited by 21
  8. 2025Context parroting: A simple but tough-to-beat baseline for foundation models in scientific machine learningcited by 18
  9. 2021Locally-symplectic neural networks for learning volume-preserving dynamicscited by 9
  10. 2021Learning Large-Time-Step Molecular Dynamics with Graph Neural Networkscited by 9
  11. 2023Lie-Poisson Neural Networks (LPNets): Data-Based Computing of Hamiltonian Systems with Symmetriescited by 9
  12. 2022Learning Neural Hamiltonian Dynamics: A Methodological Overviewcited by 8
29 more
  1. 2024Analysing Multi-Task Regression via Random Matrix Theory with Application to Time Series Forecastingcited by 8
  2. 2023Hamiltonian Neural Networks with Automatic Symmetry Detectioncited by 6
  3. 2023Implementation and (Inverse Modified) Error Analysis for implicitly-templated ODE-netscited by 6
  4. 2023Symmetry Preservation in Hamiltonian Systems: Simulation and Learningcited by 6
  5. 2025Enabling Automatic Differentiation with Mollified Graph Neural Operatorscited by 6
  6. 2023Recurrences reveal shared causal drivers of complex time seriescited by 5
  7. 2021Approximation capabilities of measure-preserving neural networkscited by 4
  8. 2022Learning Trajectories of Hamiltonian Systems with Neural Networkscited by 4
  9. 2022ModLaNets: Learning Generalisable Dynamics via Modularity and Physical Inductive Biascited by 4
  10. 2024Symplectic Neural Networks Based on Dynamical Systemscited by 4
  11. 2024Symplectic Neural Flows for Modeling and Discoverycited by 4
  12. 2022Bayesian Identification of Nonseparable Hamiltonian Systems Using Stochastic Dynamic Modelscited by 3
  13. 2024CLPNets: Coupled Lie-Poisson Neural Networks for Multi-Part Hamiltonian Systems with Symmetriescited by 3
  14. 2026Post-Training in Time Series Foundation Models: A Unifying Frameworkcited by 3
  15. 2022VPNets: Volume-preserving neural networks for learning source-free dynamicscited by 2
  16. 2023A hybrid approach for solving the gravitational N-body problem with Artificial Neural Networkscited by 2
  17. 2025Learning the action for long-time-step simulations of molecular dynamicscited by 2
  18. 2025Discovering Phase Space Structure in Learned Hamiltonian Systemscited by 2
  19. 2022Data-driven discovery of non-Newtonian astronomy via learning non-Euclidean Hamiltoniancited by 1
  20. 2023Separable Hamiltonian Neural Networkscited by 1
  21. 2023What's Next? Predicting Hamiltonian Dynamics from Discrete Observations of a Vector Fieldcited by 1
  22. 2025Learning Stochastic Hamiltonian Systems via Stochastic Generating Function Neural Networkcited by 1
  23. 2025Moment Estimate and Variational Approach for Learning Generalized Diffusion with Non-gradient Structurescited by 1
  24. 2025Time-adaptive SympNets for separable Hamiltonian systemscited by 1
  25. 2025Time-adaptive H'enonNets for separable Hamiltonian systemscited by 1
  26. 2026Frequency-Separable Hamiltonian Neural Network for Multi-Timescale Dynamicscited by 1
  27. 2024Learning Nonholonomic Dynamics with Constraint Discoverycited by 0
  28. 2026Latent Lie-Poisson Neural Networks (LLPNNs): Discovering the motion of Lie-Poisson systems through observable data and latent dynamicscited by 0
  29. 2026Extrapolating the emergence of Hamiltonian chaos with random-feature Hamiltonian neural networkscited by 0