mlsanityData to 14 Oct 2026

Exact conservation laws for neural network integrators of dynamical systems

arXiv 2209.11661 ↗First posted 23 Sep 2022math.DS cs.LG gr-qccited by 15

Not on the map. Why?

Abstract (arXiv)

The solution of time dependent differential equations with neural networks has attracted a lot of attention recently. The central idea is to learn the laws that govern the evolution of the solution from data, which might be polluted with random noise. However, in contrast to other machine learning applications, usually a lot is known about the system at hand. For example, for many dynamical systems physical quantities such as energy or (angular) momentum are exactly conserved. Hence, the neural network has to learn these conservation laws from data and they will only be satisfied approximately due to finite training time and random noise. In this paper we present an alternative approach which uses Noether's Theorem to inherently incorporate conservation laws into the architecture of the neural network. We demonstrate that this leads to better predictions for three model systems: the motion of a non-relativistic particle in a three-dimensional Newtonian gravitational potential, the motion of a massive relativistic particle in the Schwarzschild metric and a system of two interacting particles in four dimensions.

Key facts. Cited by 15 papers in the map (data through 14 Oct 2026). Builds on 21 of its 50 references that are in the map. First posted on arXiv 23 Sep 2022.

Builds on

21 of 50 references.

References · 21

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,639
  3. 2018Relational inductive biases, deep learning, and graph networkscited by 1,360
  4. 2016Group Equivariant Convolutional Networkscited by 1,165
  5. 2020Learning to Simulate Complex Physics with Graph Networkscited by 880
  6. 2020Learning Mesh-Based Simulation with Graph Networkscited by 868
  7. 2018Tensor field networks: Rotation- and translation-equivariant neural networks for 3D point cloudscited by 746
  8. 2019Hamiltonian Neural Networkscited by 712
  9. 2017SchNet: A continuous-filter convolutional neural network for modeling quantum interactionscited by 571
  10. 2016Interaction Networks for Learning about Objects, Relations and Physicscited by 509
  11. 2020Lagrangian Neural Networkscited by 398
  12. 2020Generalizing Convolutional Neural Networks for Equivariance to Lie Groups on Arbitrary Continuous Datacited by 248
9 more
  1. 2019Symplectic Recurrent Neural Networkscited by 150
  2. 2021Scalars are universal: Equivariant machine learning, structured like classical physicscited by 127
  3. 2019Hamiltonian Graph Networks with ODE Integratorscited by 108
  4. 2020Structure-preserving neural networkscited by 55
  5. 2021Machine learning structure preserving brackets for forecasting irreversible processescited by 52
  6. 2021GFINNs: GENERIC Formalism Informed Neural Networks for Deterministic and Stochastic Dynamical Systemscited by 49
  7. 2019Physical Symmetries Embedded in Neural Networkscited by 40
  8. 2020Solving Newton's Equations of Motion with Large Timesteps using Recurrent Neural Networks based Operatorscited by 6
  9. 2021A simple equivariant machine learning method for dynamics based on scalarscited by 6

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2022: 1; 2023: 3; 2024: 4; 2025: 5; 2026: 2.

15 papers.

Sort:

By area: