mlsanityData to 14 Oct 2026

Neural equilibria for long-term prediction of nonlinear conservation laws

arXiv 2501.06933 ↗First posted 12 Jan 2025cs.LG physics.comp-ph physics.flu-dyncited by 10

Not on the map. Why?

Abstract (arXiv)

Nonlinear conservation laws govern a broad class of important physical systems in science and industry and are central to scientific machine learning (SciML). Large general-purpose models offer speed, but replacing the numerical and physical structure of solvers often compromises stability, accuracy, and physical faithfulness. Here, we aim to balance the general inductive bias of conservation with the flexibility and speed of neural networks through a conservation-aware SciML backbone, which we call Neural Discrete Equilibrium (NeurDE). NeurDE places machine learning inside a kinetic solver by learning the local equilibrium closure of a Boltzmann formulation. The kinetic solver still performs transport, relaxation, moment recovery, and conservation; the neural network provides only the nonlinear equilibrium target. We test NeurDE on 6 conserved systems, including three very challenging subsonic, transonic, and supersonic shock systems. NeurDE outperforms state-of-the-art SciML methods, including neural operators and pretrained SciML foundation models that are 104 and 106 times larger, respectively. Most notably, NeurDE improves upon the numerical method from which it is derived. NeurDE therefore provides a compact target for scientific machine learning in conservative simulation: learn the equilibrium law toward which the system relaxes, not the evolution law itself.

Key facts. Cited by 10 papers in the map (data through 14 Oct 2026). Builds on 21 of its 83 references that are in the map. First posted on arXiv 12 Jan 2025.

Builds on

21 of 83 references.

References · 21

  1. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
  2. 2018Neural Ordinary Differential Equationscited by 3,779
  3. 2022A Time Series is Worth 64 Words: Long-term Forecasting with Transformerscited by 2,039
  4. 2019DeepONet: Learning nonlinear operators for identifying differential equations based on the universal approximation theorem of operatorscited by 2,018
  5. 2021Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series Forecastingcited by 1,676
  6. 2022FEDformer: Frequency Enhanced Decomposed Transformer for Long-term Series Forecastingcited by 1,210
  7. 2023iTransformer: Inverted Transformers Are Effective for Time Series Forecastingcited by 931
  8. 2021Characterizing possible failure modes in physics-informed neural networkscited by 643
  9. 2021Machine learning accelerated computational fluid dynamicscited by 471
  10. 2022Message Passing Neural PDE Solverscited by 386
  11. 2023PDE-Refiner: Achieving Accurate Long Rollouts with Neural PDE Solverscited by 216
  12. 2023Towards Foundation Models for Scientific Machine Learning: Characterizing Scaling and Transfer Behaviorcited by 131
9 more
  1. 2024Weak baselines and reporting biases lead to overoptimism in machine learning for fluid-related partial differential equationscited by 91
  2. 2017Multi-level Residual Networks from Dynamical Systems Viewcited by 59
  3. 2023Learning Physical Models that Can Respect Conservation Lawscited by 59
  4. 2023Multi-stage Neural Networks: Function Approximator of Machine Precisioncited by 48
  5. 2023Out-of-distributional risk bounds for neural operators with applications to the Helmholtz equationcited by 32
  6. 2022Learning continuous models for continuous physicscited by 28
  7. 2023Differentiable hybrid neural modeling for fluid-structure interactioncited by 18
  8. 2019Towards Robust ResNet: A Small Step but A Giant Leapcited by 15
  9. 2024Learning Physics for Unveiling Hidden Earthquake Ground Motions via Conditional Generative Modelingcited by 7

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 5; 2026: 5.

10 papers.