mlsanityData to 7 Oct 2026

Space and Time Continuous Physics Simulation From Partial Observations

arXiv 2401.09198 ↗First posted 17 Jan 2024cs.LGcited by 6

Not on the map. Why?

Abstract (arXiv)

Modern techniques for physical simulations rely on numerical schemes and mesh-refinement methods to address trade-offs between precision and complexity, but these handcrafted solutions are tedious and require high computational power. Data-driven methods based on large-scale machine learning promise high adaptivity by integrating long-range dependencies more directly and efficiently. In this work, we focus on fluid dynamics and address the shortcomings of a large part of the literature, which are based on fixed support for computations and predictions in the form of regular or irregular grids. We propose a novel setup to perform predictions in a continuous spatial and temporal domain while being trained on sparse observations. We formulate the task as a double observation problem and propose a solution with two interlinked dynamical systems defined on, respectively, the sparse positions and the continuous domain, which allows to forecast and interpolate a solution from the initial condition. Our practical implementation involves recurrent GNNs and a spatio-temporal attention observer capable of interpolating the solution at arbitrary locations. Our model not only generalizes to new initial conditions (as standard auto-regressive models do) but also performs evaluation at arbitrary space and time locations. We evaluate on three standard datasets in fluid dynamics and compare to strong baselines, which are outperformed both in classical settings and in the extended new task requiring continuous predictions.

Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Builds on 31 of its 49 references that are in the map. First posted on arXiv 17 Jan 2024.

Builds on

31 of 49 references.

References · 31

  1. 2017Attention Is All You Needcited by 59,932
  2. 2014Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translationcited by 4,016
  3. 2018Neural Ordinary Differential Equationscited by 3,733
  4. 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,806
  5. 2020Implicit Neural Representations with Periodic Activation Functionscited by 2,214
  6. 2020Learning to Simulate Complex Physics with Graph Networkscited by 867
  7. 2020Learning Mesh-Based Simulation with Graph Networkscited by 840
  8. 2020When and why PINNs fail to train: A neural tangent kernel perspectivecited by 629
  9. 2016Interaction Networks for Learning about Objects, Relations and Physicscited by 503
  10. 2021Physics-informed neural networks (PINNs) for fluid mechanics: A reviewcited by 470
  11. 2019Augmented Neural ODEscited by 396
  12. 2022Message Passing Neural PDE Solverscited by 368
19 more
  1. 2017Physics Informed Deep Learning (Part I): Data-driven Solutions of Nonlinear Partial Differential Equationscited by 362
  2. 2020Multipole Graph Neural Operator for Parametric Partial Differential Equationscited by 343
  3. 2019Attentive Neural Processescited by 280
  4. 2021Physics-informed neural networks with hard constraints for inverse designcited by 277
  5. 2018Learning Particle Dynamics for Manipulating Rigid Bodies, Deformable Objects, and Fluidscited by 219
  6. 2020Disentangling Physical Dynamics from Unknown Factors for Unsupervised Video Predictioncited by 192
  7. 2021Translating Images into Mapscited by 115
  8. 2017Deep Learning for Physical Processes: Incorporating Prior Scientific Knowledgecited by 95
  9. 2022Predicting Physics in Mesh-reduced Space with Temporal Attentioncited by 82
  10. 2019Physics-Informed Neural Networks for Power Systemscited by 80
  11. 2022Continuous PDE Dynamics Forecasting with Implicit Neural Representationscited by 71
  12. 2023Eagle: Large-Scale Learning of Turbulent Fluid Dynamics with Mesh Transformerscited by 54
  13. 2022Learning to Accelerate Partial Differential Equations via Latent Global Evolutioncited by 38
  14. 2022MAgNet: Mesh Agnostic Neural PDE Solvercited by 28
  15. 2022Competitive Physics Informed Networkscited by 19
  16. 2023A Stable and Scalable Method for Solving Initial Value PDEs with Neural Networkscited by 15
  17. 2022Filtered-CoPhy: Unsupervised Learning of Counterfactual Physics in Pixel Spacecited by 14
  18. 2022Simple initialization and parametrization of sinusoidal networks via their kernel bandwidthcited by 6
  19. 2022Learning Reduced Nonlinear State-Space Models: an Output-Error Based Canonical Approachcited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 2; 2025: 3; 2026: 1.

6 papers.