mlsanityData to 14 Oct 2026

Learning to simulate partially known spatio-temporal dynamics with trainable difference operators

arXiv 2307.14395 ↗First posted 26 Jul 2023cs.LG cs.AIcited by 1

Not on the map. Why?

Abstract (arXiv)

Recently, using neural networks to simulate spatio-temporal dynamics has received a lot of attention. However, most existing methods adopt pure data-driven black-box models, which have limited accuracy and interpretability. By combining trainable difference operators with black-box models, we propose a new hybrid architecture explicitly embedded with partial prior knowledge of the underlying PDEs named PDE-Net++. Furthermore, we introduce two distinct options called the trainable flipping difference layer (TFDL) and the trainable dynamic difference layer (TDDL) for the difference operators. Numerous numerical experiments have demonstrated that PDE-Net++ has superior prediction accuracy and better extrapolation performance than black-box models.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 31 of its 59 references that are in the map. First posted on arXiv 26 Jul 2023.

Builds on

31 of 59 references.

References · 31

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
  3. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
  4. 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,908
  5. 2019DeepONet: Learning nonlinear operators for identifying differential equations based on the universal approximation theorem of operatorscited by 2,018
  6. 2016HyperNetworkscited by 1,027
  7. 2020Learning Mesh-Based Simulation with Graph Networkscited by 868
  8. 2022FourCastNet: A Global Data-driven High-resolution Weather Model using Adaptive Fourier Neural Operatorscited by 776
  9. 2021Machine learning accelerated computational fluid dynamicscited by 471
  10. 2021Dynamic Neural Networks: A Surveycited by 408
  11. 2021Choose a Transformer: Fourier or Galerkincited by 343
  12. 2016Dynamic Filter Networkscited by 319
19 more
  1. 2017PDE-Net: Learning PDEs from Datacited by 311
  2. 2022GraphCast: Learning skillful medium-range global weather forecastingcited by 267
  3. 2021Factorized Fourier Neural Operatorscited by 249
  4. 2021Adaptive Fourier Neural Operators: Efficient Token Mixers for Transformerscited by 248
  5. 2018PDE-Net 2.0: Learning PDEs from Data with A Numeric-Symbolic Hybrid Deep Networkcited by 210
  6. 2020Solver-in-the-Loop: Learning from Differentiable Physics to Interact with Iterative PDE-Solverscited by 205
  7. 2019Towards Physics-informed Deep Learning for Turbulent Flow Predictioncited by 204
  8. 2018Bayesian Deep Convolutional Encoder-Decoder Networks for Surrogate Modeling and Uncertainty Quantificationcited by 199
  9. 2022Forecasting Global Weather with Graph Neural Networkscited by 168
  10. 2022Pangu-Weather: A 3D High-Resolution Model for Fast and Accurate Global Weather Forecastcited by 166
  11. 2019Prediction of Aerodynamic Flow Fields Using Convolutional Neural Networkscited by 145
  12. 2020Combining Differentiable PDE Solvers and Graph Neural Networks for Fluid Flow Predictioncited by 138
  13. 2019Pixel-Adaptive Convolutional Neural Networkscited by 126
  14. 2021Sub-seasonal forecasting with a large ensemble of deep-learning weather prediction modelscited by 79
  15. 2022Multi-resolution partial differential equations preserved learning framework for spatiotemporal dynamicscited by 44
  16. 2021Deep Learning for Reduced Order Modelling and Efficient Temporal Evolution of Fluid Simulationscited by 36
  17. 2021Graph Neural Networks Accelerated Molecular Dynamicscited by 33
  18. 2021Combining distribution-based neural networks to predict weather forecast probabilitiescited by 18
  19. 2020Graph Convolutional Neural Networks for Body Force Predictioncited by 16

Built on by

Cited by year

Citing papers per year: 2024: 1.

1 paper.