Learning to simulate partially known spatio-temporal dynamics with trainable difference operators
Not on the map. Why?
Abstract (arXiv)
Recently, using neural networks to simulate spatio-temporal dynamics has received a lot of attention. However, most existing methods adopt pure data-driven black-box models, which have limited accuracy and interpretability. By combining trainable difference operators with black-box models, we propose a new hybrid architecture explicitly embedded with partial prior knowledge of the underlying PDEs named PDE-Net++. Furthermore, we introduce two distinct options called the trainable flipping difference layer (TFDL) and the trainable dynamic difference layer (TDDL) for the difference operators. Numerous numerical experiments have demonstrated that PDE-Net++ has superior prediction accuracy and better extrapolation performance than black-box models.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 31 of its 59 references that are in the map. First posted on arXiv 26 Jul 2023.
Builds on
31 of 59 references.
References · 31
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
- 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,908
- 2019DeepONet: Learning nonlinear operators for identifying differential equations based on the universal approximation theorem of operatorscited by 2,018
- 2016HyperNetworkscited by 1,027
- 2020Learning Mesh-Based Simulation with Graph Networkscited by 868
- 2022FourCastNet: A Global Data-driven High-resolution Weather Model using Adaptive Fourier Neural Operatorscited by 776
- 2021Machine learning accelerated computational fluid dynamicscited by 471
- 2021Dynamic Neural Networks: A Surveycited by 408
- 2021Choose a Transformer: Fourier or Galerkincited by 343
- 2016Dynamic Filter Networkscited by 319
19 more
- 2017PDE-Net: Learning PDEs from Datacited by 311
- 2022GraphCast: Learning skillful medium-range global weather forecastingcited by 267
- 2021Factorized Fourier Neural Operatorscited by 249
- 2021Adaptive Fourier Neural Operators: Efficient Token Mixers for Transformerscited by 248
- 2018PDE-Net 2.0: Learning PDEs from Data with A Numeric-Symbolic Hybrid Deep Networkcited by 210
- 2020Solver-in-the-Loop: Learning from Differentiable Physics to Interact with Iterative PDE-Solverscited by 205
- 2019Towards Physics-informed Deep Learning for Turbulent Flow Predictioncited by 204
- 2018Bayesian Deep Convolutional Encoder-Decoder Networks for Surrogate Modeling and Uncertainty Quantificationcited by 199
- 2022Forecasting Global Weather with Graph Neural Networkscited by 168
- 2022Pangu-Weather: A 3D High-Resolution Model for Fast and Accurate Global Weather Forecastcited by 166
- 2019Prediction of Aerodynamic Flow Fields Using Convolutional Neural Networkscited by 145
- 2020Combining Differentiable PDE Solvers and Graph Neural Networks for Fluid Flow Predictioncited by 138
- 2019Pixel-Adaptive Convolutional Neural Networkscited by 126
- 2021Sub-seasonal forecasting with a large ensemble of deep-learning weather prediction modelscited by 79
- 2022Multi-resolution partial differential equations preserved learning framework for spatiotemporal dynamicscited by 44
- 2021Deep Learning for Reduced Order Modelling and Efficient Temporal Evolution of Fluid Simulationscited by 36
- 2021Graph Neural Networks Accelerated Molecular Dynamicscited by 33
- 2021Combining distribution-based neural networks to predict weather forecast probabilitiescited by 18
- 2020Graph Convolutional Neural Networks for Body Force Predictioncited by 16
Built on by
Citing papers per year: 2024: 1.
1 paper.
- 2024PAPM: A Physics-aware Proxy Model for Process Systemscited by 4
- 2024PAPM: A Physics-aware Proxy Model for Process Systems7 Jul 2024