mlsanityData to 7 Oct 2026

PhyCRNet: Physics-informed Convolutional-Recurrent Network for Solving Spatiotemporal PDEs

arXiv 2106.14103 ↗First posted 26 Jun 2021cs.LG cs.CL cs.NAcited by 97

Not on the map. Why?

Abstract (arXiv)

Partial differential equations (PDEs) play a fundamental role in modeling and simulating problems across a wide range of disciplines. Recent advances in deep learning have shown the great potential of physics-informed neural networks (PINNs) to solve PDEs as a basis for data-driven modeling and inverse analysis. However, the majority of existing PINN methods, based on fully-connected NNs, pose intrinsic limitations to low-dimensional spatiotemporal parameterizations. Moreover, since the initial/boundary conditions (I/BCs) are softly imposed via penalty, the solution quality heavily relies on hyperparameter tuning. To this end, we propose the novel physics-informed convolutional-recurrent learning architectures (PhyCRNet and PhyCRNet-s) for solving PDEs without any labeled data. Specifically, an encoder-decoder convolutional long short-term memory network is proposed for low-dimensional spatial feature extraction and temporal evolution learning. The loss function is defined as the aggregated discretized PDE residuals, while the I/BCs are hard-encoded in the network to ensure forcible satisfaction (e.g., periodic boundary padding). The networks are further enhanced by autoregressive and residual connections that explicitly simulate time marching. The performance of our proposed methods has been assessed by solving three nonlinear PDEs (e.g., 2D Burgers' equations, the λ-ω and FitzHugh Nagumo reaction-diffusion equations), and compared against the start-of-the-art baseline algorithms. The numerical results demonstrate the superiority of our proposed methodology in the context of solution accuracy, extrapolability and generalizability.

Key facts. Cited by 97 papers in the map (data through 7 Oct 2026). Builds on 53 of its 85 references that are in the map. First posted on arXiv 26 Jun 2021.

Builds on

53 of 85 references.

References · 53

  1. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  2. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
  3. 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 6,979
  4. 2016Densely Connected Convolutional Networkscited by 6,691
  5. 2018Neural Ordinary Differential Equationscited by 3,733
  6. 2014Sequence to Sequence Learning with Neural Networkscited by 2,974
  7. 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,806
  8. 2016Convolutional Neural Networks on Graphs with Fast Localized Spectral Filteringcited by 2,085
  9. 2019DeepONet: Learning nonlinear operators for identifying differential equations based on the universal approximation theorem of operatorscited by 1,965
  10. 2015Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcastingcited by 1,428
  11. 2018Relational inductive biases, deep learning, and graph networkscited by 1,341
  12. 2016Real-Time Single Image and Video Super-Resolution Using an Efficient Sub-Pixel Convolutional Neural Networkcited by 1,199
38 more
  1. 2016Geometric deep learning: going beyond Euclidean datacited by 1,042
  2. 2020Learning Mesh-Based Simulation with Graph Networkscited by 840
  3. 2020Neural Operator: Graph Kernel Network for Partial Differential Equationscited by 722
  4. 2019DeepXDE: A deep learning library for solving differential equationscited by 617
  5. 2017The Deep Ritz method: A deep learning-based numerical algorithm for solving variational problemscited by 581
  6. 2013Generating Sequences With Recurrent Neural Networkscited by 549
  7. 2017Solving high-dimensional partial differential equations using deep learningcited by 549
  8. 2016Weight Normalization: A Simple Reparameterization to Accelerate Training of Deep Neural Networkscited by 541
  9. 2019Machine Learning for Fluid Mechanicscited by 380
  10. 2017Residual Gated Graph ConvNetscited by 341
  11. 2017PDE-Net: Learning PDEs from Datacited by 304
  12. 2019Physics-Constrained Deep Learning for High-dimensional Surrogate Modeling and Uncertainty Quantification without Labeled Datacited by 261
  13. 2020Model Reduction and Neural Networks for Parametric PDEscited by 257
  14. 2018Deep Hidden Physics Models: Deep Learning of Nonlinear Partial Differential Equationscited by 233
  15. 2018Bayesian Deep Convolutional Encoder-Decoder Networks for Surrogate Modeling and Uncertainty Quantificationcited by 199
  16. 2020PhyGeoNet: Physics-Informed Geometry-Adaptive Convolutional Neural Networks for Solving Parameterized Steady-State PDEs on Irregular Domaincited by 173
  17. 2020Physics-informed learning of governing equations from scarce datacited by 167
  18. 2018Quantifying total uncertainty in physics-informed neural networks for solving forward and inverse stochastic problemscited by 144
  19. 2019Prediction of Aerodynamic Flow Fields Using Convolutional Neural Networkscited by 144
  20. 2020Combining Differentiable PDE Solvers and Graph Neural Networks for Fluid Flow Predictioncited by 137
  21. 2019Modeling the Dynamics of PDE Systems with Physics-Constrained Deep Auto-Regressive Networkscited by 127
  22. 2019An Energy Approach to the Solution of Partial Differential Equations in Computational Mechanics via Machine Learning: Concepts, Implementation and Applicationscited by 118
  23. 2020Transformers for Modeling Physical Systemscited by 105
  24. 2018Data Driven Governing Equations Approximation Using Deep Neural Networkscited by 94
  25. 2020Physics informed deep learning for computational elastodynamics without labeled datacited by 79
  26. 2019Machine learning in cardiovascular flows modeling: Predicting arterial blood pressure from non-invasive 4D flow MRI data using physics-informed neural networkscited by 76
  27. 2018Deep Learning of Vortex Induced Vibrationscited by 74
  28. 2020Physics-informed neural network for ultrasound nondestructive quantification of surface breaking crackscited by 67
  29. 2018Wide Activation for Efficient and Accurate Image Super-Resolutioncited by 64
  30. 2019Learning in Modal Space: Solving Time-Dependent Stochastic PDEs Using Physics-Informed Neural Networkscited by 63
  31. 2020A physics-informed operator regression framework for extracting data-driven continuum modelscited by 60
  32. 2020Physics-informed deep learning for incompressible laminar flowscited by 54
  33. 2020Physics-Informed Multi-LSTM Networks for Metamodeling of Nonlinear Structurescited by 52
  34. 2019Physics-guided Convolutional Neural Network (PhyCNN) for Data-driven Seismic Response Modelingcited by 40
  35. 2020DiscretizationNet: A Machine-Learning based solver for Navier-Stokes Equations using Finite Volume Discretizationcited by 35
  36. 2019A Physics-Constrained Data-Driven Approach Based on Locally Convex Reconstruction for Noisy Databasecited by 18
  37. 2019GMLS-Nets: A framework for learning from unstructured datacited by 18
  38. 2020Variational system identification of the partial differential equations governing microstructure evolution in materials: Inference over sparse and spatially unrelated datacited by 13

50 most cited of 53 All 53 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 1; 2022: 16; 2023: 18; 2024: 27; 2025: 21; 2026: 14.

97 papers.

Sort:

By area:

  1. 2021CAN-PINN: A Fast Physics-Informed Neural Network Based on Coupled-Automatic-Numerical Differentiation Methodcited by 93
  2. 2022Physics-Informed Machine Learning: A Survey on Problems, Methods and Applicationscited by 88
  3. 2023PINNacle: A Comprehensive Benchmark of Physics-Informed Neural Networks for Solving PDEscited by 84
  4. 2024KAN-ODEs: Kolmogorov-Arnold Network Ordinary Differential Equations for Learning Dynamical Systems and Hidden Physicscited by 58
  5. 2023Eagle: Large-Scale Learning of Turbulent Fluid Dynamics with Mesh Transformerscited by 54
  6. 2022Multi-resolution partial differential equations preserved learning framework for spatiotemporal dynamicscited by 44
  7. 2025Optimizing the Optimizer for Physics-Informed Neural Networks and Kolmogorov-Arnold Networkscited by 41
  8. 2023CFDBench: A Large-Scale Benchmark for Machine Learning Methods in Fluid Dynamicscited by 40
  9. 2024Data-Efficient Operator Learning via Unsupervised Pretraining and In-Context Learningcited by 32
  10. 2022Partial Differential Equations Meet Deep Neural Networks: A Surveycited by 25
  11. 2022Discovering Nonlinear PDEs from Scarce Data with Physics-encoded Learningcited by 24
  12. 2022Physics-Guided, Physics-Informed, and Physics-Encoded Neural Networks in Scientific Computingcited by 24
38 more
  1. 2023Deep Learning in Deterministic Computational Mechanicscited by 21
  2. 2024PhyMPGN: Physics-encoded Message Passing Graph Network for spatiotemporal PDE systemscited by 18
  3. 2022SeismicNet: Physics-informed neural networks for seismic wave modeling in semi-infinite domaincited by 16
  4. 2024A finite element-based physics-informed operator learning framework for spatiotemporal partial differential equations on arbitrary domainscited by 15
  5. 2025Sensitivity-Constrained Fourier Neural Operators for Forward and Inverse Problems in Parametric Differential Equationscited by 14
  6. 2024P2C2Net: PDE-Preserved Coarse Correction Network for efficient prediction of spatiotemporal dynamicscited by 13
  7. 2024Physics-informed MeshGraphNets (PI-MGNs): Neural finite element solvers for non-stationary and nonlinear simulations on arbitrary meshescited by 12
  8. 2023Physics-aware Machine Learning Revolutionizes Scientific Paradigm for Machine Learning and Process-based Hydrologycited by 11
  9. 2024PARCv2: Physics-aware Recurrent Convolutional Neural Networks for Spatiotemporal Dynamics Modelingcited by 10
  10. 2024A finite operator learning technique for mapping the elastic properties of microstructures to their mechanical deformationscited by 10
  11. 2022Physics-informed Deep Super-resolution for Spatiotemporal Datacited by 9
  12. 2025QCPINN: Quantum-Classical Physics-Informed Neural Networks for Solving PDEscited by 9
  13. 2023Neural Operator: Is data all you need to model the world? An insight into the paradigm of data-driven scientific MLcited by 8
  14. 2022An unsupervised latent/output physics-informed convolutional-LSTM network for solving partial differential equations using peridynamic differential operatorcited by 7
  15. 2023Physics-informed PointNet: On how many irregular geometries can it solve an inverse problem simultaneously? Application to linear elasticitycited by 7
  16. 2023Discovering stochastic partial differential equations from limited data using variational Bayes inferencecited by 6
  17. 2023Learning the solution operator of two-dimensional incompressible Navier-Stokes equations using physics-aware convolutional neural networkscited by 6
  18. 2023On the locality of local neural operator in learning fluid dynamicscited by 6
  19. 2024Generative Learning for Forecasting the Dynamics of Complex Systemscited by 6
  20. 2024Physics-informed Discretization-independent Deep Compositional Operator Networkcited by 6
  21. 2024Spectral Informed Neural Network: An Efficient and Low-Memory PINNcited by 6
  22. 2024Energy Dissipation Preserving Physics Informed Neural Network for Allen-Cahn Equationscited by 6
  23. 2022Physics-informed ConvNet: Learning Physical Field from a Shallow Neural Networkcited by 5
  24. 2022PhyGNNet: Solving spatiotemporal PDEs with Physics-informed Graph Neural Networkcited by 5
  25. 2023Learning a model is paramount for sample efficiency in reinforcement learning control of PDEscited by 5
  26. 2025PeSANet: Physics-encoded Spectral Attention Network for Simulating PDE-Governed Complex Systemscited by 5
  27. 2022Accelerating hydrodynamic simulations of urban drainage systems with physics-guided machine learningcited by 4
  28. 2022RBF-MGN:Solving spatiotemporal PDEs with Physics-informed Graph Neural Networkcited by 4
  29. 2023LSA-PINN: Linear Boundary Connectivity Loss for Solving PDEs on Complex Geometrycited by 4
  30. 2023Physics-informed Convolutional Recurrent Surrogate Model for Reservoir Simulation with Well Controlscited by 4
  31. 2023ParticleWNN: a Novel Neural Networks Framework for Solving Partial Differential Equationscited by 4
  32. 2024Integration of physics-informed operator learning and finite element method for parametric learning of partial differential equationscited by 4
  33. 2024Adapting Physics-Informed Neural Networks to Improve ODE Optimization in Mosquito Population Dynamicscited by 4
  34. 2024DiffFluid: Plain Diffusion Models are Effective Predictors of Flow Dynamicscited by 4
  35. 2024Data-Efficient Inference of Neural Fluid Fields via SciML Foundation Modelcited by 4
  36. 2024Conservation-informed Graph Learning for Spatiotemporal Dynamics Predictioncited by 4
  37. 2024Smooth and Sparse Latent Dynamics in Operator Learning with Jerk Regularizationcited by 3
  38. 2024Space-Time Video Super-resolution with Neural Operatorcited by 3

50 most cited of 97 All 97 (JSON)