mlsanityData to 14 Oct 2026

Filtered Partial Differential Equations: a robust surrogate constraint in physics-informed deep learning framework

arXiv 2311.03776 ↗First posted 7 Nov 2023physics.flu-dyn stat.AP stat.MLcited by 1

Not on the map. Why?

Abstract (arXiv)

Embedding physical knowledge into neural network (NN) training has been a hot topic. However, when facing the complex real-world, most of the existing methods still strongly rely on the quantity and quality of observation data. Furthermore, the neural networks often struggle to converge when the solution to the real equation is very complex. Inspired by large eddy simulation in computational fluid dynamics, we propose an improved method based on filtering. We analyzed the causes of the difficulties in physics informed machine learning, and proposed a surrogate constraint (filtered PDE, FPDE in short) of the original physical equations to reduce the influence of noisy and sparse observation data. In the noise and sparsity experiment, the proposed FPDE models (which are optimized by FPDE constraints) have better robustness than the conventional PDE models. Experiments demonstrate that the FPDE model can obtain the same quality solution with 100% higher noise and 12% quantity of observation data of the baseline. Besides, two groups of real measurement data are used to show the FPDE improvements in real cases. The final results show that FPDE still gives more physically reasonable solutions when facing the incomplete equation problem and the extremely sparse and high-noise conditions. For combining real-world experiment data into physics-informed training, the proposed FPDE constraint is useful and performs well in two real-world experiments: modeling the blood velocity in vessels and cell migration in scratches.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 23 of its 72 references that are in the map. First posted on arXiv 7 Nov 2023.

Builds on

23 of 72 references.

References · 23

  1. 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,908
  2. 2016An overview of gradient descent optimization algorithmscited by 1,033
  3. 2018Self-Attention Generative Adversarial Networkscited by 809
  4. 2020When and why PINNs fail to train: A neural tangent kernel perspectivecited by 634
  5. 2019DeepXDE: A deep learning library for solving differential equationscited by 619
  6. 2022Scientific Machine Learning through Physics-Informed Neural Networks: Where we are and What's nextcited by 608
  7. 2014Qualitatively characterizing neural network optimization problemscited by 188
  8. 2020Physics-informed learning of governing equations from scarce datacited by 167
  9. 2019Transfer learning enhanced physics informed neural network for phase-field modeling of fracturecited by 116
  10. 2019Digital Twin: Values, Challenges and Enablerscited by 81
  11. 2019Physics-Informed Neural Networks for Power Systemscited by 80
  12. 2019Machine learning in cardiovascular flows modeling: Predicting arterial blood pressure from non-invasive 4D flow MRI data using physics-informed neural networkscited by 76
11 more
  1. 2020Physics-informed neural network for ultrasound nondestructive quantification of surface breaking crackscited by 68
  2. 2020Physics-informed deep learning for incompressible laminar flowscited by 54
  3. 2021Any equation is a forest: Symbolic genetic algorithm for discovering open-form partial differential equations (SGA-PDE)cited by 41
  4. 2019DL-PDE: Deep-learning based data-driven discovery of partial differential equations from discrete and noisy datacited by 38
  5. 2019Deep Learning of Subsurface Flow via Theory-guided Neural Networkcited by 32
  6. 2020Theory-guided hard constraint projection (HCP): a knowledge-based data-driven scientific machine learning methodcited by 29
  7. 2020Physics-Informed Neural Network Super Resolution for Advection-Diffusion Modelscited by 16
  8. 2022Integration of knowledge and data in machine learningcited by 13
  9. 2020A Lagrangian Dual-based Theory-guided Deep Neural Networkcited by 8
  10. 2022Multi-scale data reconstruction of turbulent rotating flows with Gappy POD, Extended POD and Generative Adversarial Networkscited by 8
  11. 2022AutoKE: An automatic knowledge embedding framework for scientific machine learningcited by 6

Built on by

Cited by year

Citing papers per year: 2024: 1.

1 paper.