mlsanityData to 14 Oct 2026

Physics-enhanced deep surrogates for partial differential equations

arXiv 2111.05841 ↗First posted 10 Nov 2021cs.LG physics.app-phcited by 18

Not on the map. Why?

Abstract (arXiv)

Many physics and engineering applications demand Partial Differential Equations (PDE) property evaluations that are traditionally computed with resource-intensive high-fidelity numerical solvers. Data-driven surrogate models provide an efficient alternative but come with a significant cost of training. Emerging applications would benefit from surrogates with an improved accuracy-cost tradeoff, while studied at scale. Here we present a "physics-enhanced deep-surrogate" ("PEDS") approach towards developing fast surrogate models for complex physical systems, which is described by PDEs. Specifically, a combination of a low-fidelity, explainable physics simulator and a neural network generator is proposed, which is trained end-to-end to globally match the output of an expensive high-fidelity numerical solver. Experiments on three exemplar testcases, diffusion, reaction-diffusion, and electromagnetic scattering models, show that a PEDS surrogate can be up to 3× more accurate than an ensemble of feedforward neural networks with limited data (≈ 103 training points), and reduces the training data need by at least a factor of 100 to achieve a target error of 5%. Experiments reveal that PEDS provides a general, data-driven strategy to bridge the gap between a vast array of simplified physical models with corresponding brute-force numerical solvers modeling complex systems, offering accuracy, speed, data efficiency, as well as physical insights into the process.

Key facts. Cited by 18 papers in the map (data through 14 Oct 2026). Builds on 19 of its 75 references that are in the map. First posted on arXiv 10 Nov 2021.

Builds on

19 of 75 references.

References · 19

  1. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  2. 2016Simple and Scalable Predictive Uncertainty Estimation using Deep Ensemblescited by 3,926
  3. 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,908
  4. 2019DeepONet: Learning nonlinear operators for identifying differential equations based on the universal approximation theorem of operatorscited by 2,018
  5. 2021Machine learning accelerated computational fluid dynamicscited by 471
  6. 2020Universal Differential Equations for Scientific Machine Learningcited by 353
  7. 2020Discovering Symbolic Models from Deep Learning with Inductive Biasescited by 344
  8. 2020Kernel and Rich Regimes in Overparametrized Modelscited by 306
  9. 2021Physics-informed neural networks with hard constraints for inverse designcited by 280
  10. 2021Trustworthy AI: From Principles to Practicescited by 207
  11. 2019Universal Approximation with Deep Narrow Networkscited by 200
  12. 2020Integrating Scientific Knowledge with Machine Learning for Engineering and Environmental Systemscited by 164
7 more
  1. 2018Don't Unroll Adjoint: Differentiating SSA-Form Programscited by 45
  2. 2021A Framework for Machine Learning of Model Error in Dynamical Systemscited by 38
  3. 2021Deep Learning for Reduced Order Modelling and Efficient Temporal Evolution of Fluid Simulationscited by 36
  4. 2018A proof that deep artificial neural networks overcome the curse of dimensionality in the numerical approximation of Kolmogorov partial differential equations with constant diffusion and nonlinear drift coefficientscited by 31
  5. 2020Active learning of deep surrogates for PDEs: Application to metasurface designcited by 28
  6. 2020Multi-fidelity Generative Deep Learning Turbulent Flowscited by 21
  7. 2020A three layer neural network can represent any multivariate functioncited by 10

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2022: 2; 2023: 1; 2024: 4; 2025: 7; 2026: 4.

18 papers.

Sort:

  1. 2022Clifford Neural Layers for PDE Modelingcited by 92
  2. 2022Learning continuous models for continuous physicscited by 28
  3. 2023A neural operator-based surrogate solver for free-form electromagnetic inverse designcited by 19
  4. 2024Diffeomorphism Neural Operator for various domains and parameters of partial differential equationscited by 15
  5. 2024A Gaussian Process Framework for Solving Forward and Inverse Problems Involving Nonlinear Partial Differential Equationscited by 8
  6. 2025Inverse Design in Nanophotonics via Representation Learningcited by 7
  7. 2025HiLAB: A Hybrid Inverse-Design Frameworkcited by 6
  8. 2024PAPM: A Physics-aware Proxy Model for Process Systemscited by 4
  9. 2025Building Trustworthy AI for Materials Discovery: From Autonomous Laboratories to Z-scorescited by 2
  10. 2026Learning Where to Simulate: Generative Active Sampling for Online PDE Surrogate Trainingcited by 2
  11. 2025Gaussian process surrogate with physical law-corrected prior for multi-coupled PDEs defined on irregular geometrycited by 1
  12. 2024Open-Source High-Speed Flight Surrogate Modeling Frameworkcited by 0
6 more
  1. 2025Estimating Parameter Fields in Multi-Physics PDEs from Scarce Measurementscited by 0
  2. 2025Performance-Carbon Trade-Offs across Architectural Biases in Shear Flow Forecastingcited by 0
  3. 2025Physics Enhanced Deep Surrogates for the Phonon Boltzmann Transport Equationcited by 0
  4. 2026Fourier Neural Operators with rank-1 lattice points and hyperbolic crosscited by 0
  5. 2026Inductively Scalable, Single-Step Neural Surrogates for Wave-Scattering Inverse Problemscited by 0
  6. 2026Cluster Attention Neural Operators for Solving Parametric Partial Differential Equationscited by 0