mlsanityData to 7 Oct 2026

Physics-Aware Neural Implicit Solvers for multiscale, parametric PDEs with applications in heterogeneous media

arXiv 2405.19019 ↗First posted 29 May 2024stat.ML cs.LGcited by 5

Not on the map. Why?

Abstract (arXiv)

We propose Physics-Aware Neural Implicit Solvers (PANIS), a novel, data-driven framework for learning surrogates for parametrized Partial Differential Equations (PDEs). It consists of a probabilistic, learning objective in which weighted residuals are used to probe the PDE and provide a source of em virtual data i.e. the actual PDE never needs to be solved. This is combined with a physics-aware implicit solver that consists of a much coarser, discretized version of the original PDE, which provides the requisite information bottleneck for high-dimensional problems and enables generalization in out-of-distribution settings (e.g. different boundary conditions). We demonstrate its capability in the context of random heterogeneous materials where the input parameters represent the material microstructure. We extend the framework to multiscale problems and show that a surrogate can be learned for the effective (homogenized) solution without ever solving the reference problem. We further demonstrate how the proposed framework can accommodate and generalize several existing learning objectives and architectures while yielding probabilistic surrogates that can quantify predictive uncertainty.

Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 43 of its 89 references that are in the map. First posted on arXiv 29 May 2024.

Builds on

43 of 89 references.

References · 43

  1. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
  2. 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,806
  3. 2016Variational Inference: A Review for Statisticianscited by 1,466
  4. 2015Automatic differentiation in machine learning: a surveycited by 846
  5. 2020Neural Operator: Graph Kernel Network for Partial Differential Equationscited by 722
  6. 2017DGM: A deep learning algorithm for solving partial differential equationscited by 674
  7. 2021Characterizing possible failure modes in physics-informed neural networkscited by 632
  8. 2017The Deep Ritz method: A deep learning-based numerical algorithm for solving variational problemscited by 581
  9. 2017Solving high-dimensional partial differential equations using deep learningcited by 549
  10. 2021Learning the solution operator of parametric partial differential equations with physics-informed DeepOnetscited by 537
  11. 2021Physics-Informed Neural Operator for Learning Partial Differential Equationscited by 516
  12. 2015Variational Dropout and the Local Reparameterization Trickcited by 489
31 more
  1. 2021Neural Operator: Learning Maps Between Function Spacescited by 413
  2. 2017Physics Informed Deep Learning (Part I): Data-driven Solutions of Nonlinear Partial Differential Equationscited by 362
  3. 2020Discovering Symbolic Models from Deep Learning with Inductive Biasescited by 335
  4. 2019Physics-Constrained Deep Learning for High-dimensional Surrogate Modeling and Uncertainty Quantification without Labeled Datacited by 261
  5. 2020Model Reduction and Neural Networks for Parametric PDEscited by 257
  6. 2020Equivariant Flows: Exact Likelihood Generative Learning for Symmetric Densitiescited by 248
  7. 2020hp-VPINNs: Variational Physics-Informed Neural Networks With Domain Decompositioncited by 236
  8. 2017Hidden Physics Models: Machine Learning of Nonlinear Partial Differential Equationscited by 208
  9. 2023Convolutional Neural Operators for robust and accurate learning of PDEscited by 207
  10. 2020Solver-in-the-Loop: Learning from Differentiable Physics to Interact with Iterative PDE-Solverscited by 201
  11. 2018Bayesian Deep Convolutional Encoder-Decoder Networks for Surrogate Modeling and Uncertainty Quantificationcited by 199
  12. 2020Combining Differentiable PDE Solvers and Graph Neural Networks for Fluid Flow Predictioncited by 137
  13. 2018Adversarial Uncertainty Quantification in Physics-Informed Neural Networkscited by 120
  14. 2022Wavelet neural operator: a neural operator for parametric partial differential equationscited by 77
  15. 2022Learning Deep Implicit Fourier Neural Operators (IFNOs) with Applications to Heterogeneous Material Modelingcited by 65
  16. 2022Error estimates for physics informed neural networks approximating the Navier-Stokes equationscited by 63
  17. 2018Deep convolutional encoder-decoder networks for uncertainty quantification of dynamic multiphase flow in heterogeneous mediacited by 56
  18. 2021GFINNs: GENERIC Formalism Informed Neural Networks for Deterministic and Stochastic Dynamical Systemscited by 48
  19. 2022Thermodynamics-informed graph neural networkscited by 31
  20. 2020A probabilistic generative model for semi-supervised training of coarse-grained surrogates and enforcing physical constraints through virtual observablescited by 28
  21. 2019Incorporating physical constraints in a deep probabilistic machine learning framework for coarse-graining dynamical systemscited by 25
  22. 2018A Deep Neural Network Surrogate for High-Dimensional Random Partial Differential Equationscited by 23
  23. 2022Fully probabilistic deep models for forward and inverse problems in parametric PDEscited by 19
  24. 2019Conditional deep surrogate models for stochastic, high-dimensional, and multi-fidelity systemscited by 18
  25. 2021Multiscale modeling of inelastic materials with Thermodynamics-based Artificial Neural Networks (TANN)cited by 18
  26. 2022Variational Bayes Deep Operator Network: A data-driven Bayesian solver for parametric differential equationscited by 11
  27. 2022Thermodynamics of learning physical phenomenacited by 10
  28. 2023Random Grid Neural Processes for Parametric Partial Differential Equationscited by 8
  29. 2019A physics-aware, probabilistic machine learning framework for coarse-graining high-dimensional systems in the Small Data regimecited by 7
  30. 2021Self-supervised optimization of random material microstructures in the small-data regimecited by 4
  31. 2013Pushing Stochastic Gradient towards Second-Order Methods -- Backpropagation Learning with Transformations in Nonlinearitiescited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 1; 2025: 1; 2026: 3.

5 papers.