Physics-Aware Neural Implicit Solvers for multiscale, parametric PDEs with applications in heterogeneous media
Not on the map. Why?
Abstract (arXiv)
We propose Physics-Aware Neural Implicit Solvers (PANIS), a novel, data-driven framework for learning surrogates for parametrized Partial Differential Equations (PDEs). It consists of a probabilistic, learning objective in which weighted residuals are used to probe the PDE and provide a source of em virtual data i.e. the actual PDE never needs to be solved. This is combined with a physics-aware implicit solver that consists of a much coarser, discretized version of the original PDE, which provides the requisite information bottleneck for high-dimensional problems and enables generalization in out-of-distribution settings (e.g. different boundary conditions). We demonstrate its capability in the context of random heterogeneous materials where the input parameters represent the material microstructure. We extend the framework to multiscale problems and show that a surrogate can be learned for the effective (homogenized) solution without ever solving the reference problem. We further demonstrate how the proposed framework can accommodate and generalize several existing learning objectives and architectures while yielding probabilistic surrogates that can quantify predictive uncertainty.
Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 43 of its 89 references that are in the map. First posted on arXiv 29 May 2024.
Builds on
43 of 89 references.
References · 43
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,806
- 2016Variational Inference: A Review for Statisticianscited by 1,466
- 2015Automatic differentiation in machine learning: a surveycited by 846
- 2020Neural Operator: Graph Kernel Network for Partial Differential Equationscited by 722
- 2017DGM: A deep learning algorithm for solving partial differential equationscited by 674
- 2021Characterizing possible failure modes in physics-informed neural networkscited by 632
- 2017The Deep Ritz method: A deep learning-based numerical algorithm for solving variational problemscited by 581
- 2017Solving high-dimensional partial differential equations using deep learningcited by 549
- 2021Learning the solution operator of parametric partial differential equations with physics-informed DeepOnetscited by 537
- 2021Physics-Informed Neural Operator for Learning Partial Differential Equationscited by 516
- 2015Variational Dropout and the Local Reparameterization Trickcited by 489
31 more
- 2021Neural Operator: Learning Maps Between Function Spacescited by 413
- 2017Physics Informed Deep Learning (Part I): Data-driven Solutions of Nonlinear Partial Differential Equationscited by 362
- 2020Discovering Symbolic Models from Deep Learning with Inductive Biasescited by 335
- 2019Physics-Constrained Deep Learning for High-dimensional Surrogate Modeling and Uncertainty Quantification without Labeled Datacited by 261
- 2020Model Reduction and Neural Networks for Parametric PDEscited by 257
- 2020Equivariant Flows: Exact Likelihood Generative Learning for Symmetric Densitiescited by 248
- 2020hp-VPINNs: Variational Physics-Informed Neural Networks With Domain Decompositioncited by 236
- 2017Hidden Physics Models: Machine Learning of Nonlinear Partial Differential Equationscited by 208
- 2023Convolutional Neural Operators for robust and accurate learning of PDEscited by 207
- 2020Solver-in-the-Loop: Learning from Differentiable Physics to Interact with Iterative PDE-Solverscited by 201
- 2018Bayesian Deep Convolutional Encoder-Decoder Networks for Surrogate Modeling and Uncertainty Quantificationcited by 199
- 2020Combining Differentiable PDE Solvers and Graph Neural Networks for Fluid Flow Predictioncited by 137
- 2018Adversarial Uncertainty Quantification in Physics-Informed Neural Networkscited by 120
- 2022Wavelet neural operator: a neural operator for parametric partial differential equationscited by 77
- 2022Learning Deep Implicit Fourier Neural Operators (IFNOs) with Applications to Heterogeneous Material Modelingcited by 65
- 2022Error estimates for physics informed neural networks approximating the Navier-Stokes equationscited by 63
- 2018Deep convolutional encoder-decoder networks for uncertainty quantification of dynamic multiphase flow in heterogeneous mediacited by 56
- 2021GFINNs: GENERIC Formalism Informed Neural Networks for Deterministic and Stochastic Dynamical Systemscited by 48
- 2022Thermodynamics-informed graph neural networkscited by 31
- 2020A probabilistic generative model for semi-supervised training of coarse-grained surrogates and enforcing physical constraints through virtual observablescited by 28
- 2019Incorporating physical constraints in a deep probabilistic machine learning framework for coarse-graining dynamical systemscited by 25
- 2018A Deep Neural Network Surrogate for High-Dimensional Random Partial Differential Equationscited by 23
- 2022Fully probabilistic deep models for forward and inverse problems in parametric PDEscited by 19
- 2019Conditional deep surrogate models for stochastic, high-dimensional, and multi-fidelity systemscited by 18
- 2021Multiscale modeling of inelastic materials with Thermodynamics-based Artificial Neural Networks (TANN)cited by 18
- 2022Variational Bayes Deep Operator Network: A data-driven Bayesian solver for parametric differential equationscited by 11
- 2022Thermodynamics of learning physical phenomenacited by 10
- 2023Random Grid Neural Processes for Parametric Partial Differential Equationscited by 8
- 2019A physics-aware, probabilistic machine learning framework for coarse-graining high-dimensional systems in the Small Data regimecited by 7
- 2021Self-supervised optimization of random material microstructures in the small-data regimecited by 4
- 2013Pushing Stochastic Gradient towards Second-Order Methods -- Backpropagation Learning with Transformations in Nonlinearitiescited by 2
Built on by
Citing papers per year: 2024: 1; 2025: 1; 2026: 3.
5 papers.
- 2025DGenNO: A Novel Physics-aware Neural Operator for Solving Forward and Inverse PDE Problems based on Deep, Generative Probabilistic Modelingcited by 5
- 2024A Primer on Variational Inference for Physics-Informed Deep Generative Modellingcited by 3
- 2026On the training of physics-informed neural operators for solving parametric partial differential equationscited by 1
- 2026GenPANIS: A Latent-Variable Generative Framework for Forward and Inverse PDE Problems in Multiphase Mediacited by 0
- 2026Architecture Shapes Transfer Specificity in Implicit Neural Representationscited by 0
- 2026Architecture Shapes Transfer Specificity in Implicit Neural Representations5 Jun 2026
- 2026On the training of physics-informed neural operators for solving parametric partial differential equations4 Jun 2026
- 2026GenPANIS: A Latent-Variable Generative Framework for Forward and Inverse PDE Problems in Multiphase Media16 Feb 2026
- 2025DGenNO: A Novel Physics-aware Neural Operator for Solving Forward and Inverse PDE Problems based on Deep, Generative Probabilistic Modeling10 Feb 2025
- 2024A Primer on Variational Inference for Physics-Informed Deep Generative Modelling10 Sep 2024