Learning Deep Implicit Fourier Neural Operators (IFNOs) with Applications to Heterogeneous Material Modeling
Not on the map. Why?
Abstract (arXiv)
Constitutive modeling based on continuum mechanics theory has been a classical approach for modeling the mechanical responses of materials. However, when constitutive laws are unknown or when defects and/or high degrees of heterogeneity are present, these classical models may become inaccurate. In this work, we propose to use data-driven modeling, which directly utilizes high-fidelity simulation and/or experimental measurements to predict a material's response without using conventional constitutive models. Specifically, the material response is modeled by learning the implicit mappings between loading conditions and the resultant displacement and/or damage fields, with the neural network serving as a surrogate for a solution operator. To model the complex responses due to material heterogeneity and defects, we develop a novel deep neural operator architecture, which we coin as the Implicit Fourier Neural Operator (IFNO). In the IFNO, the increment between layers is modeled as an integral operator to capture the long-range dependencies in the feature space. As the network gets deeper, the limit of IFNO becomes a fixed point equation that yields an implicit neural operator and naturally mimics the displacement/damage fields solving procedure in material modeling problems. We demonstrate the performance of our proposed method for a number of examples, including hyperelastic, anisotropic and brittle materials. As an application, we further employ the proposed approach to learn the material models directly from digital image correlation (DIC) tracking measurements, and show that the learned solution operators substantially outperform the conventional constitutive models in predicting displacement fields.
Key facts. Cited by 65 papers in the map (data through 7 Oct 2026). Builds on 36 of its 106 references that are in the map. First posted on arXiv 15 Mar 2022.
Builds on
36 of 106 references.
References · 36
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,806
- 2019DeepONet: Learning nonlinear operators for identifying differential equations based on the universal approximation theorem of operatorscited by 1,965
- 2020Neural Operator: Graph Kernel Network for Partial Differential Equationscited by 722
- 2019Deep Equilibrium Modelscited by 603
- 2017The Deep Ritz method: A deep learning-based numerical algorithm for solving variational problemscited by 581
- 2019AI Feynman: a Physics-Inspired Method for Symbolic Regressioncited by 536
- 2021Physics-informed neural networks (PINNs) for fluid mechanics: A reviewcited by 470
- 2021Neural Operator: Learning Maps Between Function Spacescited by 413
- 2020Multipole Graph Neural Operator for Parametric Partial Differential Equationscited by 343
- 2021Multiwavelet-based Operator Learning for Differential Equationscited by 229
- 2017Deep Potential Molecular Dynamics: a scalable model with the accuracy of quantum mechanicscited by 213
24 more
- 2018Bayesian Deep Convolutional Encoder-Decoder Networks for Surrogate Modeling and Uncertainty Quantificationcited by 199
- 2019Ab-Initio Solution of the Many-Electron Schr"odinger Equation with Deep Neural Networkscited by 195
- 2018Deep Neural Networks Motivated by Partial Differential Equationscited by 187
- 2020Multiscale Deep Equilibrium Modelscited by 149
- 2017Solving ill-posed inverse problems using iterative deep neural networkscited by 145
- 2019Prediction of Aerodynamic Flow Fields Using Convolutional Neural Networkscited by 144
- 2019Implicit Deep Learningcited by 124
- 2020Monotone operator equilibrium networkscited by 100
- 2021A physics-informed variational DeepONet for predicting the crack path in brittle materialscited by 98
- 2022Learning Operators with Coupled Attentioncited by 88
- 2021JFB: Jacobian-Free Backpropagation for Implicit Networkscited by 84
- 2020Physics-informed neural network for ultrasound nondestructive quantification of surface breaking crackscited by 67
- 2019Physics-Informed Neural Networks for Multiphysics Data Assimilation with Application to Subsurface Transportcited by 60
- 2019Physics-Informed Probabilistic Learning of Linear Embeddings of Non-linear Dynamics With Guaranteed Stabilitycited by 53
- 2020EikoNet: Solving the Eikonal equation with Deep Neural Networkscited by 50
- 2022Interfacing Finite Elements with Deep Neural Operators for Fast Multiscale Modeling of Mechanics Problemscited by 47
- 2022Nonlocal Kernel Network (NKN): a Stable and Resolution-Independent Deep Neural Networkcited by 45
- 2021Simulating progressive intramural damage leading to aortic dissection using an operator-regression neural networkcited by 35
- 2018A deep material network for multiscale topology learning and accelerated nonlinear modeling of heterogeneous materialscited by 31
- 2019Unsupervised Deep Learning Algorithm for PDE-based Forward and Inverse Problemscited by 31
- 2021On physics-informed data-driven isotropic and anisotropic constitutive models through probabilistic machine learning and space-filling samplingcited by 24
- 2021A data-driven peridynamic continuum model for upscaling molecular dynamicscited by 17
- 2022IAE-Net: Integral Autoencoders for Discretization-Invariant Learningcited by 15
- 2019Model-Free Data-Driven Methods in Mechanics: Material Data Identification and Solverscited by 7
Built on by
Citing papers per year: 2022: 7; 2023: 15; 2024: 14; 2025: 19; 2026: 10.
65 papers.
Sort:
By area:
- 2022Physics-Informed Deep Neural Operator Networkscited by 110
- 2022Physics-Informed Machine Learning: A Survey on Problems, Methods and Applicationscited by 88
- 2023A Mathematical Guide to Operator Learningcited by 74
- 2023Nonlocality and Nonlinearity Implies Universality in Operator Learningcited by 43
- 2023Domain Agnostic Fourier Neural Operatorscited by 36
- 2022SVD Perspectives for Augmenting DeepONet Flexibility and Interpretabilitycited by 35
- 2023Out-of-distributional risk bounds for neural operators with applications to the Helmholtz equationcited by 32
- 2023Neural Operator Learning for Long-Time Integration in Dynamical Systems with Recurrent Neural Networkscited by 32
- 2022INO: Invariant Neural Operators for Learning Complex Physical Systems with Momentum Conservationcited by 28
- 2023Rethinking materials simulations: Blending direct numerical simulations with neural operatorscited by 25
- 2022Physics-Guided, Physics-Informed, and Physics-Encoded Neural Networks in Scientific Computingcited by 24
- 2023Harnessing the Power of Neural Operators with Automatically Encoded Conservation Lawscited by 22
38 more
- 2024An operator learning perspective on parameter-to-observable mapscited by 22
- 2023Deep Learning in Deterministic Computational Mechanicscited by 21
- 2022A Physics-Guided Neural Operator Learning Approach to Model Biological Tissues from Digital Image Correlation Measurementscited by 19
- 2023Improved generalization with deep neural operators for engineering systems: Path towards digital twincited by 19
- 2024Peridynamic Neural Operators: A Data-Driven Nonlocal Constitutive Model for Complex Material Responsescited by 18
- 2024Diffeomorphism Neural Operator for various domains and parameters of partial differential equationscited by 15
- 2024Deep Neural Operator Enabled Digital Twin Modeling for Additive Manufacturingcited by 14
- 2025Operator Learning: A Statistical Perspectivecited by 14
- 2025Principled Approaches for Extending Neural Architectures to Function Spaces for Operator Learningcited by 11
- 2023MetaNO: How to Transfer Your Knowledge on Learning Hidden Physicscited by 10
- 2023Neural Operator: Is data all you need to model the world? An insight into the paradigm of data-driven scientific MLcited by 8
- 2025Geometry-Informed Neural Operator Transformercited by 8
- 2024Component Fourier Neural Operator for Singularly Perturbed Differential Equationscited by 7
- 2023Variational operator learning: A unified paradigm marrying training neural operators and solving partial differential equationscited by 6
- 2024A physics-informed transformer neural operator for learning generalized solutions of initial boundary value problemscited by 6
- 2025Neural-Initialized Newton: Accelerating Nonlinear Finite Elements via Operator Learningcited by 6
- 2024Physics-Aware Neural Implicit Solvers for multiscale, parametric PDEs with applications in heterogeneous mediacited by 5
- 2024Micrometer: Micromechanics Transformer for Predicting Mechanical Responses of Heterogeneous Materialscited by 5
- 2025DGenNO: A Novel Physics-aware Neural Operator for Solving Forward and Inverse PDE Problems based on Deep, Generative Probabilistic Modelingcited by 5
- 2025History-Aware Neural Operator: Robust Data-Driven Constitutive Modeling of Path-Dependent Materialscited by 5
- 2026Structure-Preserving Learning Improves Geometry Generalization in Neural PDEscited by 5
- 2024Heterogeneous Peridynamic Neural Operators: Discover Biotissue Constitutive Law and Microstructure From Digital Image Correlation Measurementscited by 4
- 2023Towards a unified nonlocal, peridynamics framework for the coarse-graining of molecular dynamics data with fracturescited by 3
- 2024Green Multigrid Networkcited by 3
- 2024Structure-Preserving Operator Learningcited by 3
- 2025Orthogonal greedy algorithm for linear operator learning with shallow neural networkcited by 3
- 2025Continuum Transformers Perform In-Context Learning by Operator Gradient Descentcited by 3
- 2025Universal Fourier Neural Operators for periodic homogenization problems in linear elasticitycited by 3
- 2023Machine learning for phase-resolved reconstruction of nonlinear ocean wave surface elevations from sparse remote sensing datacited by 2
- 2024Disentangled Representation Learning for Parametric Partial Differential Equationscited by 2
- 2025Equilibrium Conserving Neural Operators for Super-Resolution Learningcited by 2
- 2025Localized FNO for Spatiotemporal Hemodynamic Upsampling in Aneurysm MRIcited by 2
- 2025MD-PNOP: Equation-Recast Neural Operators for Minimal-Data Extrapolation and PDE Solver Accelerationcited by 2
- 2025ReBaNO: Reduced Basis Neural Operator Mitigating Generalization Gaps and Achieving Discretization Invariancecited by 2
- 2022Data-driven soliton mappings for integrable fractional nonlinear wave equations via deep learning with Fourier neural operatorcited by 1
- 2024Implicit factorized transformer approach to fast prediction of turbulent channel flowscited by 1
- 2025Invertible Koopman neural operator for data-driven modeling of partial differential equationscited by 1
- 2025Neural Interpretable PDEs: Harmonizing Fourier Insights with Attention for Scalable and Interpretable Physics Discoverycited by 1
50 most cited of 65 All 65 (JSON)
- 2026Beyond Simulation: Retain-and-Repair Neural Operators for Real-World Adaptation30 Sep 2026
- 2026Theory Guided and Interpretable Neural Operator Design for Partial Differential Equation Learning27 Sep 2026
- 2026Inertial Manifold Neural Operator for Dissipative Time-Dependent Partial Differential Equations24 Aug 2026
- 2026Adaptive Mamba Neural Operators20 Jul 2026
- 2026Geometry-Conditioned Fourier Neural Operators for Cubic Nonlinear Schrodinger Dynamics on Periodic Domains25 Jun 2026
- 2026A meshfree exterior calculus for generalizable and data-efficient learning of physics from point clouds8 May 2026
- 2026Constitutive parameterized deep energy method for solid mechanics problems with random material parameters27 Mar 2026
- 2026Parameterized Temporal Extrapolation of PDEs via Disentangled Latent Dynamics Manifold Fusion13 Mar 2026
- 2026Inverse Neural Operator for ODE Parameter Optimization12 Mar 2026
- 2026Structure-Preserving Learning Improves Geometry Generalization in Neural PDEs2 Feb 2026
- 2025Neural-Initialized Newton: Accelerating Nonlinear Finite Elements via Operator Learning10 Nov 2025
- 2025ReBaNO: Reduced Basis Neural Operator Mitigating Generalization Gaps and Achieving Discretization Invariance11 Sep 2025
38 more
- 2025MD-PNOP: Equation-Recast Neural Operators for Minimal-Data Extrapolation and PDE Solver Acceleration1 Sep 2025
- 2025Localized FNO for Spatiotemporal Hemodynamic Upsampling in Aneurysm MRI18 Jul 2025
- 2025Universal Fourier Neural Operators for periodic homogenization problems in linear elasticity16 Jul 2025
- 2025An Attention-based Spatio-Temporal Neural Operator for Evolving Physics12 Jun 2025
- 2025Principled Approaches for Extending Neural Architectures to Function Spaces for Operator Learning12 Jun 2025
- 2025History-Aware Neural Operator: Robust Data-Driven Constitutive Modeling of Path-Dependent Materials12 Jun 2025
- 2025Deep regularization networks for inverse problems with noisy operators8 Jun 2025
- 2025Neural Interpretable PDEs: Harmonizing Fourier Insights with Attention for Scalable and Interpretable Physics Discovery29 May 2025
- 2025A physics-guided smoothing method for material modeling with digital image correlation (DIC) measurements24 May 2025
- 2025Continuum Transformers Perform In-Context Learning by Operator Gradient Descent23 May 2025
- 2025Geometry-Informed Neural Operator Transformer28 Apr 2025
- 2025Equilibrium Conserving Neural Operators for Super-Resolution Learning18 Apr 2025
- 2025Operator Learning: A Statistical Perspective4 Apr 2025
- 2025Invertible Koopman neural operator for data-driven modeling of partial differential equations25 Mar 2025
- 2025An optimal Petrov-Galerkin framework for operator networks6 Mar 2025
- 2025DGenNO: A Novel Physics-aware Neural Operator for Solving Forward and Inverse PDE Problems based on Deep, Generative Probabilistic Modeling10 Feb 2025
- 2025Orthogonal greedy algorithm for linear operator learning with shallow neural network6 Jan 2025
- 2024Implicit factorized transformer approach to fast prediction of turbulent channel flows25 Dec 2024
- 2024A physics-informed transformer neural operator for learning generalized solutions of initial boundary value problems12 Dec 2024
- 2024Embedded Nonlocal Operator Regression (ENOR): Quantifying model error in learning nonlocal operators27 Oct 2024
- 2024Disentangled Representation Learning for Parametric Partial Differential Equations3 Oct 2024
- 2024Structure-Preserving Operator Learning1 Oct 2024
- 2024Micrometer: Micromechanics Transformer for Predicting Mechanical Responses of Heterogeneous Materials23 Sep 2024
- 2024Component Fourier Neural Operator for Singularly Perturbed Differential Equations7 Sep 2024
- 2024Green Multigrid Network4 Jul 2024
- 2024Physics-Aware Neural Implicit Solvers for multiscale, parametric PDEs with applications in heterogeneous media29 May 2024
- 2024Deep Neural Operator Enabled Digital Twin Modeling for Additive Manufacturing13 May 2024
- 2024Heterogeneous Peridynamic Neural Operators: Discover Biotissue Constitutive Law and Microstructure From Digital Image Correlation Measurements27 Mar 2024
- 2024Diffeomorphism Neural Operator for various domains and parameters of partial differential equations19 Feb 2024
- 2024An operator learning perspective on parameter-to-observable maps8 Feb 2024
- 2024Peridynamic Neural Operators: A Data-Driven Nonlocal Constitutive Model for Complex Material Responses11 Jan 2024
- 2023A Mathematical Guide to Operator Learning22 Dec 2023
- 2023Harnessing the Power of Neural Operators with Automatically Encoded Conservation Laws18 Dec 2023
- 2023Rethinking materials simulations: Blending direct numerical simulations with neural operators8 Dec 2023
- 2023Can Physics Informed Neural Operators Self Improve?23 Nov 2023
- 2023Deep Learning in Deterministic Computational Mechanics27 Sep 2023
- 2023Machine learning for phase-resolved reconstruction of nonlinear ocean wave surface elevations from sparse remote sensing data18 May 2023
- 2023Domain Agnostic Fourier Neural Operators30 Apr 2023
50 newest of 65 All 65 (JSON)
- 2026Adaptive Mamba Neural Operatorscited by 0
- 2026Adaptive Mamba Neural Operators20 Jul 2026
- 2022Physics-Informed Deep Neural Operator Networkscited by 110
- 2022Physics-Informed Machine Learning: A Survey on Problems, Methods and Applicationscited by 88
- 2023A Mathematical Guide to Operator Learningcited by 74
- 2023Nonlocality and Nonlinearity Implies Universality in Operator Learningcited by 43
- 2023Domain Agnostic Fourier Neural Operatorscited by 36
- 2022SVD Perspectives for Augmenting DeepONet Flexibility and Interpretabilitycited by 35
- 2023Out-of-distributional risk bounds for neural operators with applications to the Helmholtz equationcited by 32
- 2023Neural Operator Learning for Long-Time Integration in Dynamical Systems with Recurrent Neural Networkscited by 32
- 2022INO: Invariant Neural Operators for Learning Complex Physical Systems with Momentum Conservationcited by 28
- 2023Rethinking materials simulations: Blending direct numerical simulations with neural operatorscited by 25
- 2022Physics-Guided, Physics-Informed, and Physics-Encoded Neural Networks in Scientific Computingcited by 24
- 2023Harnessing the Power of Neural Operators with Automatically Encoded Conservation Lawscited by 22
12 most cited of 64 All 64 (JSON)
- 2026Beyond Simulation: Retain-and-Repair Neural Operators for Real-World Adaptation30 Sep 2026
- 2026Theory Guided and Interpretable Neural Operator Design for Partial Differential Equation Learning27 Sep 2026
- 2026Inertial Manifold Neural Operator for Dissipative Time-Dependent Partial Differential Equations24 Aug 2026
- 2026Geometry-Conditioned Fourier Neural Operators for Cubic Nonlinear Schrodinger Dynamics on Periodic Domains25 Jun 2026
- 2026A meshfree exterior calculus for generalizable and data-efficient learning of physics from point clouds8 May 2026
- 2026Constitutive parameterized deep energy method for solid mechanics problems with random material parameters27 Mar 2026
- 2026Parameterized Temporal Extrapolation of PDEs via Disentangled Latent Dynamics Manifold Fusion13 Mar 2026
- 2026Inverse Neural Operator for ODE Parameter Optimization12 Mar 2026
- 2026Structure-Preserving Learning Improves Geometry Generalization in Neural PDEs2 Feb 2026
- 2025Neural-Initialized Newton: Accelerating Nonlinear Finite Elements via Operator Learning10 Nov 2025
- 2025ReBaNO: Reduced Basis Neural Operator Mitigating Generalization Gaps and Achieving Discretization Invariance11 Sep 2025
- 2025MD-PNOP: Equation-Recast Neural Operators for Minimal-Data Extrapolation and PDE Solver Acceleration1 Sep 2025
12 newest of 64 All 64 (JSON)