mlsanityData to 7 Oct 2026

Learning Deep Implicit Fourier Neural Operators (IFNOs) with Applications to Heterogeneous Material Modeling

arXiv 2203.08205 ↗First posted 15 Mar 2022cs.LG cond-mat.mtrl-scicited by 65

Not on the map. Why?

Abstract (arXiv)

Constitutive modeling based on continuum mechanics theory has been a classical approach for modeling the mechanical responses of materials. However, when constitutive laws are unknown or when defects and/or high degrees of heterogeneity are present, these classical models may become inaccurate. In this work, we propose to use data-driven modeling, which directly utilizes high-fidelity simulation and/or experimental measurements to predict a material's response without using conventional constitutive models. Specifically, the material response is modeled by learning the implicit mappings between loading conditions and the resultant displacement and/or damage fields, with the neural network serving as a surrogate for a solution operator. To model the complex responses due to material heterogeneity and defects, we develop a novel deep neural operator architecture, which we coin as the Implicit Fourier Neural Operator (IFNO). In the IFNO, the increment between layers is modeled as an integral operator to capture the long-range dependencies in the feature space. As the network gets deeper, the limit of IFNO becomes a fixed point equation that yields an implicit neural operator and naturally mimics the displacement/damage fields solving procedure in material modeling problems. We demonstrate the performance of our proposed method for a number of examples, including hyperelastic, anisotropic and brittle materials. As an application, we further employ the proposed approach to learn the material models directly from digital image correlation (DIC) tracking measurements, and show that the learned solution operators substantially outperform the conventional constitutive models in predicting displacement fields.

Key facts. Cited by 65 papers in the map (data through 7 Oct 2026). Builds on 36 of its 106 references that are in the map. First posted on arXiv 15 Mar 2022.

Builds on

36 of 106 references.

References · 36

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,806
  3. 2019DeepONet: Learning nonlinear operators for identifying differential equations based on the universal approximation theorem of operatorscited by 1,965
  4. 2020Neural Operator: Graph Kernel Network for Partial Differential Equationscited by 722
  5. 2019Deep Equilibrium Modelscited by 603
  6. 2017The Deep Ritz method: A deep learning-based numerical algorithm for solving variational problemscited by 581
  7. 2019AI Feynman: a Physics-Inspired Method for Symbolic Regressioncited by 536
  8. 2021Physics-informed neural networks (PINNs) for fluid mechanics: A reviewcited by 470
  9. 2021Neural Operator: Learning Maps Between Function Spacescited by 413
  10. 2020Multipole Graph Neural Operator for Parametric Partial Differential Equationscited by 343
  11. 2021Multiwavelet-based Operator Learning for Differential Equationscited by 229
  12. 2017Deep Potential Molecular Dynamics: a scalable model with the accuracy of quantum mechanicscited by 213
24 more
  1. 2018Bayesian Deep Convolutional Encoder-Decoder Networks for Surrogate Modeling and Uncertainty Quantificationcited by 199
  2. 2019Ab-Initio Solution of the Many-Electron Schr"odinger Equation with Deep Neural Networkscited by 195
  3. 2018Deep Neural Networks Motivated by Partial Differential Equationscited by 187
  4. 2020Multiscale Deep Equilibrium Modelscited by 149
  5. 2017Solving ill-posed inverse problems using iterative deep neural networkscited by 145
  6. 2019Prediction of Aerodynamic Flow Fields Using Convolutional Neural Networkscited by 144
  7. 2019Implicit Deep Learningcited by 124
  8. 2020Monotone operator equilibrium networkscited by 100
  9. 2021A physics-informed variational DeepONet for predicting the crack path in brittle materialscited by 98
  10. 2022Learning Operators with Coupled Attentioncited by 88
  11. 2021JFB: Jacobian-Free Backpropagation for Implicit Networkscited by 84
  12. 2020Physics-informed neural network for ultrasound nondestructive quantification of surface breaking crackscited by 67
  13. 2019Physics-Informed Neural Networks for Multiphysics Data Assimilation with Application to Subsurface Transportcited by 60
  14. 2019Physics-Informed Probabilistic Learning of Linear Embeddings of Non-linear Dynamics With Guaranteed Stabilitycited by 53
  15. 2020EikoNet: Solving the Eikonal equation with Deep Neural Networkscited by 50
  16. 2022Interfacing Finite Elements with Deep Neural Operators for Fast Multiscale Modeling of Mechanics Problemscited by 47
  17. 2022Nonlocal Kernel Network (NKN): a Stable and Resolution-Independent Deep Neural Networkcited by 45
  18. 2021Simulating progressive intramural damage leading to aortic dissection using an operator-regression neural networkcited by 35
  19. 2018A deep material network for multiscale topology learning and accelerated nonlinear modeling of heterogeneous materialscited by 31
  20. 2019Unsupervised Deep Learning Algorithm for PDE-based Forward and Inverse Problemscited by 31
  21. 2021On physics-informed data-driven isotropic and anisotropic constitutive models through probabilistic machine learning and space-filling samplingcited by 24
  22. 2021A data-driven peridynamic continuum model for upscaling molecular dynamicscited by 17
  23. 2022IAE-Net: Integral Autoencoders for Discretization-Invariant Learningcited by 15
  24. 2019Model-Free Data-Driven Methods in Mechanics: Material Data Identification and Solverscited by 7

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2022: 7; 2023: 15; 2024: 14; 2025: 19; 2026: 10.

65 papers.

Sort:

By area:

  1. 2022Physics-Informed Deep Neural Operator Networkscited by 110
  2. 2022Physics-Informed Machine Learning: A Survey on Problems, Methods and Applicationscited by 88
  3. 2023A Mathematical Guide to Operator Learningcited by 74
  4. 2023Nonlocality and Nonlinearity Implies Universality in Operator Learningcited by 43
  5. 2023Domain Agnostic Fourier Neural Operatorscited by 36
  6. 2022SVD Perspectives for Augmenting DeepONet Flexibility and Interpretabilitycited by 35
  7. 2023Out-of-distributional risk bounds for neural operators with applications to the Helmholtz equationcited by 32
  8. 2023Neural Operator Learning for Long-Time Integration in Dynamical Systems with Recurrent Neural Networkscited by 32
  9. 2022INO: Invariant Neural Operators for Learning Complex Physical Systems with Momentum Conservationcited by 28
  10. 2023Rethinking materials simulations: Blending direct numerical simulations with neural operatorscited by 25
  11. 2022Physics-Guided, Physics-Informed, and Physics-Encoded Neural Networks in Scientific Computingcited by 24
  12. 2023Harnessing the Power of Neural Operators with Automatically Encoded Conservation Lawscited by 22
38 more
  1. 2024An operator learning perspective on parameter-to-observable mapscited by 22
  2. 2023Deep Learning in Deterministic Computational Mechanicscited by 21
  3. 2022A Physics-Guided Neural Operator Learning Approach to Model Biological Tissues from Digital Image Correlation Measurementscited by 19
  4. 2023Improved generalization with deep neural operators for engineering systems: Path towards digital twincited by 19
  5. 2024Peridynamic Neural Operators: A Data-Driven Nonlocal Constitutive Model for Complex Material Responsescited by 18
  6. 2024Diffeomorphism Neural Operator for various domains and parameters of partial differential equationscited by 15
  7. 2024Deep Neural Operator Enabled Digital Twin Modeling for Additive Manufacturingcited by 14
  8. 2025Operator Learning: A Statistical Perspectivecited by 14
  9. 2025Principled Approaches for Extending Neural Architectures to Function Spaces for Operator Learningcited by 11
  10. 2023MetaNO: How to Transfer Your Knowledge on Learning Hidden Physicscited by 10
  11. 2023Neural Operator: Is data all you need to model the world? An insight into the paradigm of data-driven scientific MLcited by 8
  12. 2025Geometry-Informed Neural Operator Transformercited by 8
  13. 2024Component Fourier Neural Operator for Singularly Perturbed Differential Equationscited by 7
  14. 2023Variational operator learning: A unified paradigm marrying training neural operators and solving partial differential equationscited by 6
  15. 2024A physics-informed transformer neural operator for learning generalized solutions of initial boundary value problemscited by 6
  16. 2025Neural-Initialized Newton: Accelerating Nonlinear Finite Elements via Operator Learningcited by 6
  17. 2024Physics-Aware Neural Implicit Solvers for multiscale, parametric PDEs with applications in heterogeneous mediacited by 5
  18. 2024Micrometer: Micromechanics Transformer for Predicting Mechanical Responses of Heterogeneous Materialscited by 5
  19. 2025DGenNO: A Novel Physics-aware Neural Operator for Solving Forward and Inverse PDE Problems based on Deep, Generative Probabilistic Modelingcited by 5
  20. 2025History-Aware Neural Operator: Robust Data-Driven Constitutive Modeling of Path-Dependent Materialscited by 5
  21. 2026Structure-Preserving Learning Improves Geometry Generalization in Neural PDEscited by 5
  22. 2024Heterogeneous Peridynamic Neural Operators: Discover Biotissue Constitutive Law and Microstructure From Digital Image Correlation Measurementscited by 4
  23. 2023Towards a unified nonlocal, peridynamics framework for the coarse-graining of molecular dynamics data with fracturescited by 3
  24. 2024Green Multigrid Networkcited by 3
  25. 2024Structure-Preserving Operator Learningcited by 3
  26. 2025Orthogonal greedy algorithm for linear operator learning with shallow neural networkcited by 3
  27. 2025Continuum Transformers Perform In-Context Learning by Operator Gradient Descentcited by 3
  28. 2025Universal Fourier Neural Operators for periodic homogenization problems in linear elasticitycited by 3
  29. 2023Machine learning for phase-resolved reconstruction of nonlinear ocean wave surface elevations from sparse remote sensing datacited by 2
  30. 2024Disentangled Representation Learning for Parametric Partial Differential Equationscited by 2
  31. 2025Equilibrium Conserving Neural Operators for Super-Resolution Learningcited by 2
  32. 2025Localized FNO for Spatiotemporal Hemodynamic Upsampling in Aneurysm MRIcited by 2
  33. 2025MD-PNOP: Equation-Recast Neural Operators for Minimal-Data Extrapolation and PDE Solver Accelerationcited by 2
  34. 2025ReBaNO: Reduced Basis Neural Operator Mitigating Generalization Gaps and Achieving Discretization Invariancecited by 2
  35. 2022Data-driven soliton mappings for integrable fractional nonlinear wave equations via deep learning with Fourier neural operatorcited by 1
  36. 2024Implicit factorized transformer approach to fast prediction of turbulent channel flowscited by 1
  37. 2025Invertible Koopman neural operator for data-driven modeling of partial differential equationscited by 1
  38. 2025Neural Interpretable PDEs: Harmonizing Fourier Insights with Attention for Scalable and Interpretable Physics Discoverycited by 1

50 most cited of 65 All 65 (JSON)