mlsanityData to 7 Oct 2026

Neural-Integrated Meshfree (NIM) Method: A differentiable programming-based hybrid solver for computational mechanics

arXiv 2311.12915 ↗First posted 21 Nov 2023cs.LG cs.CEcited by 4

Not on the map. Why?

Abstract (arXiv)

We present the neural-integrated meshfree (NIM) method, a differentiable programming-based hybrid meshfree approach within the field of computational mechanics. NIM seamlessly integrates traditional physics-based meshfree discretization techniques with deep learning architectures. It employs a hybrid approximation scheme, NeuroPU, to effectively represent the solution by combining continuous DNN representations with partition of unity (PU) basis functions associated with the underlying spatial discretization. This neural-numerical hybridization not only enhances the solution representation through functional space decomposition but also reduces both the size of DNN model and the need for spatial gradient computations based on automatic differentiation, leading to a significant improvement in training efficiency. Under the NIM framework, we propose two truly meshfree solvers: the strong form-based NIM (S-NIM) and the local variational form-based NIM (V-NIM). In the S-NIM solver, the strong-form governing equation is directly considered in the loss function, while the V-NIM solver employs a local Petrov-Galerkin approach that allows the construction of variational residuals based on arbitrary overlapping subdomains. This ensures both the satisfaction of underlying physics and the preservation of meshfree property. We perform extensive numerical experiments on both stationary and transient benchmark problems to assess the effectiveness of the proposed NIM methods in terms of accuracy, scalability, generalizability, and convergence properties. Moreover, comparative analysis with other physics-informed machine learning methods demonstrates that NIM, especially V-NIM, significantly enhances both accuracy and efficiency in end-to-end predictive capabilities.

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 42 of its 86 references that are in the map. First posted on arXiv 21 Nov 2023.

Builds on

42 of 86 references.

References · 42

  1. 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,806
  2. 2020Fourier Features Let Networks Learn High Frequency Functions in Low Dimensional Domainscited by 2,170
  3. 2019DeepONet: Learning nonlinear operators for identifying differential equations based on the universal approximation theorem of operatorscited by 1,965
  4. 2020Learning to Simulate Complex Physics with Graph Networkscited by 867
  5. 2015Automatic differentiation in machine learning: a surveycited by 846
  6. 2021Characterizing possible failure modes in physics-informed neural networkscited by 632
  7. 2022Scientific Machine Learning through Physics-Informed Neural Networks: Where we are and What's nextcited by 603
  8. 2017The Deep Ritz method: A deep learning-based numerical algorithm for solving variational problemscited by 581
  9. 2021Physics-informed neural networks (PINNs) for fluid mechanics: A reviewcited by 470
  10. 2021Machine learning accelerated computational fluid dynamicscited by 461
  11. 2020On the eigenvector bias of Fourier feature networks: From regression to solving multi-scale PDEs with physics-informed neural networkscited by 279
  12. 2020hp-VPINNs: Variational Physics-Informed Neural Networks With Domain Decompositioncited by 236
30 more
  1. 2020Self-Adaptive Physics-Informed Neural Networks using a Soft Attention Mechanismcited by 231
  2. 2020PhyGeoNet: Physics-Informed Geometry-Adaptive Convolutional Neural Networks for Solving Parameterized Steady-State PDEs on Irregular Domaincited by 173
  3. 2019Variational Physics-Informed Neural Networks For Solving Partial Differential Equationscited by 144
  4. 2017A unified deep artificial neural network approach to partial differential equations in complex geometriescited by 122
  5. 2019An Energy Approach to the Solution of Partial Differential Equations in Computational Mechanics via Machine Learning: Concepts, Implementation and Applicationscited by 118
  6. 2021Parallel Physics-Informed Neural Networks via Domain Decompositioncited by 112
  7. 2021CAN-PINN: A Fast Physics-Informed Neural Network Based on Coupled-Automatic-Numerical Differentiation Methodcited by 93
  8. 2019A Differentiable Programming System to Bridge Machine Learning and Scientific Computingcited by 81
  9. 2020Physics informed deep learning for computational elastodynamics without labeled datacited by 79
  10. 2020Local Extreme Learning Machines and Domain Decomposition for Solving Linear and Nonlinear Partial Differential Equationscited by 78
  11. 2019Physics-Informed Neural Networks for Multiphysics Data Assimilation with Application to Subsurface Transportcited by 60
  12. 2020Physics-Informed Multi-LSTM Networks for Metamodeling of Nonlinear Structurescited by 52
  13. 2022Interfacing Finite Elements with Deep Neural Operators for Fast Multiscale Modeling of Mechanics Problemscited by 47
  14. 2022JAX-FEM: A differentiable GPU-accelerated 3D finite element solver for automatic inverse design and mechanistic data sciencecited by 40
  15. 2022JAX-FLUIDS: A fully-differentiable high-order computational fluid dynamics solver for compressible two-phase flowscited by 36
  16. 2019VarNet: Variational Neural Networks for the Solution of Partial Differential Equationscited by 35
  17. 2020DiscretizationNet: A Machine-Learning based solver for Navier-Stokes Equations using Finite Volume Discretizationcited by 35
  18. 2018Model-Free Data-Driven Inelasticitycited by 29
  19. 2020A nonlocal physics-informed deep learning framework using the peridynamic differential operatorcited by 21
  20. 2021Eighty Years of the Finite Element Method: Birth, Evolution, and Futurecited by 21
  21. 2019A Physics-Constrained Data-Driven Approach Based on Locally Convex Reconstruction for Noisy Databasecited by 18
  22. 2021Variational Physics Informed Neural Networks: the role of quadratures and test functionscited by 17
  23. 2021Partition of unity networks: deep hp-approximationcited by 15
  24. 2022Deep autoencoders for physics-constrained data-driven nonlinear materials modelingcited by 13
  25. 2023A Hybrid Deep Neural Operator/Finite Element Method for Ice-Sheet Modelingcited by 11
  26. 2022A Neural Network-enhanced Reproducing Kernel Particle Method for Modeling Strain Localizationcited by 8
  27. 2022JAX-DIPS: Neural bootstrapping of finite discretization methods and application to elliptic problems with discontinuitiescited by 7
  28. 2023A Multi-Resolution Physics-Informed Recurrent Neural Network: Formulation and Application to Musculoskeletal Systemscited by 6
  29. 2023A Neural Network-Based Enrichment of Reproducing Kernel Approximation for Modeling Brittle Fracturecited by 4
  30. 2023Software-based Automatic Differentiation is Flawedcited by 3

Built on by

Cited by year

Citing papers per year: 2024: 2; 2025: 2.

4 papers.