Micrometer: Micromechanics Transformer for Predicting Mechanical Responses of Heterogeneous Materials
Not on the map. Why?
Abstract (arXiv)
Heterogeneous materials, crucial in various engineering applications, exhibit complex multiscale behavior, which challenges the effectiveness of traditional computational methods. In this work, we introduce the Micromechanics Transformer (em Micrometer), an artificial intelligence (AI) framework for predicting the mechanical response of heterogeneous materials, bridging the gap between advanced data-driven methods and complex solid mechanics problems. Trained on a large-scale high-resolution dataset of 2D fiber-reinforced composites, Micrometer can achieve state-of-the-art performance in predicting microscale strain fields across a wide range of microstructures, material properties under any loading conditions and We demonstrate the accuracy and computational efficiency of Micrometer through applications in computational homogenization and multiscale modeling, where Micrometer achieves 1% error in predicting macroscale stress fields while reducing computational time by up to two orders of magnitude compared to conventional numerical solvers. We further showcase the adaptability of the proposed model through transfer learning experiments on new materials with limited data, highlighting its potential to tackle diverse scenarios in mechanical analysis of solid materials. Our work represents a significant step towards AI-driven innovation in computational solid mechanics, addressing the limitations of traditional numerical methods and paving the way for more efficient simulations of heterogeneous materials across various industrial applications.
Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 42 of its 107 references that are in the map. First posted on arXiv 23 Sep 2024.
Builds on
42 of 107 references.
References · 42
- 2017Attention Is All You Needcited by 59,932
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2020Scaling Laws for Neural Language Modelscited by 6,411
- 2022Training Compute-Optimal Large Language Modelscited by 2,927
- 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,806
- 2019DeepONet: Learning nonlinear operators for identifying differential equations based on the universal approximation theorem of operatorscited by 1,965
- 2021Scaling Vision Transformerscited by 993
- 2020On Layer Normalization in the Transformer Architecturecited by 906
- 2020Convolutional Occupancy Networkscited by 760
- 2020Neural Operator: Graph Kernel Network for Partial Differential Equationscited by 722
- 2021Learning the solution operator of parametric partial differential equations with physics-informed DeepOnetscited by 537
30 more
- 2022PDEBENCH: An Extensive Benchmark for Scientific Machine Learningcited by 396
- 2020Local Implicit Grid Representations for 3D Scenescited by 372
- 2023GNOT: A General Neural Operator Transformer for Operator Learningcited by 321
- 2023Geometry-Informed Neural Operator for Large-Scale 3D PDEscited by 293
- 2021U-FNO -- An enhanced Fourier neural operator-based deep-learning model for multiphase flowcited by 292
- 2022Transformer for Partial Differential Equations' Operator Learningcited by 270
- 2021Adaptive Fourier Neural Operators: Efficient Token Mixers for Transformerscited by 237
- 2022Towards Multi-spatiotemporal-scale Generalized PDE Modelingcited by 190
- 2024Poseidon: Efficient Foundation Models for PDEscited by 186
- 2021Modulated Periodic Activations for Generalizable Local Functional Representationscited by 140
- 2024DPOT: Auto-Regressive Denoising Operator Transformer for Large-Scale PDE Pre-Trainingcited by 137
- 2023An Expert's Guide to Training Physics-informed Neural Networkscited by 119
- 2023Multiple Physics Pretraining for Physical Surrogate Modelscited by 90
- 2021Long-time integration of parametric evolution equations with physics-informed DeepONetscited by 87
- 2023Getting ViT in Shape: Scaling Laws for Compute-Optimal Model Designcited by 87
- 2021Improved architectures and training algorithms for deep operator networkscited by 85
- 2024Operator Learning: Algorithms and Analysiscited by 84
- 2022NOMAD: Nonlinear Manifold Decoders for Operator Learningcited by 81
- 2022Learning Deep Implicit Fourier Neural Operators (IFNOs) with Applications to Heterogeneous Material Modelingcited by 65
- 2023Fourier-DeepONet: Fourier-enhanced deep operator networks for full waveform inversion with improved accuracy, generalizability, and robustnesscited by 60
- 2023Inverse-design of nonlinear mechanical metamaterials via video denoising diffusion modelscited by 48
- 2023MeLM, a generative pretrained language modeling framework that solves forward and inverse mechanics problemscited by 29
- 2024Universal Physics Transformers: A Framework For Efficiently Scaling Neural Operatorscited by 25
- 2020Data-driven topology optimization of spinodoid metamaterials with seamlessly tunable anisotropycited by 22
- 2021Stress field prediction in fiber-reinforced composite materials using a deep learning approachcited by 22
- 2023Unifying the design space and optimizing linear and nonlinear truss metamaterials by generative modelingcited by 21
- 2023Deep Learning in Deterministic Computational Mechanicscited by 21
- 2020Deep Optimized Priors for 3D Shape Modeling and Reconstructioncited by 20
- 2020A numerical method for computing the overall response of nonlinear composites with complex microstructurecited by 18
- 2023Deep Operator Learning Lessens the Curse of Dimensionality for PDEscited by 18
Built on by
Citing papers per year: 2025: 4; 2026: 1.
5 papers.
- 2025FunDiff: Diffusion Models over Function Spaces for Physics-Informed Generative Modelingcited by 19
- 2025Structure-Preserving Digital Twins via Conditional Neural Whitney Formscited by 8
- 2025TANTE: Time-Adaptive Operator Learning via Neural Taylor Expansioncited by 7
- 2025GeoFunFlow: Geometric Function Flow Matching for Inverse Operator Learning over Complex Geometriescited by 0
- 2026Small Models, Strong Priors: Architectural Inductive Bias for Parameter-Efficient Neural PDE Solverscited by 0
- 2026Small Models, Strong Priors: Architectural Inductive Bias for Parameter-Efficient Neural PDE Solvers25 May 2026
- 2025GeoFunFlow: Geometric Function Flow Matching for Inverse Operator Learning over Complex Geometries28 Sep 2025
- 2025Structure-Preserving Digital Twins via Conditional Neural Whitney Forms9 Aug 2025
- 2025FunDiff: Diffusion Models over Function Spaces for Physics-Informed Generative Modeling9 Jun 2025
- 2025TANTE: Time-Adaptive Operator Learning via Neural Taylor Expansion12 Feb 2025