A Neural Network Transformer Model for Composite Microstructure Homogenization
Not on the map. Why?
Abstract (arXiv)
Heterogeneity and uncertainty in a composite microstructure lead to either computational bottlenecks if modeled rigorously or to solution inaccuracies in the stress field and failure predictions if approximated. Although methods suitable for analyzing arbitrary and non-linear microstructures exist, their computational cost makes them impractical to use in large-scale structural analysis. Surrogate models or Reduced Order Models (ROMs) commonly enhance efficiencies but are typically calibrated with a single microstructure. Homogenization methods, such as the Mori-Tanaka method, offer rapid homogenization for a wide range of constituent properties. However, simplifying assumptions, like stress and strain averaging in phases, render the consideration of both deterministic and stochastic variations in microstructure infeasible. This paper illustrates a transformer neural network architecture that captures the knowledge of various microstructures and constituents, enabling it to function as a computationally efficient homogenization surrogate model. Given an image or an abstraction of an arbitrary composite microstructure of linearly elastic fibers in an elastoplastic matrix, the transformer network predicts the history-dependent, non-linear, and homogenized stress-strain response. Two methods for encoding microstructure features were tested: calculating two-point statistics using Principal Component Analysis (PCA) for dimensionality reduction and employing an autoencoder with a Convolutional Neural Network (CNN). Both methods accurately predict the homogenized material response. The developed transformer neural network offers an efficient means for microstructure-to-property translation, generalizable and extendable to a variety of microstructures. The paper describes the network architecture, training and testing data generation, and performance under cycling and random loadings.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 26 of its 75 references that are in the map. First posted on arXiv 16 Apr 2023.
Builds on
26 of 75 references.
References · 26
- 2017Attention Is All You Needcited by 60,361
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
- 2014Neural Machine Translation by Jointly Learning to Align and Translatecited by 4,548
- 2020Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecastingcited by 2,169
- 2015Fast and Accurate Deep Network Learning by Exponential Linear Units (ELUs)cited by 1,070
- 2019Attention is not Explanationcited by 929
- 2019Temporal Fusion Transformers for Interpretable Multi-horizon Time Series Forecastingcited by 761
- 2016Language Modeling with Gated Convolutional Networkscited by 702
14 more
- 2020A Survey on Visual Transformercited by 654
- 2019Attention is not not Explanationcited by 636
- 2019Enhancing the Locality and Breaking the Memory Bottleneck of Transformer on Time Series Forecastingcited by 607
- 2017Train longer, generalize better: closing the generalization gap in large batch training of neural networkscited by 279
- 2016Why and When Can Deep -- but Not Shallow -- Networks Avoid the Curse of Dimensionality: a Reviewcited by 155
- 2020Deep Transformer Models for Time Series Forecasting: The Influenza Prevalence Casecited by 129
- 2022Causal Transformer for Estimating Counterfactual Outcomescited by 123
- 2018Training Tips for the Transformer Modelcited by 85
- 2020Three-dimensional convolutional neural network (3D-CNN) for heterogeneous material homogenizationcited by 20
- 2018Meta-modeling game for deriving theoretical-consistent, micro-structural-based traction-separation laws via deep reinforcement learningcited by 19
- 2021Recurrent Neural Networks (RNNs) with dimensionality reduction and break down in computational mechanics; application to multi-scale localization stepcited by 8
- 2022PH-Net: Parallelepiped Microstructure Homogenization via 3D Convolutional Neural Networkscited by 4
- 2022SCouT: Synthetic Counterfactuals via Spatiotemporal Transformers for Actionable Healthcarecited by 2
- 2019A surrogate model for computational homogenization of elastostatics at finite strain using the HDMR-based neural network approximatorcited by 1
Built on by
Citing papers per year: 2024: 1; 2025: 0; 2026: 2.
3 papers.
- 2024Physically recurrent neural network for rate and path-dependent heterogeneous materials in a finite strain frameworkcited by 3
- 2026A comparative study of transformer models and recurrent neural networks for path-dependent composite materialscited by 0
- 2026Microstructure-Conditioned Surrogate Models for Graded Multiscale Optimization of Mycelium Compositescited by 0
- 2026Microstructure-Conditioned Surrogate Models for Graded Multiscale Optimization of Mycelium Composites15 Jul 2026
- 2026A comparative study of transformer models and recurrent neural networks for path-dependent composite materials17 Feb 2026
- 2024Physically recurrent neural network for rate and path-dependent heterogeneous materials in a finite strain framework5 Apr 2024