# Meta-modeling game for deriving theoretical-consistent, micro-structural-based traction-separation laws via deep reinforcement learning

arXiv: https://arxiv.org/abs/1810.10535 · HTML: https://mlsanity.com/paper/1810.10535/

## Key facts

- Cited by 19 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 24 Oct 2018.

## Built on by (most cited first, 19 of 19)

- [Encoding physics to learn reaction-diffusion processes](https://mlsanity.com/paper/2106.04781/) (2021)
- [A review on data-driven constitutive laws for solids](https://mlsanity.com/paper/2405.03658/) (2024)
- [Denoising diffusion algorithm for inverse design of microstructures with fine-tuned nonlinear material properties](https://mlsanity.com/paper/2302.12881/) (2023)
- [Deep Learning in Deterministic Computational Mechanics](https://mlsanity.com/paper/2309.15421/) (2023)
- [Beyond Games: A Systematic Review of Neural Monte Carlo Tree Search Applications](https://mlsanity.com/paper/2303.08060/) (2023)
- [Recent Advances and Applications of Machine Learning in Experimental Solid Mechanics: A Review](https://mlsanity.com/paper/2303.07647/) (2023)
- [Towards out of distribution generalization for problems in mechanics](https://mlsanity.com/paper/2206.14917/) (2022)
- [Data-driven discovery of interpretable causal relations for deep learning material laws with uncertainty propagation](https://mlsanity.com/paper/2105.09980/) (2021)
- [Predicting Mechanically Driven Full-Field Quantities of Interest with Deep Learning-Based Metamodels](https://mlsanity.com/paper/2108.03995/) (2021)
- [Discovering interpretable elastoplasticity models via the neural polynomial method enabled symbolic regressions](https://mlsanity.com/paper/2307.13149/) (2023)
- [Bayesian neural networks for weak solution of PDEs with uncertainty quantification](https://mlsanity.com/paper/2101.04879/) (2021)
- [Design of experiments for the calibration of history-dependent models via deep reinforcement learning and an enhanced Kalman filter](https://mlsanity.com/paper/2209.13126/) (2022)
- [Multi-Scale Simulation of Complex Systems: A Perspective of Integrating Knowledge and Data](https://mlsanity.com/paper/2306.10275/) (2023)
- [Artificial Intelligence in Materials Science and Engineering: Current Landscape, Key Challenges, and Future Trajectorie](https://mlsanity.com/paper/2601.12554/) (2026)
- [A Neural Network Transformer Model for Composite Microstructure Homogenization](https://mlsanity.com/paper/2304.07877/) (2023)
- [Machine Learning Aided Modeling of Granular Materials: A Review](https://mlsanity.com/paper/2410.14767/) (2024)
- [Towards scientific machine learning for granular material simulations -- challenges and opportunities](https://mlsanity.com/paper/2504.08766/) (2025)
- [Reinforcement learning based data assimilation for unknown state model](https://mlsanity.com/paper/2511.02286/) (2025)
- [Data-Driven Dynamic Friction Models based on Recurrent Neural Networks](https://mlsanity.com/paper/2402.14148/) (2024)

## Abstract (arXiv)

This paper presents a new meta-modeling framework to employ deep reinforcement learning (DRL) to generate mechanical constitutive models for interfaces. The constitutive models are conceptualized as information flow in directed graphs. The process of writing constitutive models are simplified as a sequence of forming graph edges with the goal of maximizing the model score (a function of accuracy, robustness and forward prediction quality). Thus meta-modeling can be formulated as a Markov decision process with well-defined states, actions, rules, objective functions, and rewards. By using neural networks to estimate policies and state values, the computer agent is able to efficiently self-improve the constitutive model it generated through self-playing, in the same way AlphaGo Zero (the algorithm that outplayed the world champion in the game of Go)improves its gameplay. Our numerical examples show that this automated meta-modeling framework not only produces models which outperform existing cohesive models on benchmark traction-separation data but is also capable of detecting hidden mechanisms among micro-structural features and incorporating them in constitutive models to improve the forward prediction accuracy, which are difficult tasks to do manually.