Latent Representation Learning of Multi-scale Thermophysics: Application to Dynamics in Shocked Porous Energetic Material
Not on the map. Why?
Abstract (arXiv)
Coupling of physics across length and time scales plays an important role in the response of microstructured materials to external loads. In a multi-scale framework, unresolved (subgrid) meso-scale dynamics is upscaled to the homogenized (macro-scale) representation of the heterogeneous material through closure models. Deep learning models trained using meso-scale simulation data are now a popular route to assimilate such closure laws. However, meso-scale simulations are computationally taxing, posing practical challenges in training deep learning-based surrogate models from scratch. In this work, we investigate an alternative meta-learning approach motivated by the idea of tokenization in natural language processing. We show that one can learn a reduced representation of the micro-scale physics to accelerate the meso-scale learning process by tokenizing the meso-scale evolution of the physical fields involved in an archetypal, albeit complex, reactive dynamics problem, textitviz., shock-induced energy localization in a porous energetic material. A probabilistic latent representation of textitmicro-scale dynamics is learned as building blocks for textitmeso-scale dynamics. The textitmeso-scale latent dynamics model learns the correlation between neighboring building blocks by training over a small dataset of meso-scale simulations. We compare the performance of our model with a physics-aware recurrent convolutional neural network (PARC) trained only on the full meso-scale dataset. We demonstrate that our model can outperform PARC with scarce meso-scale data. The proposed approach accelerates the development of closure models by leveraging inexpensive micro-scale simulations and fast training over a small meso-scale dataset, and can be applied to a range of multi-scale modeling problems.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 28 of its 97 references that are in the map. First posted on arXiv 15 Jun 2025.
Builds on
28 of 97 references.
References · 28
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,364
- 2017Prototypical Networks for Few-shot Learningcited by 3,015
- 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,908
- 2016Matching Networks for One Shot Learningcited by 2,255
- 2015Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcastingcited by 1,436
- 2020Meta-Learning in Neural Networks: A Surveycited by 950
- 2014Deep Learning in Neural Networks: An Overviewcited by 770
- 2016Learning to learn by gradient descent by gradient descentcited by 620
- 2017Understanding the Effective Receptive Field in Deep Convolutional Neural Networkscited by 553
- 2018Bilevel Programming for Hyperparameter Optimization and Meta-Learningcited by 405
16 more
- 2021Curriculum Learning: A Surveycited by 259
- 2020A comprehensive deep learning-based approach to reduced order modeling of nonlinear time-dependent parametrized PDEscited by 105
- 2020Multiscale Simulations of Complex Systems by Learning their Effective Dynamicscited by 86
- 2020A fast and accurate physics-informed neural network reduced order model with shallow masked autoencodercited by 80
- 2016Understanding Deep Convolutional Networkscited by 76
- 2021Meta-learning PINN loss functionscited by 51
- 2022Learning to Accelerate Partial Differential Equations via Latent Global Evolutioncited by 39
- 2021A novel meta-learning initialization method for physics-informed neural networkscited by 35
- 2021A Metalearning Approach for Physics-Informed Neural Networks (PINNs): Application to Parameterized PDEscited by 32
- 2023GPLaSDI: Gaussian Process-based Interpretable Latent Space Dynamics Identification through Deep Autoencodercited by 30
- 2022Reduced order modeling of parametrized systems through autoencoders and SINDy approach: continuation of periodic solutionscited by 29
- 2022Meta Learning for Natural Language Processing: A Surveycited by 26
- 2023Rethinking materials simulations: Blending direct numerical simulations with neural operatorscited by 25
- 2023Improving physics-informed neural networks with meta-learned optimizationcited by 19
- 2022PARC: Physics-Aware Recurrent Convolutional Neural Networks to Assimilate Meso-scale Reactive Mechanics of Energetic Materialscited by 11
- 2024PARCv2: Physics-aware Recurrent Convolutional Neural Networks for Spatiotemporal Dynamics Modelingcited by 10
Built on by
Not cited yet.