Accelerating Phase Field Simulations Through a Hybrid Adaptive Fourier Neural Operator with U-Net Backbone
Not on the map. Why?
Abstract (arXiv)
Prolonged contact between a corrosive liquid and metal alloys can cause progressive dealloying. For such liquid-metal dealloying (LMD) process, phase field models have been developed. However, the governing equations often involve coupled non-linear partial differential equations (PDE), which are challenging to solve numerically. In particular, stiffness in the PDEs requires an extremely small time steps (e.g. 10-12 or smaller). This computational bottleneck is especially problematic when running LMD simulation until a late time horizon is required. This motivates the development of surrogate models capable of leaping forward in time, by skipping several consecutive time steps at-once. In this paper, we propose U-Shaped Adaptive Fourier Neural Operators (U-AFNO), a machine learning (ML) model inspired by recent advances in neural operator learning. U-AFNO employs U-Nets for extracting and reconstructing local features within the physical fields, and passes the latent space through a vision transformer (ViT) implemented in the Fourier space (AFNO). We use U-AFNOs to learn the dynamics mapping the field at a current time step into a later time step. We also identify global quantities of interest (QoI) describing the corrosion process (e.g. the deformation of the liquid-metal interface) and show that our proposed U-AFNO model is able to accurately predict the field dynamics, in-spite of the chaotic nature of LMD. Our model reproduces the key micro-structure statistics and QoIs with a level of accuracy on-par with the high-fidelity numerical solver. We also investigate the opportunity of using hybrid simulations, in which we alternate forward leap in time using the U-AFNO with high-fidelity time stepping. We demonstrate that while advantageous for some surrogate model design choices, our proposed U-AFNO model in fully auto-regressive settings consistently outperforms hybrid schemes.
Key facts. Cited by 10 papers in the map (data through 7 Oct 2026). Builds on 28 of its 99 references that are in the map. First posted on arXiv 24 Jun 2024.
Builds on
28 of 99 references.
References · 28
- 2017Attention Is All You Needcited by 59,932
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,806
- 2019DeepONet: Learning nonlinear operators for identifying differential equations based on the universal approximation theorem of operatorscited by 1,965
- 2021Transformers in Vision: A Surveycited by 1,009
- 2022FourCastNet: A Global Data-driven High-resolution Weather Model using Adaptive Fourier Neural Operatorscited by 748
- 2020A Survey on Visual Transformercited by 653
- 2021Physics-Informed Neural Operator for Learning Partial Differential Equationscited by 516
- 2021Neural Operator: Learning Maps Between Function Spacescited by 413
- 2021U-FNO -- An enhanced Fourier neural operator-based deep-learning model for multiphase flowcited by 292
16 more
- 2022Transformer for Partial Differential Equations' Operator Learningcited by 270
- 2021Adaptive Fourier Neural Operators: Efficient Token Mixers for Transformerscited by 237
- 2023Convolutional Neural Operators for robust and accurate learning of PDEscited by 207
- 2022FourCastNet: Accelerating Global High-Resolution Weather Forecasting using Adaptive Fourier Neural Operatorscited by 188
- 2018Survey of multifidelity methods in uncertainty propagation, inference, and optimizationcited by 141
- 2024DPOT: Auto-Regressive Denoising Operator Transformer for Large-Scale PDE Pre-Trainingcited by 137
- 2021A physics-informed variational DeepONet for predicting the crack path in brittle materialscited by 98
- 2022Learning two-phase microstructure evolution using neural operators and autoencoder architecturescited by 72
- 2023LNO: Laplace Neural Operator for Solving Differential Equationscited by 47
- 2021Learning Dissipative Dynamics in Chaotic Systemscited by 41
- 2023GPLaSDI: Gaussian Process-based Interpretable Latent Space Dynamics Identification through Deep Autoencodercited by 29
- 2023Rethinking materials simulations: Blending direct numerical simulations with neural operatorscited by 25
- 2024A Comprehensive Review of Latent Space Dynamics Identification Algorithms for Intrusive and Non-Intrusive Reduced-Order-Modelingcited by 22
- 2023Real-time Inference and Extrapolation via a Diffusion-inspired Temporal Transformer Operator (DiTTO)cited by 16
- 2023TransformerG2G: Adaptive time-stepping for learning temporal graph embeddings using transformerscited by 9
- 2017Model Reduction For Parametrized Optimal Control Problems in Environmental Marine Sciences and Engineeringcited by 4
Built on by
Citing papers per year: 2025: 3; 2026: 7.
10 papers.
- 2025Temporal Neural Operator for Modeling Time-Dependent Physical Phenomenacited by 8
- 2025Teaching Artificial Intelligence to Perform Rapid, Resolution-Invariant Grain Growth Modeling via Fourier Neural Operatorcited by 5
- 2026Latent Generative Solvers for Generalizable Long-Term Physics Simulationcited by 2
- 2025Extrapolating Phase-Field Simulations in Space and Time with Purely Convolutional Architecturescited by 1
- 2026Physics-informed neural operator for parametric phase-field modelling of interfacial degradation and microstructural evolutioncited by 1
- 2026On the training of physics-informed neural operators for solving parametric partial differential equationscited by 1
- 2026Towards Spatio-Temporal Extrapolation of Phase-Field Simulations with Convolution-Only Neural Networkscited by 0
- 2026Tackling multiphysics problems via finite element-guided physics-informed operator learningcited by 0
- 2026A neural operator view on U-Nets for inverse imaging problemscited by 0
- 2026The limits of exactness: On the failure of automatic differentiation in physics-informed machine learningcited by 0
- 2026The limits of exactness: On the failure of automatic differentiation in physics-informed machine learning27 Sep 2026
- 2026A neural operator view on U-Nets for inverse imaging problems6 Aug 2026
- 2026On the training of physics-informed neural operators for solving parametric partial differential equations4 Jun 2026
- 2026Physics-informed neural operator for parametric phase-field modelling of interfacial degradation and microstructural evolution10 Mar 2026
- 2026Tackling multiphysics problems via finite element-guided physics-informed operator learning2 Mar 2026
- 2026Latent Generative Solvers for Generalizable Long-Term Physics Simulation11 Feb 2026
- 2026Towards Spatio-Temporal Extrapolation of Phase-Field Simulations with Convolution-Only Neural Networks8 Jan 2026
- 2025Extrapolating Phase-Field Simulations in Space and Time with Purely Convolutional Architectures25 Sep 2025
- 2025Temporal Neural Operator for Modeling Time-Dependent Physical Phenomena28 Apr 2025
- 2025Teaching Artificial Intelligence to Perform Rapid, Resolution-Invariant Grain Growth Modeling via Fourier Neural Operator18 Mar 2025