mlsanityData to 7 Oct 2026

Accelerating Phase Field Simulations Through a Hybrid Adaptive Fourier Neural Operator with U-Net Backbone

arXiv 2406.17119 ↗First posted 24 Jun 2024cs.CE cs.CV cs.LGcited by 10

Not on the map. Why?

Abstract (arXiv)

Prolonged contact between a corrosive liquid and metal alloys can cause progressive dealloying. For such liquid-metal dealloying (LMD) process, phase field models have been developed. However, the governing equations often involve coupled non-linear partial differential equations (PDE), which are challenging to solve numerically. In particular, stiffness in the PDEs requires an extremely small time steps (e.g. 10-12 or smaller). This computational bottleneck is especially problematic when running LMD simulation until a late time horizon is required. This motivates the development of surrogate models capable of leaping forward in time, by skipping several consecutive time steps at-once. In this paper, we propose U-Shaped Adaptive Fourier Neural Operators (U-AFNO), a machine learning (ML) model inspired by recent advances in neural operator learning. U-AFNO employs U-Nets for extracting and reconstructing local features within the physical fields, and passes the latent space through a vision transformer (ViT) implemented in the Fourier space (AFNO). We use U-AFNOs to learn the dynamics mapping the field at a current time step into a later time step. We also identify global quantities of interest (QoI) describing the corrosion process (e.g. the deformation of the liquid-metal interface) and show that our proposed U-AFNO model is able to accurately predict the field dynamics, in-spite of the chaotic nature of LMD. Our model reproduces the key micro-structure statistics and QoIs with a level of accuracy on-par with the high-fidelity numerical solver. We also investigate the opportunity of using hybrid simulations, in which we alternate forward leap in time using the U-AFNO with high-fidelity time stepping. We demonstrate that while advantageous for some surrogate model design choices, our proposed U-AFNO model in fully auto-regressive settings consistently outperforms hybrid schemes.

Key facts. Cited by 10 papers in the map (data through 7 Oct 2026). Builds on 28 of its 99 references that are in the map. First posted on arXiv 24 Jun 2024.

Builds on

28 of 99 references.

References · 28

  1. 2017Attention Is All You Needcited by 59,932
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  3. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
  4. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  5. 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,806
  6. 2019DeepONet: Learning nonlinear operators for identifying differential equations based on the universal approximation theorem of operatorscited by 1,965
  7. 2021Transformers in Vision: A Surveycited by 1,009
  8. 2022FourCastNet: A Global Data-driven High-resolution Weather Model using Adaptive Fourier Neural Operatorscited by 748
  9. 2020A Survey on Visual Transformercited by 653
  10. 2021Physics-Informed Neural Operator for Learning Partial Differential Equationscited by 516
  11. 2021Neural Operator: Learning Maps Between Function Spacescited by 413
  12. 2021U-FNO -- An enhanced Fourier neural operator-based deep-learning model for multiphase flowcited by 292
16 more
  1. 2022Transformer for Partial Differential Equations' Operator Learningcited by 270
  2. 2021Adaptive Fourier Neural Operators: Efficient Token Mixers for Transformerscited by 237
  3. 2023Convolutional Neural Operators for robust and accurate learning of PDEscited by 207
  4. 2022FourCastNet: Accelerating Global High-Resolution Weather Forecasting using Adaptive Fourier Neural Operatorscited by 188
  5. 2018Survey of multifidelity methods in uncertainty propagation, inference, and optimizationcited by 141
  6. 2024DPOT: Auto-Regressive Denoising Operator Transformer for Large-Scale PDE Pre-Trainingcited by 137
  7. 2021A physics-informed variational DeepONet for predicting the crack path in brittle materialscited by 98
  8. 2022Learning two-phase microstructure evolution using neural operators and autoencoder architecturescited by 72
  9. 2023LNO: Laplace Neural Operator for Solving Differential Equationscited by 47
  10. 2021Learning Dissipative Dynamics in Chaotic Systemscited by 41
  11. 2023GPLaSDI: Gaussian Process-based Interpretable Latent Space Dynamics Identification through Deep Autoencodercited by 29
  12. 2023Rethinking materials simulations: Blending direct numerical simulations with neural operatorscited by 25
  13. 2024A Comprehensive Review of Latent Space Dynamics Identification Algorithms for Intrusive and Non-Intrusive Reduced-Order-Modelingcited by 22
  14. 2023Real-time Inference and Extrapolation via a Diffusion-inspired Temporal Transformer Operator (DiTTO)cited by 16
  15. 2023TransformerG2G: Adaptive time-stepping for learning temporal graph embeddings using transformerscited by 9
  16. 2017Model Reduction For Parametrized Optimal Control Problems in Environmental Marine Sciences and Engineeringcited by 4

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 3; 2026: 7.

10 papers.