Accelerate Coastal Ocean Circulation Model with AI Surrogate
Not on the map. Why?
Abstract (arXiv)
Nearly 900 million people live in low-lying coastal zones around the world and bear the brunt of impacts from more frequent and severe hurricanes and storm surges. Oceanographers simulate ocean current circulation along the coasts to develop early warning systems that save lives and prevent loss and damage to property from coastal hazards. Traditionally, such simulations are conducted using coastal ocean circulation models such as the Regional Ocean Modeling System (ROMS), which usually runs on an HPC cluster with multiple CPU cores. However, the process is time-consuming and energy expensive. While coarse-grained ROMS simulations offer faster alternatives, they sacrifice detail and accuracy, particularly in complex coastal environments. Recent advances in deep learning and GPU architecture have enabled the development of faster AI (neural network) surrogates. This paper introduces an AI surrogate based on a 4D Swin Transformer to simulate coastal tidal wave propagation in an estuary for both hindcast and forecast (up to 12 days). Our approach not only accelerates simulations but also incorporates a physics-based constraint to detect and correct inaccurate results, ensuring reliability while minimizing manual intervention. We develop a fully GPU-accelerated workflow, optimizing the model training and inference pipeline on NVIDIA DGX-2 A100 GPUs. Our experiments demonstrate that our AI surrogate reduces the time cost of 12-day forecasting of traditional ROMS simulations from 9,908 seconds (on 512 CPU cores) to 22 seconds (on one A100 GPU), achieving over 450× speedup while maintaining high-quality simulation results. This work contributes to oceanographic modeling by offering a fast, accurate, and physically consistent alternative to traditional simulation models, particularly for real-time forecasting in rapid disaster response.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 26 of its 65 references that are in the map. First posted on arXiv 19 Oct 2024.
Builds on
26 of 65 references.
References · 26
- 2017Attention Is All You Needcited by 59,932
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
- 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 6,979
- 2016Layer Normalizationcited by 5,579
- 2016Gaussian Error Linear Units (GELUs)cited by 3,431
- 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,806
- 2021Is Space-Time Attention All You Need for Video Understanding?cited by 1,609
- 2021Video Swin Transformercited by 1,090
- 2022Swin UNETR: Swin Transformers for Semantic Segmentation of Brain Tumors in MRI Imagescited by 823
- 2022FourCastNet: A Global Data-driven High-resolution Weather Model using Adaptive Fourier Neural Operatorscited by 748
14 more
- 2020Neural Operator: Graph Kernel Network for Partial Differential Equationscited by 722
- 2022Scientific Machine Learning through Physics-Informed Neural Networks: Where we are and What's nextcited by 603
- 2021Self-Supervised Pre-Training of Swin Transformers for 3D Medical Image Analysiscited by 418
- 2022Fourier Neural Operator with Learned Deformations for PDEs on General Geometriescited by 416
- 2020Multipole Graph Neural Operator for Parametric Partial Differential Equationscited by 343
- 2021Choose a Transformer: Fourier or Galerkincited by 333
- 2023Geometry-Informed Neural Operator for Large-Scale 3D PDEscited by 293
- 2021Adaptive Fourier Neural Operators: Efficient Token Mixers for Transformerscited by 237
- 2023NodeFormer: A Scalable Graph Structure Learning Transformer for Node Classificationcited by 207
- 2021Enhancing Computational Fluid Dynamics with Machine Learningcited by 137
- 2022Continuous PDE Dynamics Forecasting with Implicit Neural Representationscited by 71
- 2022CROM: Continuous Reduced-Order Modeling of PDEs Using Implicit Neural Representationscited by 56
- 2022Neural Implicit Flow: a mesh-agnostic dimensionality reduction paradigm of spatio-temporal datacited by 37
- 2023SwiFT: Swin 4D fMRI Transformercited by 36
Built on by
Citing papers per year: 2026: 2.
2 papers.