KunPeng: A Global Ocean Environmental Model
Not on the map. Why?
Abstract (arXiv)
Inspired by the similarity of the atmosphere-ocean physical coupling mechanism, this study innovatively migrates meteorological large-model techniques to the ocean domain, constructing the KunPeng global ocean environmental prediction model. Aimed at the discontinuous characteristics of marine space, we propose a terrain-adaptive mask constraint mechanism to mitigate effectively training divergence caused by abrupt gradients at land-sea boundaries. To fully integrate far-, medium-, and close-range marine features, a longitude-cyclic deformable convolution network (LC-DCN) is employed to enhance the dynamic receptive field, achieving refined modeling of multi-scale oceanic characteristics. A Deformable Convolution-enhanced Multi-Step Prediction module (DC-MTP) is employed to strengthen temporal dependency feature extraction capabilities. Experimental results demonstrate that this model achieves an average ACC of 0.80 in 15-day global predictions at 0.25^circ resolution, outperforming comparative models by 0.01-0.08. The average mean squared error (MSE) is 0.41 (representing a 5%-31% reduction) and the average mean absolute error (MAE) is 0.44 (0.6%-21% reduction) compared to other models. Significant improvements are particularly observed in sea surface parameter prediction, deep-sea region characterization, and current velocity field forecasting. Through a horizontal comparison of the applicability of operators at different scales in the marine domain, this study reveals that local operators significantly outperform global operators under slow-varying oceanic processes, demonstrating the effectiveness of dynamic feature pyramid representations in predicting marine physical parameters.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 25 of its 68 references that are in the map. First posted on arXiv 7 Apr 2025.
Builds on
25 of 68 references.
References · 25
- 2017Attention Is All You Needcited by 59,932
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
- 2016Gaussian Error Linear Units (GELUs)cited by 3,431
- 2017Deformable Convolutional Networkscited by 1,481
- 2019ZeRO: Memory Optimizations Toward Training Trillion Parameter Modelscited by 1,278
- 2021Swin Transformer V2: Scaling Up Capacity and Resolutioncited by 1,215
- 2017Mixed Precision Trainingcited by 1,135
- 2022InternImage: Exploring Large-Scale Vision Foundation Models with Deformable Convolutionscited by 479
- 2020DCN V2: Improved Deep & Cross Network and Practical Lessons for Web-scale Learning to Rank Systemscited by 326
- 2023FuXi: A cascade machine learning forecasting system for 15-day global weather forecastcited by 237
- 2022FourCastNet: Accelerating Global High-Resolution Weather Forecasting using Adaptive Fourier Neural Operatorscited by 188
13 more
- 2024Efficient Deformable ConvNets: Rethinking Dynamic and Sparse Operator for Vision Applicationscited by 49
- 2023Adaptive Frequency Filters As Efficient Global Token Mixerscited by 45
- 2024ChaosBench: A Multi-Channel, Physics-Based Benchmark for Subseasonal-to-Seasonal Climate Predictioncited by 40
- 2023SwinRDM: Integrate SwinRNN with Diffusion Model towards High-Resolution and High-Quality Weather Forecastingcited by 32
- 2022SwinVRNN: A Data-Driven Ensemble Forecasting Model via Learned Distribution Perturbationcited by 31
- 2024Continuous Ensemble Weather Forecasting with Diffusion modelscited by 27
- 2023AI-GOMS: Large AI-Driven Global Ocean Modeling Systemcited by 26
- 2023OceanNet: A principled neural operator-based digital twin for regional oceanscited by 24
- 2024Fuxi-DA: A Generalized Deep Learning Data Assimilation Framework for Assimilating Satellite Observationscited by 18
- 2023GLH-Water: A Large-Scale Dataset for Global Surface Water Detection in Large-Size Very-High-Resolution Satellite Imagerycited by 16
- 2024FuXi-2.0: Advancing machine learning weather forecasting model for practical applicationscited by 11
- 2024Deep Random Features for Scalable Interpolation of Spatiotemporal Datacited by 6
- 2024LangYa: Revolutionizing Cross-Spatiotemporal Ocean Forecastingcited by 6
Built on by
Not cited yet.