ResoNet: Robust and Explainable ENSO Forecasts with Hybrid Convolution and Transformer Networks
Not on the map. Why?
Abstract (arXiv)
Recent studies have shown that deep learning (DL) models can skillfully predict the El Ni~no-Southern Oscillation (ENSO) forecasts over 1.5 years ahead. However, concerns regarding the reliability of predictions made by DL methods persist, including potential overfitting issues and lack of interpretability. Here, we propose ResoNet, a DL model that combines convolutional neural network (CNN) and Transformer architectures. This hybrid architecture design enables our model to adequately capture local SSTA as well as long-range inter-basin interactions across oceans. We show that ResoNet can robustly predict ESNO at lead times between 19 and 26 months, thus outperforming existing approaches in terms of the forecast horizon. According to an explainability method applied to ResoNet predictions of El Ni~no and La Ni~na events from 1- to 18-month lead, we find that it predicts the Ni~no3.4 index based on multiple physically reasonable mechanisms, such as the Recharge Oscillator concept, Seasonal Footprint Mechanism, and Indian Ocean capacitor effect. Moreover, we demonstrate that for the first time, the asymmetry between El Ni~no and La Ni~na development can be captured by ResoNet. Our results could help alleviate skepticism about applying DL models for ENSO prediction and encourage more attempts to discover and predict climate phenomena using AI methods.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 9 of its 48 references that are in the map. First posted on arXiv 16 Dec 2023.
Builds on
9 of 48 references.
References · 9
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2017Axiomatic Attribution for Deep Networkscited by 3,384
- 2015Fast R-CNNcited by 2,933
- 2021MobileViT: Light-weight, General-purpose, and Mobile-friendly Vision Transformercited by 642
- 2023FengWu: Pushing the Skillful Global Medium-range Weather Forecast beyond 10 Days Leadcited by 175
- 2022Pangu-Weather: A 3D High-Resolution Model for Fast and Accurate Global Weather Forecastcited by 166
- 2021CrossFormer: A Versatile Vision Transformer Hinging on Cross-scale Attentioncited by 139
- 2021TokenLearner: What Can 8 Learned Tokens Do for Images and Videos?cited by 127
Built on by
Citing papers per year: 2024: 1; 2025: 2; 2026: 1.
4 papers.
- 2024Data-driven Global Ocean Modeling for Seasonal to Decadal Predictioncited by 14
- 2025NeuralOM: Neural Ocean Model for Subseasonal-to-Seasonal Simulationcited by 12
- 2025Towards Long-Range ENSO Prediction with an Explainable Deep Learning Modelcited by 4
- 2026Distillation and Interpretability of Ensemble Forecasts of ENSO Phase using Entropic Learningcited by 1
- 2026Distillation and Interpretability of Ensemble Forecasts of ENSO Phase using Entropic Learning15 Feb 2026
- 2025NeuralOM: Neural Ocean Model for Subseasonal-to-Seasonal Simulation27 May 2025
- 2025Towards Long-Range ENSO Prediction with an Explainable Deep Learning Model25 Mar 2025
- 2024Data-driven Global Ocean Modeling for Seasonal to Decadal Prediction24 May 2024