Data-driven geophysical forecasting: Simple, low-cost, and accurate baselines with kernel methods
Not on the map. Why?
Abstract (arXiv)
Modeling geophysical processes as low-dimensional dynamical systems and regressing their vector field from data is a promising approach for learning emulators of such systems. We show that when the kernel of these emulators is also learned from data (using kernel flows, a variant of cross-validation), then the resulting data-driven models are not only faster than equation-based models but are easier to train than neural networks such as the long short-term memory neural network. In addition, they are also more accurate and predictive than the latter. When trained on geophysical observational data, for example, the weekly averaged global sea-surface temperature, considerable gains are also observed by the proposed technique in comparison to classical partial differential equation-based models in terms of forecast computational cost and accuracy. When trained on publicly available re-analysis data for the daily temperature of the North-American continent, we see significant improvements over classical baselines such as climatology and persistence-based forecast techniques. Although our experiments concern specific examples, the proposed approach is general, and our results support the viability of kernel methods (with learned kernels) for interpretable and computationally efficient geophysical forecasting for a large diversity of processes.
Key facts. Cited by 15 papers in the map (data through 14 Oct 2026). Builds on 15 of its 57 references that are in the map. First posted on arXiv 13 Feb 2021.
Builds on
15 of 57 references.
References · 15
- 2017A Unified Approach to Interpreting Model Predictionscited by 6,555
- 2016Simple and Scalable Predictive Uncertainty Estimation using Deep Ensemblescited by 3,926
- 2015Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcastingcited by 1,436
- 2019Tackling Climate Change with Machine Learningcited by 265
- 2018Deep learning to represent sub-grid processes in climate modelscited by 156
- 2020Improving data-driven global weather prediction using deep convolutional neural networks on a cubed spherecited by 96
- 2020Every Model Learned by Gradient Descent Is Approximately a Kernel Machinecited by 55
- 2017Machine Learning for the Geosciences: Challenges and Opportunitiescited by 53
- 2018Kernel Flows: from learning kernels from data into the abysscited by 49
- 2019Analog forecasting of extreme-causing weather patterns using deep learningcited by 33
- 2016Application of Deep Convolutional Neural Networks for Detecting Extreme Weather in Climate Datasetscited by 31
- 2018DeepDownscale: a Deep Learning Strategy for High-Resolution Weather Forecastcited by 28
3 more
- 2020Data-driven super-parameterization using deep learning: Experimentation with multi-scale Lorenz 96 systems and transfer-learningcited by 17
- 2020Deep regularization and direct training of the inner layers of Neural Networks with Kernel Flowscited by 10
- 2020Meta-modeling strategy for data-driven forecastingcited by 1
Built on by
Citing papers per year: 2021: 4; 2022: 4; 2023: 4; 2024: 2; 2025: 1.
15 papers.
Sort:
- 2023Kernel Methods are Competitive for Operator Learningcited by 50
- 2021Computational Graph Completioncited by 28
- 2022One-Shot Learning of Stochastic Differential Equations with Data Adapted Kernelscited by 15
- 2023Learning Dynamical Systems from Data: A Simple Cross-Validation Perspective, Part V: Sparse Kernel Flows for 132 Chaotic Dynamical Systemscited by 15
- 2021Learning dynamical systems from data: A simple cross-validation perspective, part III: Irregularly-Sampled Time Seriescited by 14
- 2022Learning "best" kernels from data in Gaussian process regression. With application to aerodynamicscited by 9
- 2023Codiscovering graphical structure and functional relationships within data: A Gaussian Process framework for connecting the dotscited by 8
- 2022Gaussian Process Hydrodynamicscited by 4
- 2024Kernel Sum of Squares for Data Adapted Kernel Learning of Dynamical Systems from Data: A global optimization approachcited by 4
- 2021Deep learning for surrogate modelling of 2D mantle convectioncited by 3
- 2023Bridging Algorithmic Information Theory and Machine Learning: A New Approach to Kernel Learningcited by 3
- 2021Analysis of Structured Deep Kernel Networkscited by 2
3 more
- 2025Discovery of Probabilistic Dirichlet-to-Neumann Maps on Graphs3 Jun 2025
- 2024Kernel Sum of Squares for Data Adapted Kernel Learning of Dynamical Systems from Data: A global optimization approach12 Aug 2024
- 2024Recurrent Deep Kernel Learning of Dynamical Systems30 May 2024
- 2023Codiscovering graphical structure and functional relationships within data: A Gaussian Process framework for connecting the dots28 Nov 2023
- 2023Bridging Algorithmic Information Theory and Machine Learning: A New Approach to Kernel Learning21 Nov 2023
- 2023Kernel Methods are Competitive for Operator Learning26 Apr 2023
- 2023Learning Dynamical Systems from Data: A Simple Cross-Validation Perspective, Part V: Sparse Kernel Flows for 132 Chaotic Dynamical Systems24 Jan 2023
- 2022One-Shot Learning of Stochastic Differential Equations with Data Adapted Kernels24 Sep 2022
- 2022Gaussian Process Hydrodynamics21 Sep 2022
- 2022Ensemble forecasts in reproducing kernel Hilbert space family29 Jul 2022
- 2022Learning "best" kernels from data in Gaussian process regression. With application to aerodynamics3 Jun 2022
- 2021Learning dynamical systems from data: A simple cross-validation perspective, part III: Irregularly-Sampled Time Series25 Nov 2021
3 more
- 2021Computational Graph Completion20 Oct 2021
- 2021Deep learning for surrogate modelling of 2D mantle convection23 Aug 2021
- 2021Analysis of Structured Deep Kernel Networks15 May 2021
- 2023Kernel Methods are Competitive for Operator Learningcited by 50
- 2021Computational Graph Completioncited by 28
- 2022One-Shot Learning of Stochastic Differential Equations with Data Adapted Kernelscited by 15
- 2023Learning Dynamical Systems from Data: A Simple Cross-Validation Perspective, Part V: Sparse Kernel Flows for 132 Chaotic Dynamical Systemscited by 15
- 2021Learning dynamical systems from data: A simple cross-validation perspective, part III: Irregularly-Sampled Time Seriescited by 14
- 2022Learning "best" kernels from data in Gaussian process regression. With application to aerodynamicscited by 9
- 2023Codiscovering graphical structure and functional relationships within data: A Gaussian Process framework for connecting the dotscited by 8
- 2022Gaussian Process Hydrodynamicscited by 4
- 2024Kernel Sum of Squares for Data Adapted Kernel Learning of Dynamical Systems from Data: A global optimization approachcited by 4
- 2021Deep learning for surrogate modelling of 2D mantle convectioncited by 3
- 2023Bridging Algorithmic Information Theory and Machine Learning: A New Approach to Kernel Learningcited by 3
- 2021Analysis of Structured Deep Kernel Networkscited by 2
12 most cited of 15 All 15 (JSON)
- 2025Discovery of Probabilistic Dirichlet-to-Neumann Maps on Graphs3 Jun 2025
- 2024Kernel Sum of Squares for Data Adapted Kernel Learning of Dynamical Systems from Data: A global optimization approach12 Aug 2024
- 2024Recurrent Deep Kernel Learning of Dynamical Systems30 May 2024
- 2023Codiscovering graphical structure and functional relationships within data: A Gaussian Process framework for connecting the dots28 Nov 2023
- 2023Bridging Algorithmic Information Theory and Machine Learning: A New Approach to Kernel Learning21 Nov 2023
- 2023Kernel Methods are Competitive for Operator Learning26 Apr 2023
- 2023Learning Dynamical Systems from Data: A Simple Cross-Validation Perspective, Part V: Sparse Kernel Flows for 132 Chaotic Dynamical Systems24 Jan 2023
- 2022One-Shot Learning of Stochastic Differential Equations with Data Adapted Kernels24 Sep 2022
- 2022Gaussian Process Hydrodynamics21 Sep 2022
- 2022Ensemble forecasts in reproducing kernel Hilbert space family29 Jul 2022
- 2022Learning "best" kernels from data in Gaussian process regression. With application to aerodynamics3 Jun 2022
- 2021Learning dynamical systems from data: A simple cross-validation perspective, part III: Irregularly-Sampled Time Series25 Nov 2021
12 newest of 15 All 15 (JSON)