mlsanityData to 7 Oct 2026

FNP: Fourier Neural Processes for Arbitrary-Resolution Data Assimilation

arXiv 2406.01645 ↗First posted 3 Jun 2024cs.LG cs.AIcited by 8

Not on the map. Why?

Abstract (arXiv)

Data assimilation is a vital component in modern global medium-range weather forecasting systems to obtain the best estimation of the atmospheric state by combining the short-term forecast and observations. Recently, AI-based data assimilation approaches have attracted increasing attention for their significant advantages over traditional techniques in terms of computational consumption. However, existing AI-based data assimilation methods can only handle observations with a specific resolution, lacking the compatibility and generalization ability to assimilate observations with other resolutions. Considering that complex real-world observations often have different resolutions, we propose the textitFourier Neural Processes (FNP) for textitarbitrary-resolution data assimilation in this paper. Leveraging the efficiency of the designed modules and flexible structure of neural processes, FNP achieves state-of-the-art results in assimilating observations with varying resolutions, and also exhibits increasing advantages over the counterparts as the resolution and the amount of observations increase. Moreover, our FNP trained on a fixed resolution can directly handle the assimilation of observations with out-of-distribution resolutions and the observational information reconstruction task without additional fine-tuning, demonstrating its excellent generalization ability across data resolutions as well as across tasks.

Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Builds on 30 of its 61 references that are in the map. First posted on arXiv 3 Jun 2024.

Builds on

30 of 61 references.

References · 30

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,806
  3. 2017Decoupled Weight Decay Regularizationcited by 1,722
  4. 2022FourCastNet: A Global Data-driven High-resolution Weather Model using Adaptive Fourier Neural Operatorscited by 748
  5. 2018Conditional Neural Processescited by 421
  6. 2018Neural Processescited by 307
  7. 2019Attentive Neural Processescited by 280
  8. 2020WeatherBench: A benchmark dataset for data-driven weather forecastingcited by 272
  9. 2023FuXi: A cascade machine learning forecasting system for 15-day global weather forecastcited by 237
  10. 2023WeatherBench 2: A benchmark for the next generation of data-driven global weather modelscited by 227
  11. 2023FengWu: Pushing the Skillful Global Medium-range Weather Forecast beyond 10 Days Leadcited by 170
  12. 2019Convolutional Conditional Neural Processescited by 139
18 more
  1. 2023Score-based Data Assimilationcited by 91
  2. 2020Meta-Learning Stationary Stochastic Process Prediction with Convolutional Neural Processescited by 74
  3. 2023Machine learning with data assimilation and uncertainty quantification for dynamical systems: a reviewcited by 74
  4. 2024DiffDA: a Diffusion Model for Weather-scale Data Assimilationcited by 59
  5. 2021Convolutional conditional neural processes for local climate downscalingcited by 29
  6. 2021Latent Space Data Assimilation by using Deep Learningcited by 29
  7. 2024Deep Generative Data Assimilation in Multimodal Settingcited by 28
  8. 2021Integrating Recurrent Neural Networks with Data Assimilation for Scalable Data-Driven State Estimationcited by 20
  9. 2023Towards an end-to-end artificial intelligence driven global weather forecasting systemcited by 20
  10. 2024ExtremeCast: Boosting Extreme Value Prediction for Global Weather Forecastcited by 19
  11. 2024Fuxi-DA: A Generalized Deep Learning Data Assimilation Framework for Assimilating Satellite Observationscited by 18
  12. 2022Environmental Sensor Placement with Convolutional Gaussian Neural Processescited by 14
  13. 2022Evidential Conditional Neural Processescited by 10
  14. 2023Latent assimilation with implicit neural representations for unknown dynamicscited by 8
  15. 2021Observation Error Covariance Specification in Dynamical Systems for Data assimilation using Recurrent Neural Networkscited by 7
  16. 2023Sim2Real for Environmental Neural Processescited by 4
  17. 2024Spectral Convolutional Conditional Neural Processescited by 4
  18. 2021GP-ConvCNP: Better Generalization for Convolutional Conditional Neural Processes on Time Series Datacited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 1; 2025: 5; 2026: 2.

8 papers.