mlsanityData to 14 Oct 2026

Generative 3D Gaussian Splatting for Arbitrary-ResolutionAtmospheric Downscaling and Forecasting

arXiv 2604.07928 ↗First posted 9 Apr 2026cs.CV cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

While AI-based numerical weather prediction (NWP) enables rapid forecasting, generating high-resolution outputs remains computationally demanding due to limited multi-scale adaptability and inefficient data representations. We propose the 3D Gaussian splatting-based scale-aware vision transformer (GSSA-ViT), a novel framework for arbitrary-resolution forecasting and flexible downscaling of high-dimensional atmospheric fields. Specifically, latitude-longitude grid points are treated as centers of 3D Gaussians. A generative 3D Gaussian prediction scheme is introduced to estimate key parameters, including covariance, attributes, and opacity, for unseen samples, improving generalization and mitigating overfitting. In addition, a scale-aware attention module is designed to capture cross-scale dependencies, enabling the model to effectively integrate information across varying downscaling ratios and support continuous resolution adaptation. To our knowledge, this is the first NWP approach that combines generative 3D Gaussian modeling with scale-aware attention for unified multi-scale prediction. Experiments on ERA5 show that the proposed method accurately forecasts 87 atmospheric variables at arbitrary resolutions, while evaluations on ERA5 and CMIP6 demonstrate its superior performance in downscaling tasks. The proposed framework provides an efficient and scalable solution for high-resolution, multi-scale atmospheric prediction and downscaling. Code is available at: https://github.com/binbin2xs/weather-GS.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 30 of its 56 references that are in the map. First posted on arXiv 9 Apr 2026.

Builds on

30 of 56 references.

References · 30

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  3. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
  4. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
  5. 2023Dynamic 3D Gaussians: Tracking by Persistent Dynamic View Synthesiscited by 737
  6. 2020Learning Continuous Image Representation with Local Implicit Image Functioncited by 552
  7. 2016Accelerating the Super-Resolution Convolutional Neural Networkcited by 394
  8. 2023Feature 3DGS: Supercharging 3D Gaussian Splatting to Enable Distilled Feature Fieldscited by 364
  9. 2023SC-GS: Sparse-Controlled Gaussian Splatting for Editable Dynamic Scenescited by 347
  10. 2023ClimaX: A foundation model for weather and climatecited by 337
  11. 2023Neural General Circulation Models for Weather and Climatecited by 239
  12. 2024GaussianPro: 3D Gaussian Splatting with Progressive Propagationcited by 200
18 more
  1. 2022FourCastNet: Accelerating Global High-Resolution Weather Forecasting using Adaptive Fourier Neural Operatorscited by 188
  2. 2019Meta-SR: A Magnification-Arbitrary Network for Super-Resolutioncited by 181
  3. 2023GenCast: Diffusion-based ensemble forecasting for medium-range weathercited by 177
  4. 2023FengWu: Pushing the Skillful Global Medium-range Weather Forecast beyond 10 Days Leadcited by 175
  5. 2024GaussianFormer: Scene as Gaussians for Vision-Based 3D Semantic Occupancy Predictioncited by 157
  6. 2023Residual Corrective Diffusion Modeling for Km-scale Atmospheric Downscalingcited by 110
  7. 2023Scaling transformer neural networks for skillful and reliable medium-range weather forecastingcited by 110
  8. 2024GaussianImage: 1000 FPS Image Representation and Compression by 2D Gaussian Splattingcited by 99
  9. 2017DeepSD: Generating High Resolution Climate Change Projections through Single Image Super-Resolutioncited by 82
  10. 2020Stochastic Super-Resolution for Downscaling Time-Evolving Atmospheric Fields with a Generative Adversarial Networkcited by 70
  11. 2024Image-GS: Content-Adaptive Image Representation via 2D Gaussianscited by 35
  12. 2024Generalizing Weather Forecast to Fine-grained Temporal Scales via Physics-AI Hybrid Modelingcited by 23
  13. 2023Towards an end-to-end artificial intelligence driven global weather forecasting systemcited by 21
  14. 2025Generalized and Efficient 2D Gaussian Splatting for Arbitrary-scale Super-Resolutioncited by 21
  15. 2024ExtremeCast: Boosting Extreme Value Prediction for Global Weather Forecastcited by 19
  16. 2025Satellite Observations Guided Diffusion Model for Accurate Meteorological States at Arbitrary Resolutioncited by 9
  17. 2025STCast: Adaptive Boundary Alignment for Global and Regional Weather Forecastingcited by 7
  18. 2024VA-MoE: Variables-Adaptive Mixture of Experts for Incremental Weather Forecastingcited by 6

Built on by

Not cited yet.