mlsanityData to 14 Oct 2026

Vision Transformers for Multi-Variable Climate Downscaling: Emulating Regional Climate Models with a Shared Encoder and Multi-Decoder Architecture

arXiv 2506.22447 ↗First posted 12 Jun 2025cs.LG cs.AI eess.IVcited by 0

Not on the map. Why?

Abstract (arXiv)

Global Climate Models (GCMs) are critical for simulating large-scale climate dynamics, but their coarse spatial resolution limits their applicability in regional studies. Regional Climate Models (RCMs) address this limitation through dynamical downscaling, albeit at considerable computational cost and with limited flexibility. Deep learning has emerged as an efficient data-driven alternative; however, most existing approaches focus on single-variable models that downscale one variable at a time. This paradigm can lead to redundant computation, limited contextual awareness, and weak cross-variable interactions.To address these limitations, we propose a multi-variable Vision Transformer (ViT) architecture with a shared encoder and variable-specific decoders (1EMD). The proposed model jointly predicts six key climate variables: surface temperature, wind speed, 500 hPa geopotential height, total precipitation, surface downwelling shortwave radiation, and surface downwelling longwave radiation, directly from GCM-resolution inputs, emulating RCM-scale downscaling over Europe. Compared to single-variable ViT models, the 1EMD architecture improves performance across all six variables, achieving an average MSE reduction of approximately 5.5% under a fair and controlled comparison. It also consistently outperforms alternative multi-variable baselines, including a single-decoder ViT and a multi-variable U-Net. Moreover, multi-variable models substantially reduce computational cost, yielding a 29-32% lower inference time per variable compared to single-variable approaches. Overall, our results demonstrate that multi-variable modeling provides systematic advantages for high-resolution climate downscaling in terms of both accuracy and efficiency. Among the evaluated architectures, the proposed 1EMD ViT achieves the most favorable trade-off between predictive performance and computational cost.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 28 of its 60 references that are in the map. First posted on arXiv 12 Jun 2025.

Builds on

28 of 60 references.

References · 28

  1. 2016Gaussian Error Linear Units (GELUs)cited by 3,502
  2. 2021SwinIR: Image Restoration Using Swin Transformercited by 1,887
  3. 2021Vision Transformers for Dense Predictioncited by 1,803
  4. 2021TransUNet: Transformers Make Strong Encoders for Medical Image Segmentationcited by 1,558
  5. 2020Rethinking Semantic Segmentation from a Sequence-to-Sequence Perspective with Transformerscited by 1,369
  6. 2021Uformer: A General U-Shaped Transformer for Image Restorationcited by 866
  7. 2020Multi-Task Learning with Deep Neural Networks: A Surveycited by 375
  8. 2020Improving Reproducibility in Machine Learning Research (A Report from the NeurIPS 2019 Reproducibility Program)cited by 322
  9. 2017Are GANs Created Equal? A Large-Scale Studycited by 267
  10. 2021Transformer for Single Image Super-Resolutioncited by 150
  11. 2021Video Super-Resolution Transformercited by 121
  12. 2018Troubling Trends in Machine Learning Scholarshipcited by 108
16 more
  1. 2017DeepSD: Generating High Resolution Climate Change Projections through Single Image Super-Resolutioncited by 82
  2. 2022A Generative Deep Learning Approach to Stochastic Downscaling of Precipitation Forecastscited by 66
  3. 2022Hard-Constrained Deep Learning for Climate Downscalingcited by 32
  4. 2023Fourier Neural Operators for Arbitrary Resolution Climate Data Downscalingcited by 26
  5. 2024Generative Diffusion-based Downscaling for Climatecited by 25
  6. 2023Precipitation nowcasting with generative diffusion modelscited by 23
  7. 2024Conditional diffusion models for downscaling and bias correction of Earth system model precipitationcited by 17
  8. 2022ITTR: Unpaired Image-to-Image Translation with Transformerscited by 15
  9. 2024Wind speed super-resolution and validation: from ERA5 to CERRA via diffusion modelscited by 15
  10. 2020RainNet: A Large-Scale Imagery Dataset and Benchmark for Spatial Precipitation Downscalingcited by 14
  11. 2024Can AI be enabled to dynamical downscaling? A Latent Diffusion Model to mimic km-scale COSMO5.0CLM9 simulationscited by 14
  12. 2022On the modern deep learning approaches for precipitation downscalingcited by 9
  13. 2022Deep generative model super-resolves spatially correlated multiregional climate datacited by 9
  14. 2025Regional climate projections using a deep-learning-based model-ranking and downscaling framework: Application to European climate zonescited by 2
  15. 2023DSAF: A Dual-Stage Adaptive Framework for Numerical Weather Prediction Downscalingcited by 1
  16. 2025Controlling Ensemble Variance in Diffusion Models: An Application for Reanalyses Downscalingcited by 1

Built on by

Not cited yet.