Learning Regional Monsoon Patterns with a Multimodal Attention U-Net
Not on the map. Why?
Abstract (arXiv)
Accurate monsoon rainfall prediction is vital for India's agriculture, water management, and climate risk planning, yet remains challenging due to sparse ground observations and complex regional variability. We present a multimodal deep learning framework for high-resolution precipitation classification that leverages satellite and Earth observation data. Unlike previous rainfall prediction models based on coarse 5-50 km grids, we curate a new 1 km resolution dataset for five Indian states, integrating seven key geospatial modalities: land surface temperature, vegetation (NDVI), soil moisture, relative humidity, wind speed, elevation, and land use, covering the June-September 2024 monsoon season. Our approach uses an attention-guided U-Net architecture to capture spatial patterns and temporal dependencies across modalities, combined with focal and dice loss functions to handle rainfall class imbalance defined by the India Meteorological Department (IMD). Experiments demonstrate that our multimodal framework consistently outperforms unimodal baselines and existing deep learning methods, especially in extreme rainfall categories. This work contributes a scalable framework, benchmark dataset, and state-of-the-art results for regional monsoon forecasting, climate resilience, and geospatial AI applications in India.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 7 of its 29 references that are in the map. First posted on arXiv 27 Sep 2025.
Builds on
7 of 29 references.
References · 7
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2018Attention U-Net: Learning Where to Look for the Pancreascited by 1,435
- 2017Generalised Dice overlap as a deep learning loss function for highly unbalanced segmentationscited by 620
- 2021Skillful Precipitation Nowcasting using Deep Generative Models of Radarcited by 311
- 2017Deep Learning for Precipitation Nowcasting: A Benchmark and A New Modelcited by 182
Built on by
Not cited yet.