mlsanityData to 7 Oct 2026

AA-TransUNet: Attention Augmented TransUNet For Nowcasting Tasks

arXiv 2202.04996 ↗First posted 10 Feb 2022cs.LG cs.AIcited by 22

Not on the map. Why?

Abstract (arXiv)

Data driven modeling based approaches have recently gained a lot of attention in many challenging meteorological applications including weather element forecasting. This paper introduces a novel data-driven predictive model based on TransUNet for precipitation nowcasting task. The TransUNet model which combines the Transformer and U-Net models has been previously successfully applied in medical segmentation tasks. Here, TransUNet is used as a core model and is further equipped with Convolutional Block Attention Modules (CBAM) and Depthwise-separable Convolution (DSC). The proposed Attention Augmented TransUNet (AA-TransUNet) model is evaluated on two distinct datasets: the Dutch precipitation map dataset and the French cloud cover dataset. The obtained results show that the proposed model outperforms other examined models on both tested datasets. Furthermore, the uncertainty analysis of the proposed AA-TransUNet is provided to give additional insights on its predictions.

Key facts. Cited by 22 papers in the map (data through 7 Oct 2026). Builds on 24 of its 37 references that are in the map. First posted on arXiv 10 Feb 2022.

Builds on

24 of 37 references.

References · 24

  1. 2017Attention Is All You Needcited by 59,932
  2. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  3. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  4. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  5. 2015Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learningcited by 4,416
  6. 2018CBAM: Convolutional Block Attention Modulecited by 2,463
  7. 2016Xception: Deep Learning with Depthwise Separable Convolutionscited by 2,320
  8. 2021TransUNet: Transformers Make Strong Encoders for Medical Image Segmentationcited by 1,552
  9. 2015Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcastingcited by 1,428
  10. 2021DeepViT: Towards Deeper Vision Transformercited by 288
  11. 2018Stochastic Video Generation with a Learned Priorcited by 244
  12. 2021Investigating the Limitations of Transformers with Simple Arithmetic Taskscited by 136
12 more
  1. 2021Vision Transformer for Small-Size Datasetscited by 122
  2. 2020SmaAt-UNet: Precipitation Nowcasting using a Small Attention-UNet Architecturecited by 71
  3. 2019Machine Learning for Precipitation Nowcasting from Radar Imagescited by 56
  4. 2020Towards Learning Convolutions from Scratchcited by 46
  5. 2021Broad-UNet: Multi-scale feature learning for nowcasting taskscited by 25
  6. 2021Deep Graph Convolutional Networks for Wind Speed Predictioncited by 19
  7. 2020Wind speed prediction using multidimensional convolutional neural networkscited by 17
  8. 2021Symbolic regression for scientific discovery: an application to wind speed forecastingcited by 16
  9. 2020Deep coastal sea elements forecasting using U-Net based modelscited by 14
  10. 2021Multistream Graph Attention Networks for Wind Speed Forecastingcited by 12
  11. 2021TENT: Tensorized Encoder Transformer for Temperature Forecastingcited by 7
  12. 2020Cloud Cover Nowcasting with Deep Learningcited by 4

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2022: 1; 2023: 4; 2024: 6; 2025: 2; 2026: 9.

22 papers.

Sort:

By area:

  1. 2023DA-TransUNet: Integrating Spatial and Channel Dual Attention with Transformer U-Net for Medical Image Segmentationcited by 16
  2. 2022Continual Hippocampus Segmentation with Transformerscited by 11
  3. 2024GA-SmaAt-GNet: Generative Adversarial Small Attention GNet for Extreme Precipitation Nowcastingcited by 9
  4. 2024Graph Dual-stream Convolutional Attention Fusion for Precipitation Nowcastingcited by 7
  5. 2023SAR-UNet: Small Attention Residual UNet for Explainable Nowcasting Taskscited by 6
  6. 2024Extreme Precipitation Nowcasting using Transformer-based Generative Modelscited by 6
  7. 2025WaveC2R: Wavelet-Driven Coarse-to-Refined Hierarchical Learning for Radar Retrievalcited by 6
  8. 2023WF-UNet: Weather Fusion UNet for Precipitation Nowcastingcited by 2
  9. 2025SSA-UNet: Advanced Precipitation Nowcasting via Channel Shufflingcited by 2
  10. 2026Probabilistic Precipitation Nowcasting with Rectified Flow Transformerscited by 2
  11. 2023TransCORALNet: A Two-Stream Transformer CORAL Networks for Supply Chain Credit Assessment Cold Startcited by 1
  12. 2024A Mutual Inclusion Mechanism for Precise Boundary Segmentation in Medical Imagescited by 1
10 more
  1. 2024J-CaPA : Joint Channel and Pyramid Attention Improves Medical Image Segmentationcited by 0
  2. 2024Self-supervised Spatial-Temporal Learner for Precipitation Nowcastingcited by 0
  3. 2026MFC-RFNet: A Multi-scale Guided Rectified Flow Network for Radar Sequence Predictioncited by 0
  4. 2026MAD-SmaAt-GNet: A Multimodal Advection-Guided Neural Network for Precipitation Nowcastingcited by 0
  5. 2026SmaAT-QMix-UNet: A Parameter-Efficient Vector-Quantized UNet for Precipitation Nowcastingcited by 0
  6. 2026A Diffusion-Contrastive Graph Neural Network with Virtual Nodes for Wind Nowcasting in Unobserved Regionscited by 0
  7. 2026VMU-Diff: A Coarse-to-fine Multi-source Data Fusion Framework for Precipitation Nowcastingcited by 0
  8. 2026MambaRain: Multi-Scale Mamba-Attention Framework for 0-3 Hour Precipitation Nowcastingcited by 0
  9. 2026Beyond MSE: Improving Precipitation Nowcasting with Multi-Quantile Regressioncited by 0
  10. 2026Temporal Context Conditioning for Seasonality-Aware Precipitation Nowcasting of High-Intensity Rainfallcited by 0