mlsanityData to 14 Oct 2026

TempEE: Temporal-Spatial Parallel Transformer for Radar Echo Extrapolation Beyond Auto-Regression

arXiv 2304.14131 ↗First posted 27 Apr 2023eess.SP cs.LGcited by 12

Not on the map. Why?

Abstract (arXiv)

Meteorological radar reflectivity data (i.e. radar echo) significantly influences precipitation prediction. It can facilitate accurate and expeditious forecasting of short-term heavy rainfall bypassing the need for complex Numerical Weather Prediction (NWP) models. In comparison to conventional models, Deep Learning (DL)-based radar echo extrapolation algorithms exhibit higher effectiveness and efficiency. Nevertheless, the development of reliable and generalized echo extrapolation algorithm is impeded by three primary challenges: cumulative error spreading, imprecise representation of sparsely distributed echoes, and inaccurate description of non-stationary motion processes. To tackle these challenges, this paper proposes a novel radar echo extrapolation algorithm called Temporal-Spatial Parallel Transformer, referred to as TempEE. TempEE avoids using auto-regression and instead employs a one-step forward strategy to prevent cumulative error spreading during the extrapolation process. Additionally, we propose the incorporation of a Multi-level Temporal-Spatial Attention mechanism to improve the algorithm's capability of capturing both global and local information while emphasizing task-related regions, including sparse echo representations, in an efficient manner. Furthermore, the algorithm extracts spatio-temporal representations from continuous echo images using a parallel encoder to model the non-stationary motion process for echo extrapolation. The superiority of our TempEE has been demonstrated in the context of the classic radar echo extrapolation task, utilizing a real-world dataset. Extensive experiments have further validated the efficacy and indispensability of various components within TempEE.

Key facts. Cited by 12 papers in the map (data through 14 Oct 2026). Builds on 20 of its 57 references that are in the map. First posted on arXiv 27 Apr 2023.

Builds on

20 of 57 references.

References · 20

  1. 2017Attention Is All You Needcited by 60,361
  2. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  3. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  4. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
  5. 2018CBAM: Convolutional Block Attention Modulecited by 2,477
  6. 2015Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcastingcited by 1,436
  7. 2021Multiscale Vision Transformerscited by 897
  8. 2021Going deeper with Image Transformerscited by 764
  9. 2021DeepViT: Towards Deeper Vision Transformercited by 289
  10. 2021PredRNN: A Recurrent Neural Network for Spatiotemporal Predictive Learningcited by 182
  11. 2020MetNet: A Neural Weather Model for Precipitation Forecastingcited by 131
  12. 2018PredRNN++: Towards A Resolution of the Deep-in-Time Dilemma in Spatiotemporal Predictive Learningcited by 122
8 more
  1. 2018Memory In Memory: A Predictive Neural Network for Learning Higher-Order Non-Stationarity from Spatiotemporal Dynamicscited by 92
  2. 2019Machine Learning for Precipitation Nowcasting from Radar Imagescited by 56
  3. 2023Prompt Federated Learning for Weather Forecasting: Toward Foundation Models on Meteorological Datacited by 40
  4. 2019STConvS2S: Spatiotemporal Convolutional Sequence to Sequence Network for Weather Forecastingcited by 23
  5. 2021MS-nowcasting: Operational Precipitation Nowcasting with Convolutional LSTMs at Microsoft Weathercited by 12
  6. 2022Interpretable CNN-Multilevel Attention Transformer for Rapid Recognition of Pneumonia from Chest X-Ray Imagescited by 8
  7. 2019Convolutional Neural Network for Convective Storm Nowcasting Using 3D Doppler Weather Radar Datacited by 5
  8. 2021CMS-LSTM: Context Embedding and Multi-Scale Spatiotemporal Expression LSTM for Predictive Learningcited by 4

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2023: 3; 2024: 4; 2025: 0; 2026: 5.

12 papers.