TempEE: Temporal-Spatial Parallel Transformer for Radar Echo Extrapolation Beyond Auto-Regression
Not on the map. Why?
Abstract (arXiv)
Meteorological radar reflectivity data (i.e. radar echo) significantly influences precipitation prediction. It can facilitate accurate and expeditious forecasting of short-term heavy rainfall bypassing the need for complex Numerical Weather Prediction (NWP) models. In comparison to conventional models, Deep Learning (DL)-based radar echo extrapolation algorithms exhibit higher effectiveness and efficiency. Nevertheless, the development of reliable and generalized echo extrapolation algorithm is impeded by three primary challenges: cumulative error spreading, imprecise representation of sparsely distributed echoes, and inaccurate description of non-stationary motion processes. To tackle these challenges, this paper proposes a novel radar echo extrapolation algorithm called Temporal-Spatial Parallel Transformer, referred to as TempEE. TempEE avoids using auto-regression and instead employs a one-step forward strategy to prevent cumulative error spreading during the extrapolation process. Additionally, we propose the incorporation of a Multi-level Temporal-Spatial Attention mechanism to improve the algorithm's capability of capturing both global and local information while emphasizing task-related regions, including sparse echo representations, in an efficient manner. Furthermore, the algorithm extracts spatio-temporal representations from continuous echo images using a parallel encoder to model the non-stationary motion process for echo extrapolation. The superiority of our TempEE has been demonstrated in the context of the classic radar echo extrapolation task, utilizing a real-world dataset. Extensive experiments have further validated the efficacy and indispensability of various components within TempEE.
Key facts. Cited by 12 papers in the map (data through 14 Oct 2026). Builds on 20 of its 57 references that are in the map. First posted on arXiv 27 Apr 2023.
Builds on
20 of 57 references.
References · 20
- 2017Attention Is All You Needcited by 60,361
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2018CBAM: Convolutional Block Attention Modulecited by 2,477
- 2015Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcastingcited by 1,436
- 2021Multiscale Vision Transformerscited by 897
- 2021Going deeper with Image Transformerscited by 764
- 2021DeepViT: Towards Deeper Vision Transformercited by 289
- 2021PredRNN: A Recurrent Neural Network for Spatiotemporal Predictive Learningcited by 182
- 2020MetNet: A Neural Weather Model for Precipitation Forecastingcited by 131
- 2018PredRNN++: Towards A Resolution of the Deep-in-Time Dilemma in Spatiotemporal Predictive Learningcited by 122
8 more
- 2018Memory In Memory: A Predictive Neural Network for Learning Higher-Order Non-Stationarity from Spatiotemporal Dynamicscited by 92
- 2019Machine Learning for Precipitation Nowcasting from Radar Imagescited by 56
- 2023Prompt Federated Learning for Weather Forecasting: Toward Foundation Models on Meteorological Datacited by 40
- 2019STConvS2S: Spatiotemporal Convolutional Sequence to Sequence Network for Weather Forecastingcited by 23
- 2021MS-nowcasting: Operational Precipitation Nowcasting with Convolutional LSTMs at Microsoft Weathercited by 12
- 2022Interpretable CNN-Multilevel Attention Transformer for Rapid Recognition of Pneumonia from Chest X-Ray Imagescited by 8
- 2019Convolutional Neural Network for Convective Storm Nowcasting Using 3D Doppler Weather Radar Datacited by 5
- 2021CMS-LSTM: Context Embedding and Multi-Scale Spatiotemporal Expression LSTM for Predictive Learningcited by 4
Built on by
Citing papers per year: 2023: 3; 2024: 4; 2025: 0; 2026: 5.
12 papers.
- 2023Foundation Models for Weather and Climate Data Understanding: A Comprehensive Surveycited by 34
- 2023Federated Prompt Learning for Weather Foundation Models on Devicescited by 17
- 2024Personalized Adapter for Large Meteorology Model on Devices: Towards Weather Foundation Modelscited by 15
- 2023MASK-CNN-Transformer For Real-Time Multi-Label Weather Recognitioncited by 8
- 2024Free Lunch for Federated Remote Sensing Target Fine-Grained Classification: A Parameter-Efficient Frameworkcited by 6
- 2024Federated Distillation for Medical Image Classification: Towards Trustworthy Computer-Aided Diagnosiscited by 4
- 2026Spectral-Aware Text-to-Time Series Generation with Billion-Scale Multimodal Meteorological Datacited by 1
- 2024Less is more: Ensemble Learning for Retinal Disease Recognition Under Limited Resourcescited by 0
- 2026REE-TTT: Highly Adaptive Radar Echo Extrapolation Based on Test-Time Trainingcited by 0
- 2026Optimizing Multi-Agent Weather Captioning via Text Gradient Descent: A Training-Free Approach with Consensus-Aware Gradient Fusioncited by 0
- 2026FreCast: Refining Radar Echo Intensity via Phase-Preserving Amplitude Residual Diffusion for Precipitation Nowcastingcited by 0
- 2026Copy What Is Seen, Generate What Is Not: Training-Free Anomaly-Aware Video Restorationcited by 0
- 2026Copy What Is Seen, Generate What Is Not: Training-Free Anomaly-Aware Video Restoration16 Sep 2026
- 2026FreCast: Refining Radar Echo Intensity via Phase-Preserving Amplitude Residual Diffusion for Precipitation Nowcasting9 Aug 2026
- 2026Spectral-Aware Text-to-Time Series Generation with Billion-Scale Multimodal Meteorological Data28 Mar 2026
- 2026Optimizing Multi-Agent Weather Captioning via Text Gradient Descent: A Training-Free Approach with Consensus-Aware Gradient Fusion23 Mar 2026
- 2026REE-TTT: Highly Adaptive Radar Echo Extrapolation Based on Test-Time Training4 Jan 2026
- 2024Federated Distillation for Medical Image Classification: Towards Trustworthy Computer-Aided Diagnosis2 Jul 2024
- 2024Personalized Adapter for Large Meteorology Model on Devices: Towards Weather Foundation Models24 May 2024
- 2024Less is more: Ensemble Learning for Retinal Disease Recognition Under Limited Resources15 Feb 2024
- 2024Free Lunch for Federated Remote Sensing Target Fine-Grained Classification: A Parameter-Efficient Framework3 Jan 2024
- 2023Foundation Models for Weather and Climate Data Understanding: A Comprehensive Survey5 Dec 2023
- 2023Federated Prompt Learning for Weather Foundation Models on Devices23 May 2023
- 2023MASK-CNN-Transformer For Real-Time Multi-Label Weather Recognition28 Apr 2023