SFTformer: A Spatial-Frequency-Temporal Correlation-Decoupling Transformer for Radar Echo Extrapolation
Not on the map. Why?
Abstract (arXiv)
Extrapolating future weather radar echoes from past observations is a complex task vital for precipitation nowcasting. The spatial morphology and temporal evolution of radar echoes exhibit a certain degree of correlation, yet they also possess independent characteristics. {Existing methods learn unified spatial and temporal representations in a highly coupled feature space, emphasizing the correlation between spatial and temporal features but neglecting the explicit modeling of their independent characteristics, which may result in mutual interference between them.} To effectively model the spatiotemporal dynamics of radar echoes, we propose a Spatial-Frequency-Temporal correlation-decoupling Transformer (SFTformer). The model leverages stacked multiple SFT-Blocks to not only mine the correlation of the spatiotemporal dynamics of echo cells but also avoid the mutual interference between the temporal modeling and the spatial morphology refinement by decoupling them. Furthermore, inspired by the practice that weather forecast experts effectively review historical echo evolution to make accurate predictions, SFTfomer incorporates a joint training paradigm for historical echo sequence reconstruction and future echo sequence prediction. Experimental results on the HKO-7 dataset and ChinaNorth-2021 dataset demonstrate the superior performance of SFTfomer in short(1h), mid(2h), and long-term(3h) precipitation nowcasting.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 26 of its 45 references that are in the map. First posted on arXiv 28 Feb 2024.
Builds on
26 of 45 references.
References · 26
- 2017Attention Is All You Needcited by 59,932
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
- 2020Longformer: The Long-Document Transformercited by 3,362
- 2020Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecastingcited by 2,141
- 2021Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series Forecastingcited by 1,654
- 2015Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcastingcited by 1,428
- 2022VideoMAE: Masked Autoencoders are Data-Efficient Learners for Self-Supervised Video Pre-Trainingcited by 1,305
- 2022FEDformer: Frequency Enhanced Decomposed Transformer for Long-term Series Forecastingcited by 1,200
- 2015Unsupervised Learning of Video Representations using LSTMscited by 434
- 2017Stochastic Variational Video Predictioncited by 234
- 2019Scaling Autoregressive Video Modelscited by 189
14 more
- 2022Transformer Quality in Linear Timecited by 189
- 2021PredRNN: A Recurrent Neural Network for Spatiotemporal Predictive Learningcited by 181
- 2022SimVP: Simpler yet Better Video Predictioncited by 181
- 2017Deep Learning for Precipitation Nowcasting: A Benchmark and A New Modelcited by 180
- 2019The Evolved Transformercited by 180
- 2018PredRNN++: Towards A Resolution of the Deep-in-Time Dilemma in Spatiotemporal Predictive Learningcited by 122
- 2016Video Pixel Networkscited by 108
- 2020Latent Video Transformercited by 106
- 2014Video (language) modeling: a baseline for generative models of natural videoscited by 92
- 2018Memory In Memory: A Predictive Neural Network for Learning Higher-Order Non-Stationarity from Spatiotemporal Dynamicscited by 91
- 2021MotionRNN: A Flexible Model for Video Prediction with Spacetime-Varying Motionscited by 54
- 2023Elevation Estimation-Driven Building 3D Reconstruction from Single-View Remote Sensing Imagerycited by 17
- 2022Beyond single receptive field: A receptive field fusion-and-stratification network for airborne laser scanning point cloud classificationcited by 16
- 2023Not Just Learning from Others but Relying on Yourself: A New Perspective on Few-Shot Segmentation in Remote Sensingcited by 11
Built on by
Citing papers per year: 2024: 1.
1 paper.