mlsanityData to 7 Oct 2026

GMG: A Video Prediction Method Based on Global Focus and Motion Guided

arXiv 2503.11297 ↗First posted 14 Mar 2025cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Recent years, weather forecasting has gained significant attention. However, accurately predicting weather remains a challenge due to the rapid variability of meteorological data and potential teleconnections. Current spatiotemporal forecasting models primarily rely on convolution operations or sliding windows for feature extraction. These methods are limited by the size of the convolutional kernel or sliding window, making it difficult to capture and identify potential teleconnection features in meteorological data. Additionally, weather data often involve non-rigid bodies, whose motion processes are accompanied by unpredictable deformations, further complicating the forecasting task. In this paper, we propose the GMG model to address these two core challenges. The Global Focus Module, a key component of our model, enhances the global receptive field, while the Motion Guided Module adapts to the growth or dissipation processes of non-rigid bodies. Through extensive evaluations, our method demonstrates competitive performance across various complex tasks, providing a novel approach to improving the predictive accuracy of complex spatiotemporal data.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 22 of its 39 references that are in the map. First posted on arXiv 14 Mar 2025.

Builds on

22 of 39 references.

References · 22

  1. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  2. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
  3. 2016Xception: Deep Learning with Depthwise Separable Convolutionscited by 2,320
  4. 2017Deformable Convolutional Networkscited by 1,481
  5. 2015Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcastingcited by 1,428
  6. 2015Unsupervised Learning of Video Representations using LSTMscited by 434
  7. 2016Deep Spatio-Temporal Residual Networks for Citywide Crowd Flows Predictioncited by 330
  8. 2021Skillful Precipitation Nowcasting using Deep Generative Models of Radarcited by 308
  9. 2020WeatherBench: A benchmark dataset for data-driven weather forecastingcited by 272
  10. 2020Disentangling Physical Dynamics from Unknown Factors for Unsupervised Video Predictioncited by 192
  11. 2021PredRNN: A Recurrent Neural Network for Spatiotemporal Predictive Learningcited by 181
  12. 2022SimVP: Simpler yet Better Video Predictioncited by 181
10 more
  1. 2018PredRNN++: Towards A Resolution of the Deep-in-Time Dilemma in Spatiotemporal Predictive Learningcited by 122
  2. 2018Memory In Memory: A Predictive Neural Network for Learning Higher-Order Non-Stationarity from Spatiotemporal Dynamicscited by 91
  3. 2022Temporal Attention Unit: Towards Efficient Spatiotemporal Predictive Learningcited by 84
  4. 2021MotionRNN: A Flexible Model for Video Prediction with Spacetime-Varying Motionscited by 54
  5. 2023OpenSTL: A Comprehensive Benchmark of Spatio-Temporal Predictive Learningcited by 53
  6. 2024VMRNN: Integrating Vision Mamba and LSTM for Efficient and Accurate Spatiotemporal Forecastingcited by 35
  7. 2023SwinLSTM:Improving Spatiotemporal Prediction Accuracy using Swin Transformer and LSTMcited by 32
  8. 2023MMVP: Motion-Matrix-based Video Predictioncited by 18
  9. 2024Video Prediction Transformers without Recurrence or Convolutioncited by 6
  10. 2024Machine Learning for the Digital Typhoon Dataset: Extensions to Multiple Basins and New Developments in Representations and Taskscited by 3

Built on by

Not cited yet.