mlsanityData to 7 Oct 2026

SimVPv2: Towards Simple yet Powerful Spatiotemporal Predictive Learning

arXiv 2211.12509 ↗First posted 22 Nov 2022cs.LGcited by 20

Not on the map. Why?

Abstract (arXiv)

Recent years have witnessed remarkable advances in spatiotemporal predictive learning, with methods incorporating auxiliary inputs, complex neural architectures, and sophisticated training strategies. While SimVP has introduced a simpler, CNN-based baseline for this task, it still relies on heavy Unet-like architectures for spatial and temporal modeling, which still suffers from high complexity and computational overhead. In this paper, we propose SimVPv2, a streamlined model that eliminates the need for Unet architectures and demonstrates that plain stacks of convolutional layers, enhanced with an efficient Gated Spatiotemporal Attention mechanism, can deliver state-of-the-art performance. SimVPv2 not only simplifies the model architecture but also improves both performance and computational efficiency. On the standard Moving MNIST benchmark, SimVPv2 achieves superior performance compared to SimVP, with fewer FLOPs, about half the training time, and 60% faster inference efficiency. Extensive experiments across eight diverse datasets, including real-world tasks such as traffic forecasting and climate prediction, further demonstrate that SimVPv2 offers a powerful yet straightforward solution, achieving robust generalization across various spatiotemporal learning scenarios. We believe the proposed SimVPv2 can serve as a solid baseline to benefit the spatiotemporal predictive learning community.

Key facts. Cited by 20 papers in the map (data through 7 Oct 2026). Builds on 68 of its 110 references that are in the map. First posted on arXiv 22 Nov 2022.

Builds on

68 of 110 references.

References · 68

  1. 2017Attention Is All You Needcited by 59,932
  2. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  3. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  4. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  5. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
  6. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  7. 2020Training data-efficient image transformers & distillation through attentioncited by 4,560
  8. 2014Going Deeper with Convolutionscited by 4,231
  9. 2022A ConvNet for the 2020scited by 3,545
  10. 2021ViViT: A Video Vision Transformercited by 1,610
  11. 2021Is Space-Time Attention All You Need for Video Understanding?cited by 1,609
  12. 2021MLP-Mixer: An all-MLP Architecture for Visioncited by 1,441
38 more
  1. 2015Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcastingcited by 1,428
  2. 2017Spatio-Temporal Graph Convolutional Networks: A Deep Learning Framework for Traffic Forecastingcited by 1,125
  3. 2021Video Swin Transformercited by 1,090
  4. 2021Multiscale Vision Transformerscited by 896
  5. 2020Adaptive Graph Convolutional Recurrent Network for Traffic Forecastingcited by 525
  6. 2021MetaFormer Is Actually What You Need for Visioncited by 523
  7. 2015Unsupervised Learning of Video Representations using LSTMscited by 434
  8. 2018T-GCN: A Temporal Graph ConvolutionalNetwork for Traffic Predictioncited by 399
  9. 2021Pay Attention to MLPscited by 367
  10. 2016Deep Spatio-Temporal Residual Networks for Citywide Crowd Flows Predictioncited by 330
  11. 2016Dynamic Filter Networkscited by 318
  12. 2015Deep multi-scale video prediction beyond mean square errorcited by 297
  13. 2016Structured Sequence Modeling with Graph Convolutional Recurrent Networkscited by 273
  14. 2020WeatherBench: A benchmark dataset for data-driven weather forecastingcited by 272
  15. 2021Video Transformer Networkcited by 271
  16. 2019RoboNet: Large-Scale Multi-Robot Learningcited by 268
  17. 2016Unsupervised Learning for Physical Interaction through Video Predictioncited by 256
  18. 2018Stochastic Video Generation with a Learned Priorcited by 244
  19. 2017Stochastic Variational Video Predictioncited by 234
  20. 2022Visual Attention Networkcited by 210
  21. 2017Video Frame Synthesis using Deep Voxel Flowcited by 209
  22. 2016Deep Predictive Coding Networks for Video Prediction and Unsupervised Learningcited by 203
  23. 2022Patches Are All You Need?cited by 201
  24. 2020Disentangling Physical Dynamics from Unknown Factors for Unsupervised Video Predictioncited by 192
  25. 2019Scaling Autoregressive Video Modelscited by 189
  26. 2021PredRNN: A Recurrent Neural Network for Spatiotemporal Predictive Learningcited by 181
  27. 2022SimVP: Simpler yet Better Video Predictioncited by 181
  28. 2018Stochastic Adversarial Video Predictioncited by 173
  29. 2017Decomposing Motion and Content for Natural Video Sequence Predictioncited by 168
  30. 2022Scaling Up Your Kernels to 31x31: Revisiting Large Kernel Design in CNNscited by 155
  31. 2017Unsupervised Learning of Disentangled Representations from Videocited by 138
  32. 2018PredRNN++: Towards A Resolution of the Deep-in-Time Dilemma in Spatiotemporal Predictive Learningcited by 122
  33. 2018Learning to Decompose and Disentangle Representations for Video Predictioncited by 120
  34. 2020A Review on Deep Learning Techniques for Video Predictioncited by 114
  35. 2016Video Pixel Networkscited by 108
  36. 2020Latent Video Transformercited by 106
  37. 2019Improved Conditional VRNNs for Video Predictioncited by 104
  38. 2018Memory In Memory: A Predictive Neural Network for Learning Higher-Order Non-Stationarity from Spatiotemporal Dynamicscited by 91

50 most cited of 68 All 68 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 1; 2025: 8; 2026: 11.

20 papers.

Sort:

By area:

  1. 2025FlowCast: Advancing Precipitation Nowcasting with Conditional Flow Matchingcited by 6
  2. 2024VegeDiff: Latent Diffusion Model for Geospatial Vegetation Forecastingcited by 4
  3. 2025ResearchPulse: Building Method-Experiment Chains through Multi-Document Scientific Inferencecited by 2
  4. 2025SimCast: Enhancing Precipitation Nowcasting with Short-to-Long Term Knowledge Distillationcited by 2
  5. 2025UniTS: Unified Spatio-Temporal Generative Model for Remote Sensingcited by 2
  6. 2026Fully Convolutional Spatiotemporal Learning for Microstructure Evolution Predictioncited by 2
  7. 2025USF-Net: A Unified Spatiotemporal Fusion Network for Ground-Based Remote Sensing Cloud Image Sequence Extrapolationcited by 1
  8. 2026PnP-Corrector: A Universal Correction Framework for Coupled Spatiotemporal Forecastingcited by 1
  9. 2026Physics-Guided Fully Convolutional Spatiotemporal Learning Toward Digital-Twin-Enabled Microstructure Evolution Predictioncited by 1
  10. 2026RainODE: Continuous-Time Precipitation Forecasting with Latent Neural ODEscited by 1
  11. 2025Deformable Dynamic Convolution for Accurate yet Efficient Spatio-Temporal Traffic Predictioncited by 0
  12. 2025VISION: Prompting Ocean Vertical Velocity Reconstruction from Incomplete Observationscited by 0
8 more
  1. 2025SSTODE: Ocean-Atmosphere Physics-Informed Neural ODEs for Sea Surface Temperature Predictioncited by 0
  2. 2026PFGNet: A Fully Convolutional Frequency-Guided Peripheral Gating Network for Efficient Spatiotemporal Predictive Learningcited by 0
  3. 2026Extending Precipitation Nowcasting Horizons via Spectral Fusion of Radar Observations and Foundation Model Priorscited by 0
  4. 2026WaveSFNet: A Wavelet-Based Codec and Spatial--Frequency Dual-Domain Gating Network for Spatiotemporal Predictioncited by 0
  5. 2026Hybrid Quantum-Classical Spatiotemporal Forecasting for 3D Cloud Fieldscited by 0
  6. 2026What Will This Copper Look Like Later? Forecasting Surface Appearance and Rendering It as a PBR Materialcited by 0
  7. 2026MinkowskiPE: Minkowski Positional Encoding for Spatiotemporal Perceptioncited by 0
  8. 2026Efficient and Scalable Physics-Guided Fully Convolutional Spatiotemporal Learning for 3D Microstructure Evolution Predictioncited by 0