SimVPv2: Towards Simple yet Powerful Spatiotemporal Predictive Learning
Not on the map. Why?
Abstract (arXiv)
Recent years have witnessed remarkable advances in spatiotemporal predictive learning, with methods incorporating auxiliary inputs, complex neural architectures, and sophisticated training strategies. While SimVP has introduced a simpler, CNN-based baseline for this task, it still relies on heavy Unet-like architectures for spatial and temporal modeling, which still suffers from high complexity and computational overhead. In this paper, we propose SimVPv2, a streamlined model that eliminates the need for Unet architectures and demonstrates that plain stacks of convolutional layers, enhanced with an efficient Gated Spatiotemporal Attention mechanism, can deliver state-of-the-art performance. SimVPv2 not only simplifies the model architecture but also improves both performance and computational efficiency. On the standard Moving MNIST benchmark, SimVPv2 achieves superior performance compared to SimVP, with fewer FLOPs, about half the training time, and 60% faster inference efficiency. Extensive experiments across eight diverse datasets, including real-world tasks such as traffic forecasting and climate prediction, further demonstrate that SimVPv2 offers a powerful yet straightforward solution, achieving robust generalization across various spatiotemporal learning scenarios. We believe the proposed SimVPv2 can serve as a solid baseline to benefit the spatiotemporal predictive learning community.
Key facts. Cited by 20 papers in the map (data through 7 Oct 2026). Builds on 68 of its 110 references that are in the map. First posted on arXiv 22 Nov 2022.
Builds on
68 of 110 references.
References · 68
- 2017Attention Is All You Needcited by 59,932
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2020Training data-efficient image transformers & distillation through attentioncited by 4,560
- 2014Going Deeper with Convolutionscited by 4,231
- 2022A ConvNet for the 2020scited by 3,545
- 2021ViViT: A Video Vision Transformercited by 1,610
- 2021Is Space-Time Attention All You Need for Video Understanding?cited by 1,609
- 2021MLP-Mixer: An all-MLP Architecture for Visioncited by 1,441
38 more
- 2015Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcastingcited by 1,428
- 2017Spatio-Temporal Graph Convolutional Networks: A Deep Learning Framework for Traffic Forecastingcited by 1,125
- 2021Video Swin Transformercited by 1,090
- 2021Multiscale Vision Transformerscited by 896
- 2020Adaptive Graph Convolutional Recurrent Network for Traffic Forecastingcited by 525
- 2021MetaFormer Is Actually What You Need for Visioncited by 523
- 2015Unsupervised Learning of Video Representations using LSTMscited by 434
- 2018T-GCN: A Temporal Graph ConvolutionalNetwork for Traffic Predictioncited by 399
- 2021Pay Attention to MLPscited by 367
- 2016Deep Spatio-Temporal Residual Networks for Citywide Crowd Flows Predictioncited by 330
- 2016Dynamic Filter Networkscited by 318
- 2015Deep multi-scale video prediction beyond mean square errorcited by 297
- 2016Structured Sequence Modeling with Graph Convolutional Recurrent Networkscited by 273
- 2020WeatherBench: A benchmark dataset for data-driven weather forecastingcited by 272
- 2021Video Transformer Networkcited by 271
- 2019RoboNet: Large-Scale Multi-Robot Learningcited by 268
- 2016Unsupervised Learning for Physical Interaction through Video Predictioncited by 256
- 2018Stochastic Video Generation with a Learned Priorcited by 244
- 2017Stochastic Variational Video Predictioncited by 234
- 2022Visual Attention Networkcited by 210
- 2017Video Frame Synthesis using Deep Voxel Flowcited by 209
- 2016Deep Predictive Coding Networks for Video Prediction and Unsupervised Learningcited by 203
- 2022Patches Are All You Need?cited by 201
- 2020Disentangling Physical Dynamics from Unknown Factors for Unsupervised Video Predictioncited by 192
- 2019Scaling Autoregressive Video Modelscited by 189
- 2021PredRNN: A Recurrent Neural Network for Spatiotemporal Predictive Learningcited by 181
- 2022SimVP: Simpler yet Better Video Predictioncited by 181
- 2018Stochastic Adversarial Video Predictioncited by 173
- 2017Decomposing Motion and Content for Natural Video Sequence Predictioncited by 168
- 2022Scaling Up Your Kernels to 31x31: Revisiting Large Kernel Design in CNNscited by 155
- 2017Unsupervised Learning of Disentangled Representations from Videocited by 138
- 2018PredRNN++: Towards A Resolution of the Deep-in-Time Dilemma in Spatiotemporal Predictive Learningcited by 122
- 2018Learning to Decompose and Disentangle Representations for Video Predictioncited by 120
- 2020A Review on Deep Learning Techniques for Video Predictioncited by 114
- 2016Video Pixel Networkscited by 108
- 2020Latent Video Transformercited by 106
- 2019Improved Conditional VRNNs for Video Predictioncited by 104
- 2018Memory In Memory: A Predictive Neural Network for Learning Higher-Order Non-Stationarity from Spatiotemporal Dynamicscited by 91
50 most cited of 68 All 68 (JSON)
Built on by
Citing papers per year: 2024: 1; 2025: 8; 2026: 11.
20 papers.
Sort:
By area:
- 2025FlowCast: Advancing Precipitation Nowcasting with Conditional Flow Matchingcited by 6
- 2024VegeDiff: Latent Diffusion Model for Geospatial Vegetation Forecastingcited by 4
- 2025ResearchPulse: Building Method-Experiment Chains through Multi-Document Scientific Inferencecited by 2
- 2025SimCast: Enhancing Precipitation Nowcasting with Short-to-Long Term Knowledge Distillationcited by 2
- 2025UniTS: Unified Spatio-Temporal Generative Model for Remote Sensingcited by 2
- 2026Fully Convolutional Spatiotemporal Learning for Microstructure Evolution Predictioncited by 2
- 2025USF-Net: A Unified Spatiotemporal Fusion Network for Ground-Based Remote Sensing Cloud Image Sequence Extrapolationcited by 1
- 2026PnP-Corrector: A Universal Correction Framework for Coupled Spatiotemporal Forecastingcited by 1
- 2026Physics-Guided Fully Convolutional Spatiotemporal Learning Toward Digital-Twin-Enabled Microstructure Evolution Predictioncited by 1
- 2026RainODE: Continuous-Time Precipitation Forecasting with Latent Neural ODEscited by 1
- 2025Deformable Dynamic Convolution for Accurate yet Efficient Spatio-Temporal Traffic Predictioncited by 0
- 2025VISION: Prompting Ocean Vertical Velocity Reconstruction from Incomplete Observationscited by 0
8 more
- 2025SSTODE: Ocean-Atmosphere Physics-Informed Neural ODEs for Sea Surface Temperature Predictioncited by 0
- 2026PFGNet: A Fully Convolutional Frequency-Guided Peripheral Gating Network for Efficient Spatiotemporal Predictive Learningcited by 0
- 2026Extending Precipitation Nowcasting Horizons via Spectral Fusion of Radar Observations and Foundation Model Priorscited by 0
- 2026WaveSFNet: A Wavelet-Based Codec and Spatial--Frequency Dual-Domain Gating Network for Spatiotemporal Predictioncited by 0
- 2026Hybrid Quantum-Classical Spatiotemporal Forecasting for 3D Cloud Fieldscited by 0
- 2026What Will This Copper Look Like Later? Forecasting Surface Appearance and Rendering It as a PBR Materialcited by 0
- 2026MinkowskiPE: Minkowski Positional Encoding for Spatiotemporal Perceptioncited by 0
- 2026Efficient and Scalable Physics-Guided Fully Convolutional Spatiotemporal Learning for 3D Microstructure Evolution Predictioncited by 0
- 2026Efficient and Scalable Physics-Guided Fully Convolutional Spatiotemporal Learning for 3D Microstructure Evolution Prediction29 Sep 2026
- 2026MinkowskiPE: Minkowski Positional Encoding for Spatiotemporal Perception27 Sep 2026
- 2026What Will This Copper Look Like Later? Forecasting Surface Appearance and Rendering It as a PBR Material28 Aug 2026
- 2026RainODE: Continuous-Time Precipitation Forecasting with Latent Neural ODEs29 Jun 2026
- 2026Physics-Guided Fully Convolutional Spatiotemporal Learning Toward Digital-Twin-Enabled Microstructure Evolution Prediction18 Jun 2026
- 2026PnP-Corrector: A Universal Correction Framework for Coupled Spatiotemporal Forecasting9 May 2026
- 2026Hybrid Quantum-Classical Spatiotemporal Forecasting for 3D Cloud Fields31 Mar 2026
- 2026WaveSFNet: A Wavelet-Based Codec and Spatial--Frequency Dual-Domain Gating Network for Spatiotemporal Prediction24 Mar 2026
- 2026Extending Precipitation Nowcasting Horizons via Spectral Fusion of Radar Observations and Foundation Model Priors23 Mar 2026
- 2026PFGNet: A Fully Convolutional Frequency-Guided Peripheral Gating Network for Efficient Spatiotemporal Predictive Learning24 Feb 2026
- 2026Fully Convolutional Spatiotemporal Learning for Microstructure Evolution Prediction23 Feb 2026
- 2025UniTS: Unified Spatio-Temporal Generative Model for Remote Sensing4 Dec 2025
8 more
- 2025FlowCast: Advancing Precipitation Nowcasting with Conditional Flow Matching12 Nov 2025
- 2025USF-Net: A Unified Spatiotemporal Fusion Network for Ground-Based Remote Sensing Cloud Image Sequence Extrapolation12 Nov 2025
- 2025SSTODE: Ocean-Atmosphere Physics-Informed Neural ODEs for Sea Surface Temperature Prediction7 Nov 2025
- 2025SimCast: Enhancing Precipitation Nowcasting with Short-to-Long Term Knowledge Distillation9 Oct 2025
- 2025VISION: Prompting Ocean Vertical Velocity Reconstruction from Incomplete Observations25 Sep 2025
- 2025ResearchPulse: Building Method-Experiment Chains through Multi-Document Scientific Inference3 Sep 2025
- 2025Deformable Dynamic Convolution for Accurate yet Efficient Spatio-Temporal Traffic Prediction13 Jul 2025
- 2024VegeDiff: Latent Diffusion Model for Geospatial Vegetation Forecasting17 Jul 2024
- 2025ResearchPulse: Building Method-Experiment Chains through Multi-Document Scientific Inferencecited by 2
- 2025SimCast: Enhancing Precipitation Nowcasting with Short-to-Long Term Knowledge Distillationcited by 2
- 2026Fully Convolutional Spatiotemporal Learning for Microstructure Evolution Predictioncited by 2
- 2025USF-Net: A Unified Spatiotemporal Fusion Network for Ground-Based Remote Sensing Cloud Image Sequence Extrapolationcited by 1
- 2026PnP-Corrector: A Universal Correction Framework for Coupled Spatiotemporal Forecastingcited by 1
- 2026Physics-Guided Fully Convolutional Spatiotemporal Learning Toward Digital-Twin-Enabled Microstructure Evolution Predictioncited by 1
- 2026RainODE: Continuous-Time Precipitation Forecasting with Latent Neural ODEscited by 1
- 2025Deformable Dynamic Convolution for Accurate yet Efficient Spatio-Temporal Traffic Predictioncited by 0
- 2025VISION: Prompting Ocean Vertical Velocity Reconstruction from Incomplete Observationscited by 0
- 2025SSTODE: Ocean-Atmosphere Physics-Informed Neural ODEs for Sea Surface Temperature Predictioncited by 0
- 2026PFGNet: A Fully Convolutional Frequency-Guided Peripheral Gating Network for Efficient Spatiotemporal Predictive Learningcited by 0
- 2026Extending Precipitation Nowcasting Horizons via Spectral Fusion of Radar Observations and Foundation Model Priorscited by 0
12 most cited of 17 All 17 (JSON)
- 2026Efficient and Scalable Physics-Guided Fully Convolutional Spatiotemporal Learning for 3D Microstructure Evolution Prediction29 Sep 2026
- 2026MinkowskiPE: Minkowski Positional Encoding for Spatiotemporal Perception27 Sep 2026
- 2026What Will This Copper Look Like Later? Forecasting Surface Appearance and Rendering It as a PBR Material28 Aug 2026
- 2026RainODE: Continuous-Time Precipitation Forecasting with Latent Neural ODEs29 Jun 2026
- 2026Physics-Guided Fully Convolutional Spatiotemporal Learning Toward Digital-Twin-Enabled Microstructure Evolution Prediction18 Jun 2026
- 2026PnP-Corrector: A Universal Correction Framework for Coupled Spatiotemporal Forecasting9 May 2026
- 2026Hybrid Quantum-Classical Spatiotemporal Forecasting for 3D Cloud Fields31 Mar 2026
- 2026WaveSFNet: A Wavelet-Based Codec and Spatial--Frequency Dual-Domain Gating Network for Spatiotemporal Prediction24 Mar 2026
- 2026Extending Precipitation Nowcasting Horizons via Spectral Fusion of Radar Observations and Foundation Model Priors23 Mar 2026
- 2026PFGNet: A Fully Convolutional Frequency-Guided Peripheral Gating Network for Efficient Spatiotemporal Predictive Learning24 Feb 2026
- 2026Fully Convolutional Spatiotemporal Learning for Microstructure Evolution Prediction23 Feb 2026
- 2025USF-Net: A Unified Spatiotemporal Fusion Network for Ground-Based Remote Sensing Cloud Image Sequence Extrapolation12 Nov 2025
12 newest of 17 All 17 (JSON)