SRVP: Strong Recollection Video Prediction Model Using Attention-Based Spatiotemporal Correlation Fusion
Not on the map. Why?
Abstract (arXiv)
Video prediction (VP) generates future frames by leveraging spatial representations and temporal context from past frames. Traditional recurrent neural network (RNN)-based models enhance memory cell structures to capture spatiotemporal states over extended durations but suffer from gradual loss of object appearance details. To address this issue, we propose the strong recollection VP (SRVP) model, which integrates standard attention (SA) and reinforced feature attention (RFA) modules. Both modules employ scaled dot-product attention to extract temporal context and spatial correlations, which are then fused to enhance spatiotemporal representations. Experiments on three benchmark datasets demonstrate that SRVP mitigates image quality degradation in RNN-based models while achieving predictive performance comparable to RNN-free architectures.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 23 of its 32 references that are in the map. First posted on arXiv 10 Apr 2025.
Builds on
23 of 32 references.
References · 23
- 2017Attention Is All You Needcited by 60,361
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
- 2020End-to-End Object Detection with Transformerscited by 7,414
- 2014Neural Machine Translation by Jointly Learning to Align and Translatecited by 4,548
- 2014Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translationcited by 4,057
- 2014Sequence to Sequence Learning with Neural Networkscited by 2,986
- 2014Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modelingcited by 2,367
- 2015Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcastingcited by 1,436
- 2015Unsupervised Learning of Video Representations using LSTMscited by 435
- 2020Disentangling Physical Dynamics from Unknown Factors for Unsupervised Video Predictioncited by 195
- 2022SimVP: Simpler yet Better Video Predictioncited by 184
- 2021HRFormer: High-Resolution Transformer for Dense Predictioncited by 149
11 more
- 2018PredRNN++: Towards A Resolution of the Deep-in-Time Dilemma in Spatiotemporal Predictive Learningcited by 122
- 2018Memory In Memory: A Predictive Neural Network for Learning Higher-Order Non-Stationarity from Spatiotemporal Dynamicscited by 92
- 2021Space-time Mixing Attention for Video Transformercited by 84
- 2020Convolutional Tensor-Train LSTM for Spatio-temporal Learningcited by 55
- 2021MotionRNN: A Flexible Model for Video Prediction with Spacetime-Varying Motionscited by 54
- 2021Unveiling the Potential of Structure Preserving for Weakly Supervised Object Localizationcited by 46
- 2020ConvTransformer: A Convolutional Transformer Network for Video Frame Synthesiscited by 34
- 2022MIMO Is All You Need : A Strong Multi-In-Multi-Out Baseline for Video Predictioncited by 17
- 2022Dual Prototype Attention for Unsupervised Video Object Segmentationcited by 14
- 2022Video Prediction by Efficient Transformerscited by 12
- 2023Self-Correlation and Cross-Correlation Learning for Few-Shot Remote Sensing Image Semantic Segmentationcited by 3
Built on by
Not cited yet.