mlsanityData to 14 Oct 2026

ARFA: An Asymmetric Receptive Field Autoencoder Model for Spatiotemporal Prediction

arXiv 2309.00314 ↗First posted 1 Sep 2023cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Spatiotemporal prediction aims to generate future sequences by paradigms learned from historical contexts. It is essential in numerous domains, such as traffic flow prediction and weather forecasting. Recently, research in this field has been predominantly driven by deep neural networks based on autoencoder architectures. However, existing methods commonly adopt autoencoder architectures with identical receptive field sizes. To address this issue, we propose an Asymmetric Receptive Field Autoencoder (ARFA) model, which introduces corresponding sizes of receptive field modules tailored to the distinct functionalities of the encoder and decoder. In the encoder, we present a large kernel module for global spatiotemporal feature extraction. In the decoder, we develop a small kernel module for local spatiotemporal information reconstruction. Experimental results demonstrate that ARFA consistently achieves state-of-the-art performance on popular datasets. Additionally, we construct the RainBench, a large-scale radar echo dataset for precipitation prediction, to address the scarcity of meteorological data in the domain.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 34 of its 55 references that are in the map. First posted on arXiv 1 Sep 2023.

Builds on

34 of 55 references.

References · 34

  1. 2017Attention Is All You Needcited by 60,361
  2. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  3. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
  4. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
  5. 2014Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translationcited by 4,057
  6. 2017MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applicationscited by 3,845
  7. 2022A ConvNet for the 2020scited by 3,579
  8. 2021SwinIR: Image Restoration Using Swin Transformercited by 1,887
  9. 2015Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcastingcited by 1,436
  10. 2021Swin Transformer V2: Scaling Up Capacity and Resolutioncited by 1,228
  11. 2021Video Swin Transformercited by 1,091
  12. 2017Sigmoid-Weighted Linear Units for Neural Network Function Approximation in Reinforcement Learningcited by 950
22 more
  1. 2015Unsupervised Learning of Video Representations using LSTMscited by 435
  2. 2019GMAN: A Graph Multi-Attention Network for Traffic Predictioncited by 434
  3. 2016Unsupervised Learning for Physical Interaction through Video Predictioncited by 260
  4. 2022SegNeXt: Rethinking Convolutional Attention Design for Semantic Segmentationcited by 252
  5. 2022Visual Attention Networkcited by 210
  6. 2017Large Kernel Matters -- Improve Semantic Segmentation by Global Convolutional Networkcited by 208
  7. 2020Disentangling Physical Dynamics from Unknown Factors for Unsupervised Video Predictioncited by 195
  8. 2022SimVP: Simpler yet Better Video Predictioncited by 184
  9. 2017Deep Learning for Precipitation Nowcasting: A Benchmark and A New Modelcited by 182
  10. 2021PredRNN: A Recurrent Neural Network for Spatiotemporal Predictive Learningcited by 182
  11. 2022Scaling Up Your Kernels to 31x31: Revisiting Large Kernel Design in CNNscited by 155
  12. 2022More ConvNets in the 2020s: Scaling up Kernels Beyond 51x51 using Sparsitycited by 142
  13. 2018Revisiting Spatial-Temporal Similarity: A Deep Learning Framework for Traffic Predictioncited by 122
  14. 2018PredRNN++: Towards A Resolution of the Deep-in-Time Dilemma in Spatiotemporal Predictive Learningcited by 122
  15. 2014Video (language) modeling: a baseline for generative models of natural videoscited by 92
  16. 2018Memory In Memory: A Predictive Neural Network for Learning Higher-Order Non-Stationarity from Spatiotemporal Dynamicscited by 92
  17. 2022Conv2Former: A Simple Transformer-Style ConvNet for Visual Recognitioncited by 81
  18. 2022An efficient encoder-decoder architecture with top-down attention for speech separationcited by 38
  19. 2021Speech Separation Using an Asynchronous Fully Recurrent Convolutional Neural Networkcited by 32
  20. 2020Preserving Dynamic Attention for Long-Term Spatial-Temporal Predictioncited by 30
  21. 2023DiffCR: A Fast Conditional Diffusion Framework for Cloud Removal from Optical Satellite Imagescited by 27
  22. 2023PMAA: A Progressive Multi-scale Attention Autoencoder Model for High-performance Cloud Removal from Multi-temporal Satellite Imagerycited by 16

Built on by

Not cited yet.