mlsanityData to 7 Oct 2026

Anti-aliasing Predictive Coding Network for Future Video Frame Prediction

arXiv 2301.05421 ↗First posted 13 Jan 2023cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

We introduce here a predictive coding based model that aims to generate accurate and sharp future frames. Inspired by the predictive coding hypothesis and related works, the total model is updated through a combination of bottom-up and top-down information flows, which can enhance the interaction between different network levels. Most importantly, We propose and improve several artifacts to ensure that the neural networks generate clear and natural frames. Different inputs are no longer simply concatenated or added, they are calculated in a modulated manner to avoid being roughly fused. The downsampling and upsampling modules have been redesigned to ensure that the network can more easily construct images from Fourier features of low-frequency inputs. Additionally, the training strategies are also explored and improved to generate believable results and alleviate inconsistency between the input predicted frames and ground truth. Our proposals achieve results that better balance pixel accuracy and visualization effect.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 37 of its 58 references that are in the map. First posted on arXiv 13 Jan 2023.

Builds on

37 of 58 references.

References · 37

  1. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  2. 2015Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classificationcited by 3,590
  3. 2015Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcastingcited by 1,428
  4. 2021Alias-Free Generative Adversarial Networkscited by 1,181
  5. 2018Video-to-Video Synthesiscited by 388
  6. 2015A Recurrent Latent Variable Model for Sequential Datacited by 362
  7. 2019Frequency Principle: Fourier Analysis Sheds Light on Deep Neural Networkscited by 360
  8. 2016Deep Visual Foresight for Planning Robot Motioncited by 276
  9. 2017Stochastic Variational Video Predictioncited by 234
  10. 2017Video Frame Synthesis using Deep Voxel Flowcited by 209
  11. 2016Deep Predictive Coding Networks for Video Prediction and Unsupervised Learningcited by 203
  12. 2022SimVP: Simpler yet Better Video Predictioncited by 181
25 more
  1. 2017Deep Learning for Precipitation Nowcasting: A Benchmark and A New Modelcited by 180
  2. 2019Video Representation Learning by Dense Predictive Codingcited by 175
  3. 2018Training behavior of deep neural network in frequency domaincited by 174
  4. 2018Stochastic Adversarial Video Predictioncited by 173
  5. 2017Decomposing Motion and Content for Natural Video Sequence Predictioncited by 168
  6. 2020Self-supervised Video Representation Learning by Pace Predictioncited by 139
  7. 2018PredRNN++: Towards A Resolution of the Deep-in-Time Dilemma in Spatiotemporal Predictive Learningcited by 122
  8. 2019Improved Conditional VRNNs for Video Predictioncited by 104
  9. 2022Temporal Attention Unit: Towards Efficient Spatiotemporal Predictive Learningcited by 84
  10. 2021Greedy Hierarchical Variational Autoencoders for Large-Scale Video Predictioncited by 75
  11. 2021Video Prediction Recalling Long-term Motion Context via Memory Alignment Learningcited by 62
  12. 2020Delving Deeper into Anti-aliasing in ConvNetscited by 60
  13. 2020Future Video Synthesis with Object Motion Predictioncited by 57
  14. 2020Convolutional Tensor-Train LSTM for Spatio-temporal Learningcited by 54
  15. 2020Exploring Spatial-Temporal Multi-Frequency Analysis for High-Fidelity and Temporal-Consistency Video Predictioncited by 52
  16. 2017Folded Recurrent Neural Networks for Future Video Predictioncited by 44
  17. 2022STRPM: A Spatiotemporal Residual Predictive Model for High-Resolution Video Predictioncited by 31
  18. 2022Optimizing Video Prediction via Video Frame Interpolationcited by 28
  19. 2021Impact of Aliasing on Generalization in Deep Convolutional Networkscited by 25
  20. 2022Video Prediction by Efficient Transformerscited by 12
  21. 2021Future Frame Prediction for Robot-assisted Surgerycited by 11
  22. 2020PreCNet: Next-Frame Video Prediction Based on Predictive Codingcited by 5
  23. 2020A Log-likelihood Regularized KL Divergence for Video Prediction with A 3D Convolutional Variational Recurrent Networkcited by 3
  24. 2022Pyramidal Predictive Network: A Model for Visual-frame Prediction Based on Predictive Coding Theorycited by 2
  25. 2022Predictive Coding Based Multiscale Network with Encoder-Decoder LSTM for Video Predictioncited by 2

Built on by

Not cited yet.