mlsanityData to 14 Oct 2026

Convolutional Neural Generative Coding: Scaling Predictive Coding to Natural Images

arXiv 2211.12047 ↗First posted 22 Nov 2022cs.CV cs.LGcited by 10

Not on the map. Why?

Abstract (arXiv)

In this work, we develop convolutional neural generative coding (Conv-NGC), a generalization of predictive coding to the case of convolution/deconvolution-based computation. Specifically, we concretely implement a flexible neurobiologically-motivated algorithm that progressively refines latent state feature maps in order to dynamically form a more accurate internal representation/reconstruction model of natural images. The performance of the resulting sensory processing system is evaluated on complex datasets such as Color-MNIST, CIFAR-10, and Street House View Numbers (SVHN). We study the effectiveness of our brain-inspired model on the tasks of reconstruction and image denoising and find that it is competitive with convolutional auto-encoding systems trained by backpropagation of errors and outperforms them with respect to out-of-distribution reconstruction (including the full 90k CINIC-10 test set).

Key facts. Cited by 10 papers in the map (data through 14 Oct 2026). Builds on 27 of its 69 references that are in the map. First posted on arXiv 22 Nov 2022.

Builds on

27 of 69 references.

References · 27

  1. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  2. 2020Language Models are Few-Shot Learnerscited by 32,419
  3. 2018Representation Learning with Contrastive Predictive Codingcited by 7,777
  4. 2015Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classificationcited by 3,611
  5. 2021Carbon Emissions and Large Neural Network Trainingcited by 567
  6. 2016Equilibrium Propagation: Bridging the Gap Between Energy-Based Models and Backpropagationcited by 259
  7. 2016Direct Feedback Alignment Provides Learning in Deep Neural Networkscited by 240
  8. 2016Deep Predictive Coding Networks for Video Prediction and Unsupervised Learningcited by 204
  9. 2014Difference Target Propagationcited by 148
  10. 2016Decoupled Neural Interfaces using Synthetic Gradientscited by 137
  11. 2020Training End-to-End Analog Neural Networks with Equilibrium Propagationcited by 63
  12. 2014Random feedback weights support learning in deep neural networkscited by 47
15 more
  1. 2020The Neural Coding Framework for Learning Generative Modelscited by 44
  2. 2021Associative Memories via Predictive Codingcited by 44
  3. 2018Biologically Motivated Algorithms for Propagating Local Target Representationscited by 43
  4. 2020Learning to Combine Top-Down and Bottom-Up Signals in Recurrent Neural Networks with Attention over Modulescited by 38
  5. 2018Deep Predictive Coding Network with Local Recurrent Processing for Object Recognitioncited by 25
  6. 2018Deep Predictive Coding Network for Object Recognitioncited by 23
  7. 2021Reverse Differentiation via Predictive Codingcited by 23
  8. 2021Predify: Augmenting deep neural networks with brain-inspired predictive coding dynamicscited by 19
  9. 2019Spiking Neural Predictive Coding for Continual Learning from Data Streamscited by 17
  10. 2013Deep Predictive Coding Networkscited by 13
  11. 2017Learning to Adapt by Minimizing Discrepancycited by 12
  12. 2014Kickback cuts Backprop's red-tape: Biologically plausible credit assignment in neural networkscited by 11
  13. 2022Active Predictive Coding Networks: A Neural Solution to the Problem of Learning Reference Frames and Part-Whole Hierarchiescited by 6
  14. 2016Exploiting Spatio-Temporal Structure with Recurrent Winner-Take-All Networkscited by 3
  15. 2022An Empirical Analysis of Recurrent Learning Algorithms In Neural Lossy Image Compression Systemscited by 2

Built on by

Cited by year

Citing papers per year: 2023: 5; 2024: 2; 2025: 3.

10 papers.

  1. 2023Brain-inspired Computational Intelligence via Predictive Codingcited by 30
  2. 2023Brain-Inspired Machine Intelligence: A Survey of Neurobiologically-Plausible Credit Assignmentcited by 15
  3. 2023Forward Learning with Top-Down Feedback: Empirical and Analytical Characterizationcited by 13
  4. 2024Predictive Coding Networks and Inference Learning: Tutorial and Surveycited by 7
  5. 2023Active Sensing with Predictive Coding and Uncertainty Minimizationcited by 5
  6. 2024Divide-and-Conquer Predictive Coding: a structured Bayesian inference algorithmcited by 3
  7. 2023Deep Predictive Coding with Bi-directional Propagation for Classification and Reconstructioncited by 1
  8. 2025Bridging Predictive Coding and MDL: A Two-Part Code Framework for Deep Learningcited by 1
  9. 2025Meta-Representational Predictive Coding: Neuroscience-Informed Self-Supervised Learningcited by 0
  10. 2025Comparison of Different Deep Neural Network Models in the Cultural Heritage Domaincited by 0