mlsanityData to 14 Oct 2026

Predictive Coding, Variational Autoencoders, and Biological Connections

arXiv 2011.07464 ↗First posted 15 Nov 2020cs.NEcited by 21

Not on the map. Why?

Abstract (arXiv)

This paper reviews predictive coding, from theoretical neuroscience, and variational autoencoders, from machine learning, identifying the common origin and mathematical framework underlying both areas. As each area is prominent within its respective field, more firmly connecting these areas could prove useful in the dialogue between neuroscience and machine learning. After reviewing each area, we discuss two possible correspondences implied by this perspective: cortical pyramidal dendrites as analogous to (non-linear) deep networks and lateral inhibition as analogous to normalizing flows. These connections may provide new directions for further investigations in each field.

Key facts. Cited by 21 papers in the map (data through 14 Oct 2026). First posted on arXiv 15 Nov 2020.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2021: 3; 2022: 4; 2023: 8; 2024: 2; 2025: 2; 2026: 2.

21 papers.

Sort:

By area:

  1. 2022Diffusion Probabilistic Modeling for Video Generationcited by 238
  2. 2021Predictive Coding: a Theoretical and Experimental Reviewcited by 77
  3. 2023Brain-inspired Computational Intelligence via Predictive Codingcited by 30
  4. 2022A Theoretical Framework for Inference Learningcited by 17
  5. 2024Poisson Variational Autoencodercited by 11
  6. 2023Supervised structure learningcited by 9
  7. 2024Predictive Coding Networks and Inference Learning: Tutorial and Surveycited by 7
  8. 2023The Expressive Leaky Memory Neuron: an Efficient and Expressive Phenomenological Neuron Model Can Solve Long-Horizon Taskscited by 5
  9. 2023Active Sensing with Predictive Coding and Uncertainty Minimizationcited by 5
  10. 2022Language Model-Based Paired Variational Autoencoders for Robotic Language Learningcited by 4
  11. 2023Predictive World Models from Real-World Partial Observationscited by 4
  12. 2023Latent Noise Segmentation: How Neural Noise Leads to the Emergence of Segmentation and Groupingcited by 4
9 more
  1. 2021PredProp: Bidirectional Stochastic Optimization with Precision Weighted Predictive Codingcited by 3
  2. 2023Learning to Predict Navigational Patterns from Partial Observationscited by 3
  3. 2022Top-down inference in an early visual cortex inspired hierarchical Variational Autoencodercited by 2
  4. 2023Learning beyond sensations: how dreams organize neuronal representationscited by 2
  5. 2025Negative Binomial Variational Autoencoders for Overdispersed Latent Modelingcited by 2
  6. 2026Predictive Coding Graphs are a Superset of Feedforward Neural Networkscited by 1
  7. 2021Differentiable Generalised Predictive Codingcited by 0
  8. 2025Sensory robustness through top-down feedback and neural stochasticity in recurrent vision modelscited by 0
  9. 2026Predictive Coding with Bayesian Priors via Proximal Gradientscited by 0