# Iterative VAE as a predictive brain model for out-of-distribution generalization

arXiv: https://arxiv.org/abs/2012.00557 · HTML: https://mlsanity.com/paper/2012.00557/

## Key facts

- Cited by 6 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 1 Dec 2020.

## Built on by (most cited first, 6 of 6)

- [Diversity vs. Recognizability: Human-like generalization in one-shot generative models](https://mlsanity.com/paper/2205.10370/) (2022)
- [Predictive Coding Networks and Inference Learning: Tutorial and Survey](https://mlsanity.com/paper/2407.04117/) (2024)
- [Latent Noise Segmentation: How Neural Noise Leads to the Emergence of Segmentation and Grouping](https://mlsanity.com/paper/2309.16515/) (2023)
- [Latent Representation Matters: Human-like Sketches in One-shot Drawing Tasks](https://mlsanity.com/paper/2406.06079/) (2024)
- [Not Too Generative, Not Too Discriminative: The Human Alignment Sweet Spot](https://mlsanity.com/paper/2605.23819/) (2026)
- [Generative Bayesian Filtering for State Estimation](https://mlsanity.com/paper/2607.20521/) (2026)

## Abstract (arXiv)

Our ability to generalize beyond training data to novel, out-of-distribution, image degradations is a hallmark of primate vision. The predictive brain, exemplified by predictive coding networks (PCNs), has become a prominent neuroscience theory of neural computation. Motivated by the recent successes of variational autoencoders (VAEs) in machine learning, we rigorously derive a correspondence between PCNs and VAEs. This motivates us to consider iterative extensions of VAEs (iVAEs) as plausible variational extensions of the PCNs. We further demonstrate that iVAEs generalize to distributional shifts significantly better than both PCNs and VAEs. In addition, we propose a novel measure of recognizability for individual samples which can be tested against human psychophysical data. Overall, we hope this work will spur interest in iVAEs as a promising new direction for modeling in neuroscience.