mlsanityData to 14 Oct 2026

BayesPCN: A Continually Learnable Predictive Coding Associative Memory

arXiv 2205.09930 ↗First posted 20 May 2022cs.LG cs.AIcited by 14

Not on the map. Why?

Abstract (arXiv)

Associative memory plays an important role in human intelligence and its mechanisms have been linked to attention in machine learning. While the machine learning community's interest in associative memories has recently been rekindled, most work has focused on memory recall (read) over memory learning (write). In this paper, we present BayesPCN, a hierarchical associative memory capable of performing continual one-shot memory writes without meta-learning. Moreover, BayesPCN is able to gradually forget past observations (forget) to free its memory. Experiments show that BayesPCN can recall corrupted i.i.d. high-dimensional data observed hundreds to a thousand ``timesteps'' ago without a large drop in recall ability compared to the state-of-the-art offline-learned parametric memory models.

Key facts. Cited by 14 papers in the map (data through 14 Oct 2026). Builds on 27 of its 52 references that are in the map. First posted on arXiv 20 May 2022.

Builds on

27 of 52 references.

References · 27

  1. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  2. 2013Auto-Encoding Variational Bayescited by 4,053
  3. 2014Neural Turing Machinescited by 644
  4. 2021Linear Transformers Are Secretly Fast Weight Programmerscited by 502
  5. 2020Hopfield Networks is All You Needcited by 475
  6. 2016Dense Associative Memory for Pattern Recognitioncited by 236
  7. 2020Large Associative Memory Problem in Neurobiology and Machine Learningcited by 112
  8. 2020Predictive Coding Approximates Backprop along Arbitrary Computation Graphscited by 90
  9. 2021Predictive Coding: a Theoretical and Experimental Reviewcited by 77
  10. 2022Universal Hopfield Networks: A General Framework for Single-Shot Associative Memory Modelscited by 55
  11. 2020Modern Hopfield Networks and Attention for Immune Repertoire Classificationcited by 53
  12. 2022The Dual Form of Neural Networks Revisited: Connecting Test Time Predictions to Training Patterns via Spotlights of Attentioncited by 46
15 more
  1. 2020The Neural Coding Framework for Learning Generative Modelscited by 44
  2. 2021Associative Memories via Predictive Codingcited by 44
  3. 2021Hierarchical Associative Memorycited by 34
  4. 2019Unsupervised Progressive Learning and the STAM Architecturecited by 30
  5. 2021Attention Approximates Sparse Distributed Memorycited by 29
  6. 2022Hybrid Predictive Coding: Inferring, Fast and Slowcited by 26
  7. 2015Continuous online sequence learning with an unsupervised neural network modelcited by 18
  8. 2019Lifelong Neural Predictive Coding: Learning Cumulatively Online without Forgettingcited by 15
  9. 2018The Kanerva Machine: A Generative Distributed Memorycited by 14
  10. 2021Modern Hopfield Networks for Few- and Zero-Shot Reaction Template Predictioncited by 13
  11. 2018Conducting Credit Assignment by Aligning Local Representationscited by 12
  12. 2019Meta-Learning Deep Energy-Based Memory Modelscited by 11
  13. 2022Content Addressable Memory Without Catastrophic Forgetting by Heteroassociation with a Fixed Scaffoldcited by 11
  14. 2018Learning Attractor Dynamics for Generative Memorycited by 6
  15. 2018A neuro-inspired architecture for unsupervised continual learning based on online clustering and hierarchical predictive codingcited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2023: 5; 2024: 5; 2025: 1; 2026: 3.

14 papers.

Sort:

By area:

  1. 2024Uniform Memory Retrieval with Larger Capacity for Modern Hopfield Modelscited by 38
  2. 2023Brain-inspired Computational Intelligence via Predictive Codingcited by 30
  3. 2024Benchmarking Predictive Coding Networks -- Made Simplecited by 30
  4. 2023Sequential Memory with Temporal Predictive Codingcited by 16
  5. 2023Predictive Coding beyond Correlationscited by 6
  6. 2023A Sparse Quantized Hopfield Network for Online-Continual Memorycited by 5
  7. 2023Saliency-Guided Hidden Associative Replay for Continual Learningcited by 5
  8. 2026Faster Predictive Coding Networks via Better Initializationcited by 3
  9. 2024Associative Memories in the Feature Spacecited by 2
  10. 2024Lifelong Learning of Video Diffusion Models From a Single Video Streamcited by 2
  11. 2025Memory-Integrated Reconfigurable Adapters: A Unified Framework for Settings with Multiple Taskscited by 2
  12. 2024Predictive Attractor Modelscited by 0
2 more
  1. 2026Robust Auto-associative Memory via Convolutional Restricted Hopfield Networkscited by 0
  2. 2026DeltaNet-PC: Test-Time Memory Without Backpropagation Through Timecited by 0