mlsanityData to 7 Oct 2026

Memoria: Resolving Fateful Forgetting Problem through Human-Inspired Memory Architecture

arXiv 2310.03052 ↗First posted 4 Oct 2023cs.LG cs.AI cs.NEcited by 8

Not on the map. Why?

Abstract (arXiv)

Making neural networks remember over the long term has been a longstanding issue. Although several external memory techniques have been introduced, most focus on retaining recent information in the short term. Regardless of its importance, information tends to be fatefully forgotten over time. We present Memoria, a memory system for artificial neural networks, drawing inspiration from humans and applying various neuroscientific and psychological theories. The experimental results prove the effectiveness of Memoria in the diverse tasks of sorting, language modeling, and classification, surpassing conventional techniques. Engram analysis reveals that Memoria exhibits the primacy, recency, and temporal contiguity effects which are characteristics of human memory.

Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Builds on 25 of its 69 references that are in the map. First posted on arXiv 4 Oct 2023.

Builds on

25 of 69 references.

References · 25

  1. 2017Attention Is All You Needcited by 59,932
  2. 2020Language Models are Few-Shot Learnerscited by 32,199
  3. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
  4. 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,874
  5. 2020Longformer: The Long-Document Transformercited by 3,362
  6. 2016Pointer Sentinel Mixture Modelscited by 2,992
  7. 2014Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modelingcited by 2,341
  8. 2019Transformer-XL: Attentive Language Models Beyond a Fixed-Length Contextcited by 1,830
  9. 2020Big Bird: Transformers for Longer Sequencescited by 1,673
  10. 2020Reformer: The Efficient Transformercited by 1,658
  11. 2019Compressive Transformers for Long-Range Sequence Modellingcited by 699
  12. 2014Neural Turing Machinescited by 630
13 more
  1. 2020Hopfield Networks is All You Needcited by 461
  2. 2022Memorizing Transformerscited by 219
  3. 2022Recurrent Memory Transformercited by 197
  4. 2015Practical and Optimal LSH for Angular Distancecited by 105
  5. 2022Hebbian Deep Learning Without Feedbackcited by 61
  6. 2018Revisiting the Inverted Indices for Billion-Scale Approximate Nearest Neighborscited by 37
  7. 2020Self-Attentive Associative Memorycited by 33
  8. 2016Scaling Memory-Augmented Neural Networks with Sparse Reads and Writescited by 28
  9. 2020MEMO: A Deep Network for Flexible Combination of Episodic Memoriescited by 21
  10. 2017Memory Augmented Neural Networks with Wormhole Connectionscited by 15
  11. 2018Fast Parametric Learning with Activation Memorizationcited by 9
  12. 2022A Machine with Short-Term, Episodic, and Semantic Memory Systemscited by 9
  13. 2016Dynamic Neural Turing Machine with Soft and Hard Addressing Schemescited by 8

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 4; 2025: 2; 2026: 2.

8 papers.

  1. 2024HippoRAG: Neurobiologically Inspired Long-Term Memory for Large Language Modelscited by 273
  2. 2025Advances and Challenges in Foundation Agents: From Brain-Inspired Intelligence to Evolutionary, Collaborative, and Safe Systemscited by 125
  3. 2024WISE: Rethinking the Knowledge Memory for Lifelong Model Editing of Large Language Modelscited by 90
  4. 2024Online Adaptation of Language Models with a Memory of Amortized Contextscited by 35
  5. 2024Towards LifeSpan Cognitive Systemscited by 13
  6. 2025A Review of Incorporating Psychological Theories in LLMscited by 5
  7. 2026Memory Bank Compression for Continual Adaptation of Large Language Modelscited by 4
  8. 2026Position: Hippocampal Explicit Memory Is the Cornerstone for AGIcited by 0