mlsanityData to 14 Oct 2026

The Geometry of Forgetting

arXiv 2604.06222 ↗First posted 27 Mar 2026q-bio.NC cs.AI cs.IRcited by 2

Not on the map. Why?

Abstract (arXiv)

Why do we forget? Why do we remember things that never happened? The conventional answer points to biological hardware. We propose a different one: geometry. Here we show that high-dimensional embedding spaces, subjected to noise, interference, and temporal degradation, reproduce quantitative signatures of human memory with no phenomenon-specific engineering. Power-law forgetting (b = 0.460 ± 0.183, human b ≈ 0.5) arises from interference among competing memories, not from decay. The identical decay function without competitors yields b ≈ 0.009, fifty times smaller. Time alone does not produce forgetting in this system. Competition does. Production embedding models (nominally 384--1,024 dimensions) concentrate their variance in only ~16 effective dimensions, placing them deep in the interference-vulnerable regime. False memories require no engineering at all: cosine similarity on unmodified pre-trained embeddings reproduces the Deese--Roediger--McDermott false alarm rate (0.583 versus human ~0.55) with zero parameter tuning and no boundary conditions. We did not build a false memory system. We found one already present in the raw geometry of semantic space. These results suggest that core memory phenomena are not bugs of biological implementation but features of any system that organizes information by meaning and retrieves it by proximity.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 5 of its 24 references that are in the map. First posted on arXiv 27 Mar 2026.

Builds on

5 of 24 references.

References · 5

  1. 2017Attention Is All You Needcited by 60,361
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  3. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
  4. 2024Qwen2.5 Technical Reportcited by 4,942
  5. 2016Overcoming catastrophic forgetting in neural networkscited by 4,787

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 2.

2 papers.