mlsanityData to 7 Oct 2026

Holographic Memory for Zero-Shot Compositional Reasoning in Knowledge Graphs: A Mechanistic Study of Where and Why It Fails

arXiv 2606.24948 ↗First posted 23 Jun 2026cs.LG cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Knowledge graph embedding (KGE) models predict single-hop links well but have no mechanism for zero-shot compositional queries: multi-hop questions whose relation chains never appeared during training. Holographic Reduced Representations (HRR), which bind and unbind symbols via circular convolution, are a theoretically attractive candidate, since binding is approximately invertible and associative. We test whether this promise holds. We study two holographic memory variants, real-valued HRR and phase-only Fourier HRR (FHRR), each with a modern Hopfield cleanup, on FB15k-237 over five seeds. Four findings follow. First, both are competitive single-hop retrievers (filtered MRR 0.358 +/- 0.002 for HRR, 0.350 +/- 0.021 for FHRR). Second, neither composes zero-shot: accuracy stays at chance across all cleanup temperatures. Third, the main contribution, we localise the failure mechanistically. A hop-1 probe shows the memory recovers the correct intermediate entity with high fidelity (MRR 0.896 +/- 0.002 for HRR), yet composition still fails even with a verified-correct intermediate. A second probe shows why: posing the ground-truth second-hop fact as a standalone atomic query, bypassing composition entirely, already recovers it at only 0.26 to 0.48x average atomic accuracy, uniformly across relation fan-out. The bottleneck is not the bind-unbind algebra or the cleanup; it is that facts compositional chains pass through are intrinsically harder for the superposed memory to retrieve, a capacity and interference effect present already at a single hop. Fourth, we prove (Lemma 4.1) that FHRR's softmax cleanup is not phase-equivariant, compounding the primary failure on the minority of chains where hop-1 itself errs. Fixing zero-shot composition requires improving retrieval capacity under superposition, not just redesigning the cleanup.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 12 of its 21 references that are in the map. First posted on arXiv 23 Jun 2026.

Builds on

12 of 21 references.

References · 12

  1. 2014Embedding Entities and Relations for Learning and Inference in Knowledge Basescited by 929
  2. 2016Complex Embeddings for Simple Link Predictioncited by 897
  3. 2019RotatE: Knowledge Graph Embedding by Relational Rotation in Complex Spacecited by 893
  4. 2017Convolutional 2D Knowledge Graph Embeddingscited by 729
  5. 2020Hopfield Networks is All You Needcited by 461
  6. 2017DeepPath: A Reinforcement Learning Method for Knowledge Graph Reasoningcited by 265
  7. 2020Query2box: Reasoning over Knowledge Graphs in Vector Space using Box Embeddingscited by 169
  8. 2020Beta Embeddings for Multi-Hop Logical Reasoning in Knowledge Graphscited by 128
  9. 2020RNNLogic: Learning Logic Rules for Reasoning on Knowledge Graphscited by 117
  10. 2020Complex Query Answering with Neural Link Predictorscited by 98
  11. 2020A comparison of Vector Symbolic Architecturescited by 63
  12. 2015Traversing Knowledge Graphs in Vector Spacecited by 51

Built on by

Not cited yet.