mlsanityData to 14 Oct 2026

Suppressed, Not Erased: A Representational Trace of Edited Facts Survives Even Weight-Free Knowledge Editing

arXiv 2609.18985 ↗First posted 17 Jul 2026cs.AI cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Knowledge-editing benchmarks certify local correctness, whether an edited model produces the new fact on near-edit prompts but not how much of the original fact remains decodable inside the model. We study residual knowledge directly with a linear trace probe: after editing a fact, we ask whether the original object is still recoverable from the model's hidden states. On GPT-2-XL, across three mechanistically distinct editors applied to 50 CounterFact edits, the original object remains linearly decodable well above chance after a successful edit (probe accuracy 0.96 for ROME, 0.86 for constrained fine-tuning, and 0.79 for the memory-based editor GRACE, against a chance level of 0.50; all edits reach 100% generation-based success). The GRACE result is the most informative: GRACE changes zero base-model weights, overriding the fact through an external memory, yet the original object is still decodable from the underlying network, so the residual trace cannot be attributed to an incomplete weight update. We read this as evidence that editing, even when behaviorally successful, suppresses rather than erases the original association in representational space. We also report a relearning-savings instrument that did not behave reliably in our setting and discuss why; we treat it as a negative methodological result rather than evidence. Code and data are released.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 9 of its 14 references that are in the map. First posted on arXiv 17 Jul 2026.

Builds on

9 of 14 references.

References · 9

  1. 2022Locating and Editing Factual Associations in GPTcited by 2,691
  2. 2020Transformer Feed-Forward Layers Are Key-Value Memoriescited by 1,336
  3. 2022Mass-Editing Memory in a Transformercited by 1,001
  4. 2022Aging with GRACE: Lifelong Model Editing with Discrete Key-Value Adaptorscited by 271
  5. 2023Evaluating the Ripple Effects of Knowledge Editing in Language Modelscited by 242
  6. 2023Linearity of Relation Decoding in Transformer Language Modelscited by 200
  7. 2023Can Sensitive Information Be Deleted From LLMs? Objectives for Defending Against Extraction Attackscited by 158
  8. 2025Towards LLM Unlearning Resilient to Relearning Attacks: A Sharpness-Aware Minimization Perspective and Beyondcited by 79
  9. 2025Revealing the Deceptiveness of Knowledge Editing: A Mechanistic Analysis of Superficial Editingcited by 5

Built on by

Not cited yet.