mlsanityData to 14 Oct 2026

What the "Spotless" Mind Remembers: How Knowledge Entanglement Shapes What Leaks After Unlearning in LLMs

arXiv 2510.25732 ↗First posted 29 Oct 2025cs.CL cs.AIcited by 1

On the map: LLM safety and security → Machine unlearning

Abstract (arXiv)

Unlearning in large language models (LLMs) is usually evaluated as whether an "unlearned" fact can be recovered. We instead ask whether a fact's structural entanglement with the rest of a model's knowledge predicts whether it leaks after unlearning, whether this relationship changes systematically, and whether it is causal. Across varied unlearning algorithms (WHP and GA+KL), two domains (both fictional Harry Potter and non-fictional U.S. Senators, 2000-2010), and four models (2.7B-13B parameters), we find that before unlearning, more entangled facts are recalled more often (r = +0.39 to +0.51). WHP weakens this relationship but stays positive (r = +0.16 to +0.33); GA+KL inverts it in every domain and model size (r = -0.14 to -0.25). To our knowledge, this is the first report of this specific reversal in the unlearning literature. To confirm this is causal beyond correlation, we directly manipulate a prompt's entanglement score, holding its content, target model fixed, and show recall moves in the predicted direction and reverses sign under GA+KL in the same direction as the correlational analysis. This manipulation is our central evidence that unlearning acts on the underlying knowledge structure, not just its output. Building on this, we train a predictive model that estimates a prompt's post-unlearning factuality/hallucination profile before unlearning is run, creating a unique way of model auditing in triaging which prompts are likely to leak.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Machine unlearning, one of 12 directions in LLM safety and security. Builds on 15 of its 32 references that are in the map. First posted on arXiv 29 Oct 2025.

Builds on

15 of 32 references.

Closest ancestors · 8

Same direction, newest first

  1. 2025Probing Knowledge Holes in Unlearned LLMs27 Oct
  2. 2025Harry Potter is Still Here! Probing Knowledge Leakage in Targeted Unlearned Large Language Models via Automated Adversarial Prompting22 May
  3. 2025Unlearning Isn't Deletion: Investigating Reversibility of Machine Unlearning in LLMs22 May
  4. 2025Not All Data Are Unlearned Equally7 Apr
  5. 2025Which Retain Set Matters for LLM Unlearning? A Case Study on Entity Unlearning17 Feb
  6. 2024TOFU: A Task of Fictitious Unlearning for LLMs11 Jan
  7. 2023Who's Harry Potter? Approximate Unlearning in LLMs3 Oct
  8. 2023Speak, Memory: An Archaeology of Books Known to ChatGPT/GPT-428 Apr

Other references · 7

  1. 2024How Johnny Can Persuade LLMs to Jailbreak Them: Rethinking Persuasion to Challenge AI Safety by Humanizing LLMscited by 573
  2. 2023Analyzing Leakage of Personally Identifiable Information in Language Modelscited by 285
  3. 2023Head-to-Tail: How Knowledgeable are Large Language Models (LLMs)? A.K.A. Will LLMs Replace Knowledge Graphs?cited by 168
  4. 2023The Earth is Flat because...: Investigating LLMs' Belief towards Misinformation via Persuasive Conversationcited by 109
  5. 2022The Moral Debater: A Study on the Computational Generation of Morally Framed Argumentscited by 22
  6. 2024Why Does New Knowledge Create Messy Ripple Effects in LLMs?cited by 18
  7. 2025Disentangling Knowledge Representations for Large Language Model Editingcited by 6

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2024Learning and Unlearning of Fabricated Knowledge in Language Models
  2. 2025Do LLMs Really Forget? Evaluating Unlearning with Knowledge Correlation and Confidence Awareness
  3. 2026Multilingual Unlearning in LLMs: Transfer, Dynamics, and Reversibility
  4. 2026Anatomy of Unlearning: The Dual Impact of Fact Salience and Model Fine-Tuning
  5. 2025FaithUn: Toward Faithful Forgetting in Language Models by Investigating the Interconnectedness of Knowledge
  6. 2026Entangled Representations Amplify Collateral Damage in Unlearning
  7. 2026Making LLMs Truly Forget: Deep Unlearning by Searching, Selecting, and Severing Knowledge Paths
  8. 2025Towards Mitigating Excessive Forgetting in LLM Unlearning via Entanglement-Guidance with Proxy Constraint