CLaRE-ty Amid Chaos: Quantifying Representational Entanglement to Predict Ripple Effects in LLM Editing
Not on the map. Why?
Abstract (arXiv)
The static knowledge representations of large language models (LLMs) inevitably become outdated or incorrect over time. While model-editing techniques offer a promising solution by modifying a model's factual associations, they often produce unpredictable ripple effects, which are unintended behavioral changes that propagate even to the hidden space. In this work, we introduce CLaRE, a lightweight representation-level technique to identify where these ripple effects may occur. Unlike prior gradient-based methods, CLaRE quantifies entanglement between facts using forward activations from a single intermediate layer, avoiding costly backward passes. To enable systematic study, we prepare and analyse a corpus of 11,427 facts drawn from three existing datasets. Using CLaRE, we compute large-scale entanglement graphs of this corpus for multiple models, capturing how local edits propagate through representational space. These graphs enable stronger preservation sets for model editing, audit trails, efficient red-teaming, and scalable post-edit evaluation. In comparison to baselines, CLaRE achieves an average of 62.2% improvement in Spearman correlation with ripple effects while being 2.74× faster, and using 2.85× less peak GPU memory. Besides, CLaRE requires only a fraction of the storage needed by the baselines to compute and preserve fact representations. Our entanglement graphs and corpus are available at https://github.com/manitbaser/CLaRE.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 24 of its 46 references that are in the map. First posted on arXiv 11 Mar 2026.
Builds on
24 of 46 references.
References · 24
- 2022Locating and Editing Factual Associations in GPTcited by 2,691
- 2022Mass-Editing Memory in a Transformercited by 1,001
- 2022Memory-Based Model Editing at Scalecited by 447
- 2017Zero-Shot Relation Extraction via Reading Comprehensioncited by 426
- 2023Can We Edit Factual Knowledge by In-Context Learning?cited by 285
- 2022Aging with GRACE: Lifelong Model Editing with Discrete Key-Value Adaptorscited by 271
- 2023Evaluating the Ripple Effects of Knowledge Editing in Language Modelscited by 242
- 2024AlphaEdit: Null-Space Constrained Knowledge Editing for Language Modelscited by 236
- 2023Transformer-Patcher: One Mistake worth One Neuroncited by 197
- 2024Model Editing Harms General Abilities of Large Language Models: Regularization to the Rescuecited by 103
- 2024What is Your Data Worth to GPT? LLM-Scale Data Valuation with Influence Functionscited by 94
- 2023Detecting Edit Failures In Large Language Models: An Improved Specificity Benchmarkcited by 62
12 more
- 2024A Unified Framework for Model Editingcited by 57
- 2024Investigating Bias in LLM-Based Bias Detection: Disparities between LLMs and Human Perceptioncited by 56
- 2024Knowledge Graph Enhanced Large Language Model Editingcited by 40
- 2024Lifelong Knowledge Editing for LLMs with Retrieval-Augmented Continuous Prompt Learningcited by 40
- 2024Long-form evaluation of model editingcited by 23
- 2024Why Does New Knowledge Create Messy Ripple Effects in LLMs?cited by 18
- 2024From Deception to Detection: The Dual Roles of Large Language Models in Fake Newscited by 11
- 2025Disentangling Knowledge Representations for Large Language Model Editingcited by 6
- 2024RIPPLECOT: Amplifying Ripple Effect of Knowledge Editing in Language Models via Chain-of-Thought In-Context Learningcited by 5
- 2025ThinkEval: Practical Evaluation of Knowledge Leakage in LLM Editing using Thought-based Knowledge Graphscited by 4
- 2025ChainEdit: Propagating Ripple Effects in LLM Knowledge Editing through Logical Rule-Guided Chainscited by 4
- 2025Know-MRI: A Knowledge Mechanisms Revealer&Interpreter for Large Language Modelscited by 1
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2026Towards Localized and Disentangled Knowledge Editing for Multimodal Large Language Models
- 2024The Butterfly Effect of Model Editing: Few Edits Can Trigger Large Language Models Collapse
- 2025Bilinear representation mitigates reversal curse and enables consistent model editing
- 2024Attribution Analysis Meets Model Editing: Advancing Knowledge Correction in Vision Language Models with VisEdit
- 2024See the Unseen: Better Context-Consistent Knowledge-Editing by Noises
- 2023Learning Mutually Informed Representations for Characters and Subwords
- 2024Uncovering Overfitting in Large Language Model Editing
- 2025Revealing the Deceptiveness of Knowledge Editing: A Mechanistic Analysis of Superficial Editing