REPAIR: Robust Editing via Progressive Adaptive Intervention and Reintegration
Not on the map. Why?
Abstract (arXiv)
Post-training for large language models (LLMs) is constrained by the high cost of acquiring new knowledge or correcting errors and by the unintended side effects that frequently arise from retraining. To address these issues, we introduce REPAIR (Robust Editing via Progressive Adaptive Intervention and Reintegration), a lifelong editing framework designed to support precise and low-cost model updates while preserving non-target knowledge. REPAIR mitigates the instability and conflicts of large-scale sequential edits through a closed-loop feedback mechanism coupled with dynamic memory management. Furthermore, by incorporating frequent knowledge fusion and enforcing strong locality guards, REPAIR effectively addresses the shortcomings of traditional distribution-agnostic approaches that often overlook unintended ripple effects. Our experiments demonstrate that REPAIR boosts editing accuracy by 10%-30% across multiple model families and significantly reduces knowledge forgetting. This work introduces a robust framework for developing reliable, scalable, and continually evolving LLMs.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 24 of its 29 references that are in the map. First posted on arXiv 2 Oct 2025.
Builds on
24 of 29 references.
References · 24
- 2016Overcoming catastrophic forgetting in neural networkscited by 4,718
- 2022Locating and Editing Factual Associations in GPTcited by 2,609
- 2016Learning without Forgettingcited by 2,465
- 2017Gradient Episodic Memory for Continual Learningcited by 1,871
- 2016Progressive Neural Networkscited by 1,332
- 2017Continual Learning with Deep Generative Replaycited by 1,152
- 2022Mass-Editing Memory in a Transformercited by 976
- 2017PackNet: Adding Multiple Tasks to a Single Network by Iterative Pruningcited by 882
- 2023TIES-Merging: Resolving Interference When Merging Modelscited by 795
- 2021Editing Factual Knowledge in Language Modelscited by 548
- 2021Fast Model Editing at Scalecited by 491
- 2022Memory-Based Model Editing at Scalecited by 443
12 more
- 2017Zero-Shot Relation Extraction via Reading Comprehensioncited by 425
- 2019Orthogonal Gradient Descent for Continual Learningcited by 361
- 2022Aging with GRACE: Lifelong Model Editing with Discrete Key-Value Adaptorscited by 267
- 2023Evaluating the Ripple Effects of Knowledge Editing in Language Modelscited by 238
- 2023Knowledge Editing for Large Language Models: A Surveycited by 189
- 2024RedPajama: an Open Dataset for Training Large Language Modelscited by 178
- 2021Self-Supervised Models are Continual Learnerscited by 149
- 2021An Empirical Investigation of the Role of Pre-training in Lifelong Learningcited by 134
- 2024WISE: Rethinking the Knowledge Memory for Lifelong Model Editing of Large Language Modelscited by 90
- 2024Rebuilding ROME : Resolving Model Collapse during Sequential Model Editingcited by 50
- 2024InstructEdit: Instruction-based Knowledge Editing for Large Language Modelscited by 17
- 2024Brain-inspired continual pre-trained learner via silent synaptic consolidationcited by 6
Built on by
Citing papers per year: 2026: 3.
3 papers.
- 2026DEEPMED: Building a Medical DeepResearch Agent via Multi-hop Med-Search Data and Turn-Controlled Agentic Training & Inferencecited by 6
- 2026Key-Value Pair-Free Continual Learner via Task-Specific Prompt-Prototypecited by 1
- 2026HoReN: Normalized Hopfield Retrieval for Large-Scale Sequential Model Editingcited by 0
- 2026HoReN: Normalized Hopfield Retrieval for Large-Scale Sequential Model Editing2 May 2026
- 2026DEEPMED: Building a Medical DeepResearch Agent via Multi-hop Med-Search Data and Turn-Controlled Agentic Training & Inference26 Jan 2026
- 2026Key-Value Pair-Free Continual Learner via Task-Specific Prompt-Prototype8 Jan 2026