mlsanityData to 7 Oct 2026

REPAIR: Robust Editing via Progressive Adaptive Intervention and Reintegration

arXiv 2510.01879 ↗First posted 2 Oct 2025cs.CL cs.AIcited by 3

Not on the map. Why?

Abstract (arXiv)

Post-training for large language models (LLMs) is constrained by the high cost of acquiring new knowledge or correcting errors and by the unintended side effects that frequently arise from retraining. To address these issues, we introduce REPAIR (Robust Editing via Progressive Adaptive Intervention and Reintegration), a lifelong editing framework designed to support precise and low-cost model updates while preserving non-target knowledge. REPAIR mitigates the instability and conflicts of large-scale sequential edits through a closed-loop feedback mechanism coupled with dynamic memory management. Furthermore, by incorporating frequent knowledge fusion and enforcing strong locality guards, REPAIR effectively addresses the shortcomings of traditional distribution-agnostic approaches that often overlook unintended ripple effects. Our experiments demonstrate that REPAIR boosts editing accuracy by 10%-30% across multiple model families and significantly reduces knowledge forgetting. This work introduces a robust framework for developing reliable, scalable, and continually evolving LLMs.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 24 of its 29 references that are in the map. First posted on arXiv 2 Oct 2025.

Builds on

24 of 29 references.

References · 24

  1. 2016Overcoming catastrophic forgetting in neural networkscited by 4,718
  2. 2022Locating and Editing Factual Associations in GPTcited by 2,609
  3. 2016Learning without Forgettingcited by 2,465
  4. 2017Gradient Episodic Memory for Continual Learningcited by 1,871
  5. 2016Progressive Neural Networkscited by 1,332
  6. 2017Continual Learning with Deep Generative Replaycited by 1,152
  7. 2022Mass-Editing Memory in a Transformercited by 976
  8. 2017PackNet: Adding Multiple Tasks to a Single Network by Iterative Pruningcited by 882
  9. 2023TIES-Merging: Resolving Interference When Merging Modelscited by 795
  10. 2021Editing Factual Knowledge in Language Modelscited by 548
  11. 2021Fast Model Editing at Scalecited by 491
  12. 2022Memory-Based Model Editing at Scalecited by 443
12 more
  1. 2017Zero-Shot Relation Extraction via Reading Comprehensioncited by 425
  2. 2019Orthogonal Gradient Descent for Continual Learningcited by 361
  3. 2022Aging with GRACE: Lifelong Model Editing with Discrete Key-Value Adaptorscited by 267
  4. 2023Evaluating the Ripple Effects of Knowledge Editing in Language Modelscited by 238
  5. 2023Knowledge Editing for Large Language Models: A Surveycited by 189
  6. 2024RedPajama: an Open Dataset for Training Large Language Modelscited by 178
  7. 2021Self-Supervised Models are Continual Learnerscited by 149
  8. 2021An Empirical Investigation of the Role of Pre-training in Lifelong Learningcited by 134
  9. 2024WISE: Rethinking the Knowledge Memory for Lifelong Model Editing of Large Language Modelscited by 90
  10. 2024Rebuilding ROME : Resolving Model Collapse during Sequential Model Editingcited by 50
  11. 2024InstructEdit: Instruction-based Knowledge Editing for Large Language Modelscited by 17
  12. 2024Brain-inspired continual pre-trained learner via silent synaptic consolidationcited by 6

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 3.

3 papers.