mlsanityData to 7 Oct 2026

Norm Anchors Make Model Edits Last

arXiv 2602.02543 ↗First posted 30 Jan 2026cs.LG cs.AIcited by 1

Not on the map. Why?

Abstract (arXiv)

Sequential Locate-and-Edit (L&E) model editing can fail abruptly after many edits. We identify and formalize this failure as a positive norm-feedback loop, in which solved value vectors and edited MLP weights progressively amplify each other, degrading edit quality and eventually collapsing model capabilities. Our analysis shows that this feedback can yield approximately exponential norm growth under standard L&E dynamics, and can remain unresolved by existing increment-level regularizers or update clamps. We propose Norm-Anchor Scaling (NAS), a plug-in stabilizer that breaks this loop by rescaling each solved value vector to an original-model reference norm. Across multiple LLM backbones, datasets, and L&E editors, NAS extends the usable editing horizon by more than 4x and improves long-run editing performance by 72.2% on average, while preserving single-edit efficacy, with only a one-line modification and negligible computational overhead.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 32 of its 40 references that are in the map. First posted on arXiv 30 Jan 2026.

Builds on

32 of 40 references.

References · 32

  1. 2020Measuring Massive Multitask Language Understandingcited by 7,768
  2. 2018GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understandingcited by 4,854
  3. 2021TruthfulQA: Measuring How Models Mimic Human Falsehoodscited by 2,919
  4. 2017A Broad-Coverage Challenge Corpus for Sentence Understanding through Inferencecited by 2,665
  5. 2022Locating and Editing Factual Associations in GPTcited by 2,609
  6. 2019Language Models as Knowledge Bases?cited by 1,922
  7. 2020Transformer Feed-Forward Layers Are Key-Value Memoriescited by 1,307
  8. 2022Mass-Editing Memory in a Transformercited by 976
  9. 2018Neural Network Acceptability Judgmentscited by 952
  10. 2020How Much Knowledge Can You Pack Into the Parameters of a Language Model?cited by 713
  11. 2021Editing Factual Knowledge in Language Modelscited by 548
  12. 2021Fast Model Editing at Scalecited by 491
20 more
  1. 2017Zero-Shot Relation Extraction via Reading Comprehensioncited by 425
  2. 2023Editing Large Language Models: Problems, Methods, and Opportunitiescited by 367
  3. 2023MQuAKE: Assessing Knowledge Editing in Language Models via Multi-Hop Questionscited by 292
  4. 2021Time-Aware Language Models as Temporal Knowledge Basescited by 290
  5. 2022Aging with GRACE: Lifelong Model Editing with Discrete Key-Value Adaptorscited by 267
  6. 2024AlphaEdit: Null-Space Constrained Knowledge Editing for Language Modelscited by 224
  7. 2020Modifying Memories in Transformer Modelscited by 222
  8. 2023Knowledge Editing for Large Language Models: A Surveycited by 189
  9. 2024A Comprehensive Study of Knowledge Editing for Large Language Modelscited by 157
  10. 2024Model Editing Harms General Abilities of Large Language Models: Regularization to the Rescuecited by 101
  11. 2024Model Editing at Scale leads to Gradual and Catastrophic Forgettingcited by 92
  12. 2024WISE: Rethinking the Knowledge Memory for Lifelong Model Editing of Large Language Modelscited by 90
  13. 2023MELO: Enhancing Model Editing with Neuron-Indexed Dynamic LoRAcited by 80
  14. 2025Reinforced Lifelong Editing for Language Modelscited by 33
  15. 2024Perturbation-Restrained Sequential Model Editingcited by 27
  16. 2025WikiBigEdit: Understanding the Limits of Lifelong Knowledge Editing in LLMscited by 25
  17. 2025MEMOIR: Lifelong Model Editing with Minimal Overwrite and Informed Retention for LLMscited by 10
  18. 2025Lifelong Knowledge Editing requires Better Regularizationcited by 9
  19. 2025LyapLock: Bounded Knowledge Preservation in Sequential Large Language Model Editingcited by 3
  20. 2025QueueEDIT: Structural Self-Correction for Sequential Model Editing in LLMscited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.