mlsanityData to 7 Oct 2026

A Dual-Axis Taxonomy of Knowledge Editing for LLMs: From Mechanisms to Functions

arXiv 2508.08795 ↗First posted 12 Aug 2025cs.AI cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

Large language models (LLMs) acquire vast knowledge from large text corpora, but this information can become outdated or inaccurate. Since retraining is computationally expensive, knowledge editing offers an efficient alternative -- modifying internal knowledge without full retraining. These methods aim to update facts precisely while preserving the model's overall capabilities. While existing surveys focus on the mechanism of editing (e.g., parameter changes vs. external memory), they often overlook the function of the knowledge being edited. This survey introduces a novel, complementary function-based taxonomy to provide a more holistic view. We examine how different mechanisms apply to various knowledge types -- factual, temporal, conceptual, commonsense, and social -- highlighting how editing effectiveness depends on the nature of the target knowledge. By organizing our review along these two axes, we map the current landscape, outline the strengths and limitations of existing methods, define the problem formally, survey evaluation tasks and datasets, and conclude with open challenges and future directions.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 24 of its 26 references that are in the map. First posted on arXiv 12 Aug 2025.

Builds on

24 of 26 references.

References · 24

  1. 2020Language Models are Few-Shot Learnerscited by 32,199
  2. 2022Locating and Editing Factual Associations in GPTcited by 2,609
  3. 2018FEVER: a large-scale dataset for Fact Extraction and VERificationcited by 1,362
  4. 2022Mass-Editing Memory in a Transformercited by 976
  5. 2021Editing Factual Knowledge in Language Modelscited by 548
  6. 2022Memory-Based Model Editing at Scalecited by 443
  7. 2017Zero-Shot Relation Extraction via Reading Comprehensioncited by 425
  8. 2023Editing Large Language Models: Problems, Methods, and Opportunitiescited by 367
  9. 2021Measuring and Improving Consistency in Pretrained Language Modelscited by 361
  10. 2023MQuAKE: Assessing Knowledge Editing in Language Models via Multi-Hop Questionscited by 292
  11. 2023Can We Edit Factual Knowledge by In-Context Learning?cited by 284
  12. 2022Aging with GRACE: Lifelong Model Editing with Discrete Key-Value Adaptorscited by 267
12 more
  1. 2023Does Localization Inform Editing? Surprising Differences in Causality-Based Localization vs. Knowledge Editing in Language Modelscited by 237
  2. 2021Get Your Vitamin C! Robust Fact Verification with Contrastive Evidencecited by 222
  3. 2023Transformer-Patcher: One Mistake worth One Neuroncited by 196
  4. 2023Knowledge Editing for Large Language Models: A Surveycited by 189
  5. 2023PMET: Precise Model Editing in a Transformercited by 170
  6. 2020Editable Neural Networkscited by 154
  7. 2022Calibrating Factual Knowledge in Pretrained Language Modelscited by 92
  8. 2024Detoxifying Large Language Models via Knowledge Editingcited by 86
  9. 2023A Survey on Knowledge Editing of Neural Networkscited by 34
  10. 2025BiasEdit: Debiasing Stereotyped Language Models via Model Editingcited by 18
  11. 2024Commonsense Knowledge Editing Based on Free-Text in LLMscited by 16
  12. 2024Identifying and Mitigating Social Bias Knowledge in Language Modelscited by 13

Built on by

Not cited yet.