A Dual-Axis Taxonomy of Knowledge Editing for LLMs: From Mechanisms to Functions
Not on the map. Why?
Abstract (arXiv)
Large language models (LLMs) acquire vast knowledge from large text corpora, but this information can become outdated or inaccurate. Since retraining is computationally expensive, knowledge editing offers an efficient alternative -- modifying internal knowledge without full retraining. These methods aim to update facts precisely while preserving the model's overall capabilities. While existing surveys focus on the mechanism of editing (e.g., parameter changes vs. external memory), they often overlook the function of the knowledge being edited. This survey introduces a novel, complementary function-based taxonomy to provide a more holistic view. We examine how different mechanisms apply to various knowledge types -- factual, temporal, conceptual, commonsense, and social -- highlighting how editing effectiveness depends on the nature of the target knowledge. By organizing our review along these two axes, we map the current landscape, outline the strengths and limitations of existing methods, define the problem formally, survey evaluation tasks and datasets, and conclude with open challenges and future directions.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 24 of its 26 references that are in the map. First posted on arXiv 12 Aug 2025.
Builds on
24 of 26 references.
References · 24
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2022Locating and Editing Factual Associations in GPTcited by 2,609
- 2018FEVER: a large-scale dataset for Fact Extraction and VERificationcited by 1,362
- 2022Mass-Editing Memory in a Transformercited by 976
- 2021Editing Factual Knowledge in Language Modelscited by 548
- 2022Memory-Based Model Editing at Scalecited by 443
- 2017Zero-Shot Relation Extraction via Reading Comprehensioncited by 425
- 2023Editing Large Language Models: Problems, Methods, and Opportunitiescited by 367
- 2021Measuring and Improving Consistency in Pretrained Language Modelscited by 361
- 2023MQuAKE: Assessing Knowledge Editing in Language Models via Multi-Hop Questionscited by 292
- 2023Can We Edit Factual Knowledge by In-Context Learning?cited by 284
- 2022Aging with GRACE: Lifelong Model Editing with Discrete Key-Value Adaptorscited by 267
12 more
- 2023Does Localization Inform Editing? Surprising Differences in Causality-Based Localization vs. Knowledge Editing in Language Modelscited by 237
- 2021Get Your Vitamin C! Robust Fact Verification with Contrastive Evidencecited by 222
- 2023Transformer-Patcher: One Mistake worth One Neuroncited by 196
- 2023Knowledge Editing for Large Language Models: A Surveycited by 189
- 2023PMET: Precise Model Editing in a Transformercited by 170
- 2020Editable Neural Networkscited by 154
- 2022Calibrating Factual Knowledge in Pretrained Language Modelscited by 92
- 2024Detoxifying Large Language Models via Knowledge Editingcited by 86
- 2023A Survey on Knowledge Editing of Neural Networkscited by 34
- 2025BiasEdit: Debiasing Stereotyped Language Models via Model Editingcited by 18
- 2024Commonsense Knowledge Editing Based on Free-Text in LLMscited by 16
- 2024Identifying and Mitigating Social Bias Knowledge in Language Modelscited by 13
Built on by
Not cited yet.