FABLE: Fine-grained Fact Anchoring for Unstructured Model Editing
Not on the map. Why?
Abstract (arXiv)
Unstructured model editing aims to update models with real-world text, yet existing methods often memorize text holistically without reliable fine-grained fact access. To address this, we propose FABLE, a hierarchical framework that decouples fine-grained fact injection from holistic text generation. FABLE follows a two-stage, fact-first strategy: discrete facts are anchored in shallow layers, followed by minimal updates to deeper layers to produce coherent text. This decoupling resolves the mismatch between holistic recall and fine-grained fact access, reflecting the unidirectional Transformer flow in which surface-form generation amplifies rather than corrects underlying fact representations. We also introduce UnFine, a diagnostic benchmark with fine-grained question-answer pairs and fact-level metrics for systematic evaluation. Experiments show that FABLE substantially improves fine-grained question answering while maintaining state-of-the-art holistic editing performance. Our code is publicly available at https://github.com/caskcsg/FABLE.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 22 of its 34 references that are in the map. First posted on arXiv 14 Apr 2026.
Builds on
22 of 34 references.
References · 22
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2020Measuring Massive Multitask Language Understandingcited by 7,963
- 2019BERTScore: Evaluating Text Generation with BERTcited by 5,512
- 2022Locating and Editing Factual Associations in GPTcited by 2,691
- 2017A Broad-Coverage Challenge Corpus for Sentence Understanding through Inferencecited by 2,682
- 2023FActScore: Fine-grained Atomic Evaluation of Factual Precision in Long Form Text Generationcited by 1,282
- 2022Mass-Editing Memory in a Transformercited by 1,001
- 2018Neural Network Acceptability Judgmentscited by 958
- 2021Editing Factual Knowledge in Language Modelscited by 553
- 2022Memory-Based Model Editing at Scalecited by 447
- 2023Editing Large Language Models: Problems, Methods, and Opportunitiescited by 372
- 2023MQuAKE: Assessing Knowledge Editing in Language Models via Multi-Hop Questionscited by 300
10 more
- 2022Aging with GRACE: Lifelong Model Editing with Discrete Key-Value Adaptorscited by 271
- 2024AlphaEdit: Null-Space Constrained Knowledge Editing for Language Modelscited by 236
- 2023Transformer-Patcher: One Mistake worth One Neuroncited by 197
- 2024Model Editing Harms General Abilities of Large Language Models: Regularization to the Rescuecited by 103
- 2023EasyEdit: An Easy-to-use Knowledge Editing Framework for Large Language Modelscited by 98
- 2023MELO: Enhancing Model Editing with Neuron-Indexed Dynamic LoRAcited by 80
- 2025AnyEdit: Edit Any Knowledge Encoded in Language Modelscited by 76
- 2024AKEW: Assessing Knowledge Editing in the Wildcited by 36
- 2024Commonsense Knowledge Editing Based on Free-Text in LLMscited by 16
- 2025LyapLock: Bounded Knowledge Preservation in Sequential Large Language Model Editingcited by 3
Built on by
Citing papers per year: 2026: 2.
2 papers.