mlsanityData to 13 Oct 2026

Robust Knowledge Editing via Explicit Reasoning Chains for Distractor-Resilient Multi-Hop QA

arXiv 2509.01468 ↗First posted 1 Sep 2025cs.CLcited by 4

On the map: LLM reasoning → Knowledge- and tool-augmented reasoning

Abstract (arXiv)

Large language models (LLMs) encode vast amounts of world knowledge but remain static once trained, making the timely integration of emerging facts prohibitively expensive via full retraining. Knowledge-editing techniques have thus emerged to inject or overwrite specific facts into LLMs, yet they either over-rely on superficial cues or incur complex, iterative pipelines that collapse under noisy, multi-hop conditions. We introduce Reason-KE, an end-to-end reasoning-chain-based editing framework that steers a pretrained LLM through four structured stages-fact acknowledgment, relevance determination, selective application, and final reasoning-to filter distractors in a single pass. Trained on MQuAKE-CF with up to four irrelevant facts, Reason-KE elevates Qwen2.5-7B's multi-hop QA accuracy to 90.2% while suffering merely a 6.3% drop under heavy distraction and <1% when answers are leaked. Our quantitative analysis confirms Reason-KE's resilience and efficiency, establishing a new state-of-the-art for reliable LLM knowledge updates.

Key facts. Cited by 4 papers in the map (data through 13 Oct 2026). Placed in Knowledge- and tool-augmented reasoning, one of 17 directions in LLM reasoning. Builds on 18 of its 27 references that are in the map. First posted on arXiv 1 Sep 2025.

Builds on

18 of 27 references.

Closest ancestors · 3

Same direction, newest first

  1. 2024Knowledge Editing through Chain-of-Thought23 Dec
  2. 2024DeepEdit: Knowledge Editing as Decoding with Constraints19 Jan
  3. 2023PokeMQA: Programmable knowledge editing for Multi-hop Question Answering23 Dec

Other references · 15

  1. 2024The Llama 3 Herd of Modelscited by 14,486
  2. 2024Qwen2.5 Technical Reportcited by 4,840
  3. 2023A Survey of Large Language Modelscited by 2,559
  4. 2021Unsupervised Dense Information Retrieval with Contrastive Learningcited by 1,205
  5. 2021What Makes Good In-Context Examples for GPT-3?cited by 1,191
  6. 2022Mass-Editing Memory in a Transformercited by 990
  7. 2024DeepSeek-V3 Technical Reportcited by 777
  8. 2021Fast Model Editing at Scalecited by 493
  9. 2023Editing Large Language Models: Problems, Methods, and Opportunitiescited by 370
  10. 2023MQuAKE: Assessing Knowledge Editing in Language Models via Multi-Hop Questionscited by 297
  11. 2020Modifying Memories in Transformer Modelscited by 222
  12. 2023Can ChatGPT Understand Too? A Comparative Study on ChatGPT and Fine-tuned BERTcited by 155
3 more
  1. 2023EasyEdit: An Easy-to-use Knowledge Editing Framework for Large Language Modelscited by 97
  2. 2024Achieving >97% on GSM8K: Deeply Understanding the Problems Makes LLMs Better Solvers for Math Word Problemscited by 31
  3. 2023DUnE: Dataset for Unified Editingcited by 19

Built on by

Cited by year (2026 to 13 Oct)

Citing papers per year: 2025: 1; 2026: 3.

4 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2024Enhancing Multi-hop Reasoning through Knowledge Erasure in Large Language Model Editing
  2. 2026Addressing the Reasoning Gap: Mechanistic Circuit-Based Knowledge Editing in Large Language Models
  3. 2026On the Limitations of Rank-One Model Editing in Answering Multi-hop Questions
  4. 2025Knowledge Editing for Multi-Hop Question Answering Using Semantic Analysis
  5. 2024Retrieval-enhanced Knowledge Editing in Language Models for Multi-Hop Question Answering
  6. 2024Time Sensitive Knowledge Editing through Efficient Finetuning
  7. 2025Decoupling Reasoning and Knowledge Injection for In-Context Knowledge Editing
  8. 2024Investigating Multi-Hop Factual Shortcuts in Knowledge Editing of Large Language Models