mlsanityData to 14 Oct 2026

Decoupling Reasoning and Knowledge Injection for In-Context Knowledge Editing

arXiv 2506.00536 ↗First posted 31 May 2025cs.CL cs.AIcited by 12

On the map: LLM reasoning → Knowledge- and tool-augmented reasoning

Abstract (arXiv)

Knowledge editing aims to efficiently update Large Language Models (LLMs) by modifying specific knowledge without retraining the entire model. Among knowledge editing approaches, in-context editing (ICE) offers a lightweight solution by injecting new knowledge directly into the input context, leaving model parameters unchanged. However, existing ICE approaches do not explicitly separate the newly injected knowledge from the model's original reasoning process. This entanglement often results in conflicts between external updates and internal parametric knowledge, undermining the consistency and accuracy of the reasoning path.In this work, we conduct preliminary experiments to examine how parametric knowledge influences reasoning path planning. We find that the model's reasoning is tightly coupled with its internal knowledge, and that naively injecting new information without adapting the reasoning path often leads to performance degradation, particularly in multi-hop tasks. To this end, we propose DecKER, a novel ICE framework that decouples reasoning from knowledge editing by generating a masked reasoning path and then resolving knowledge edits via hybrid retrieval and model-based validation. Experiments on multi-hop QA benchmarks show that DecKER significantly outperforms existing ICE methods by mitigating knowledge conflicts and preserving reasoning consistency. Our code is available at: https://github.com/bebr2/DecKER .

Key facts. Cited by 12 papers in the map (data through 14 Oct 2026). Placed in Knowledge- and tool-augmented reasoning, one of 17 directions in LLM reasoning. Builds on 12 of its 37 references that are in the map. First posted on arXiv 31 May 2025.

Builds on

12 of 37 references.

Closest ancestors · 2

Same direction, newest first

  1. 2024Knowledge Editing through Chain-of-Thought23 Dec
  2. 2024DeepEdit: Knowledge Editing as Decoding with Constraints19 Jan

Other references · 10

  1. 2023GPT-4 Technical Reportcited by 18,396
  2. 2024The Llama 3 Herd of Modelscited by 14,715
  3. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
  4. 2023LongBench: A Bilingual, Multitask Benchmark for Long Context Understandingcited by 1,417
  5. 2024AlphaEdit: Null-Space Constrained Knowledge Editing for Language Modelscited by 236
  6. 2024jina-embeddings-v3: Multilingual Embeddings With Task LoRAcited by 141
  7. 2025Parametric Retrieval Augmented Generationcited by 38
  8. 2025RbFT: Robust Fine-tuning for Retrieval-Augmented Generation against Retrieval Defectscited by 27
  9. 2024Should We Really Edit Language Models? On the Evaluation of Edited Language Modelscited by 18
  10. 2025JuDGE: Benchmarking Judgment Document Generation for Chinese Legal Systemcited by 18

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 4; 2026: 8.

12 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2024Enhancing Multi-hop Reasoning through Knowledge Erasure in Large Language Model Editing
  2. 2025Benchmarking and Rethinking Knowledge Editing for Large Language Models
  3. 2025Knowledge Updating? No More Model Editing! Just Selective Contextual Reasoning
  4. 2025CaKE: Circuit-aware Editing Enables Generalizable Knowledge Learners
  5. 2025Robust Knowledge Editing via Explicit Reasoning Chains for Distractor-Resilient Multi-Hop QA
  6. 2024Uncovering Overfitting in Large Language Model Editing
  7. 2026Addressing the Reasoning Gap: Mechanistic Circuit-Based Knowledge Editing in Large Language Models
  8. 2024Time Sensitive Knowledge Editing through Efficient Finetuning