Decoupling Reasoning and Knowledge Injection for In-Context Knowledge Editing
On the map: LLM reasoning → Knowledge- and tool-augmented reasoning
Abstract (arXiv)
Knowledge editing aims to efficiently update Large Language Models (LLMs) by modifying specific knowledge without retraining the entire model. Among knowledge editing approaches, in-context editing (ICE) offers a lightweight solution by injecting new knowledge directly into the input context, leaving model parameters unchanged. However, existing ICE approaches do not explicitly separate the newly injected knowledge from the model's original reasoning process. This entanglement often results in conflicts between external updates and internal parametric knowledge, undermining the consistency and accuracy of the reasoning path.In this work, we conduct preliminary experiments to examine how parametric knowledge influences reasoning path planning. We find that the model's reasoning is tightly coupled with its internal knowledge, and that naively injecting new information without adapting the reasoning path often leads to performance degradation, particularly in multi-hop tasks. To this end, we propose DecKER, a novel ICE framework that decouples reasoning from knowledge editing by generating a masked reasoning path and then resolving knowledge edits via hybrid retrieval and model-based validation. Experiments on multi-hop QA benchmarks show that DecKER significantly outperforms existing ICE methods by mitigating knowledge conflicts and preserving reasoning consistency. Our code is available at: https://github.com/bebr2/DecKER .
Key facts. Cited by 12 papers in the map (data through 14 Oct 2026). Placed in Knowledge- and tool-augmented reasoning, one of 17 directions in LLM reasoning. Builds on 12 of its 37 references that are in the map. First posted on arXiv 31 May 2025.
Builds on
12 of 37 references.
Closest ancestors · 2
Same direction, newest first
- 2024Knowledge Editing through Chain-of-Thought23 Dec
- 2024DeepEdit: Knowledge Editing as Decoding with Constraints19 Jan
Other references · 10
- 2023GPT-4 Technical Reportcited by 18,396
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
- 2023LongBench: A Bilingual, Multitask Benchmark for Long Context Understandingcited by 1,417
- 2024AlphaEdit: Null-Space Constrained Knowledge Editing for Language Modelscited by 236
- 2024jina-embeddings-v3: Multilingual Embeddings With Task LoRAcited by 141
- 2025Parametric Retrieval Augmented Generationcited by 38
- 2025RbFT: Robust Fine-tuning for Retrieval-Augmented Generation against Retrieval Defectscited by 27
- 2024Should We Really Edit Language Models? On the Evaluation of Edited Language Modelscited by 18
- 2025JuDGE: Benchmarking Judgment Document Generation for Chinese Legal Systemcited by 18
Built on by
Citing papers per year: 2025: 4; 2026: 8.
12 papers.
- 2026Skill Retrieval Augmentation for Agentic AIcited by 44
- 2025SurGE: A Benchmark and Evaluation Framework for Scientific Survey Generationcited by 16
- 2026Enhancing Judgment Document Generation via Agentic Legal Information Collection and Rubric-Guided Optimizationcited by 5
- 2025Demystifying Scientific Problem-Solving in LLMs by Probing Knowledge and Reasoningcited by 4
- 2025Dynamic and Parametric Retrieval-Augmented Generationcited by 3
- 2025Towards Unification of Hallucination Detection and Fact Verification for Large Language Modelscited by 2
- 2026BetaEdit: Null-Space Constrained Sequential Model Editingcited by 1
- 2026Dual-Layer Agentic Memory with Fast Write Routing and Slow Consolidationcited by 1
- 2026Decoupled Mixture-of-Experts for Parametric Knowledge Injectioncited by 0
- 2026Retrievable Gradients: Continual Post-Training Without Cumulative Weight Driftcited by 0
- 2026Orthogonal Representation Editing: Decoupling Semantic Entanglement in Batch Knowledge Editing of LLMscited by 0
- 2026RWGBench: Evaluating Scholarly Positioning in Related Work Generationcited by 0
- 2026Dual-Layer Agentic Memory with Fast Write Routing and Slow Consolidation23 Aug 2026
- 2026Orthogonal Representation Editing: Decoupling Semantic Entanglement in Batch Knowledge Editing of LLMs21 Jun 2026
- 2026Retrievable Gradients: Continual Post-Training Without Cumulative Weight Drift14 Jun 2026
- 2026Decoupled Mixture-of-Experts for Parametric Knowledge Injection12 Jun 2026
- 2026RWGBench: Evaluating Scholarly Positioning in Related Work Generation30 May 2026
- 2026BetaEdit: Null-Space Constrained Sequential Model Editing10 May 2026
- 2026Enhancing Judgment Document Generation via Agentic Legal Information Collection and Rubric-Guided Optimization3 May 2026
- 2026Skill Retrieval Augmentation for Agentic AI27 Apr 2026
- 2025Towards Unification of Hallucination Detection and Fact Verification for Large Language Models2 Dec 2025
- 2025Demystifying Scientific Problem-Solving in LLMs by Probing Knowledge and Reasoning26 Aug 2025
- 2025SurGE: A Benchmark and Evaluation Framework for Scientific Survey Generation21 Aug 2025
- 2025Dynamic and Parametric Retrieval-Augmented Generation7 Jun 2025
Similar, not cited
Close in wording, no citation either way
- 2024Enhancing Multi-hop Reasoning through Knowledge Erasure in Large Language Model Editing
- 2025Benchmarking and Rethinking Knowledge Editing for Large Language Models
- 2025Knowledge Updating? No More Model Editing! Just Selective Contextual Reasoning
- 2025CaKE: Circuit-aware Editing Enables Generalizable Knowledge Learners
- 2025Robust Knowledge Editing via Explicit Reasoning Chains for Distractor-Resilient Multi-Hop QA
- 2024Uncovering Overfitting in Large Language Model Editing
- 2026Addressing the Reasoning Gap: Mechanistic Circuit-Based Knowledge Editing in Large Language Models
- 2024Time Sensitive Knowledge Editing through Efficient Finetuning