mlsanityData to 14 Oct 2026

Reforming the Mechanism: Editing Reasoning Patterns in LLMs with Circuit Reshaping

arXiv 2603.06923 ↗First posted 6 Mar 2026cs.CLcited by 1

On the map: LLM reasoning → Reasoning benchmarks and evaluation

Abstract (arXiv)

Large language models (LLMs) often exhibit flawed reasoning ability that undermines reliability. Existing approaches to improving reasoning typically treat it as a general and monolithic skill, applying broad training which is inefficient and unable to target specific reasoning errors. We introduce Reasoning Editing, a paradigm for selectively modifying specific reasoning patterns in LLMs while preserving other reasoning pathways. This task presents a fundamental trade-off between Generality, the ability of an edit to generalize across different tasks sharing the same reasoning pattern, and Locality, the ability to preserve other reasoning capabilities. Through systematic investigation, we uncover the Circuit-Interference Law: Edit interference between reasoning patterns is proportional to the overlap of their neural circuits. Guided by this principle, we propose REdit, the first framework to actively reshape neural circuits before editing, thereby modulating interference between reasoning patterns and mitigating the trade-off. REdit integrates three components: (i) Contrastive Circuit Reshaping, which directly addresses the generality-locality trade-off by disentangling overlapping circuits; (ii) Meta-Contrastive Learning, which extends transferability to novel reasoning patterns; and (iii) Dual-Level Protection, which preserves preexisting abilities by constraining reshaping update directions and regularizing task-level predictions. Extensive experiments with Qwen-2.5-3B on propositional logic reasoning tasks across three difficulty levels demonstrate that REdit consistently achieves superior generality and locality compared to baselines, with additional validation in mathematics showing broader potential. Our code is available at https://github.com/LzyFischer/REdit.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Reasoning benchmarks and evaluation, one of 17 directions in LLM reasoning. Builds on 80 of its 92 references that are in the map. First posted on arXiv 6 Mar 2026.

Builds on

80 of 92 references.

Closest ancestors · 13

Same direction, newest first

  1. 2025Qwen3 Technical Report14 May
  2. 2025LLM Post-Training: A Deep Dive into Reasoning Large Language Models28 Feb
  3. 2025From System 1 to System 2: A Survey of Reasoning Large Language Models24 Feb
  4. 2024Can Large Language Models Act as Symbolic Reasoners?28 Oct
  5. 2024The Role of Deductive and Inductive Reasoning in Large Language Models3 Oct
  6. 2024Disentangling Logic: The Role of Context in Large Language Model Reasoning Capabilities4 Jun
  7. 2024Unveiling the Impact of Coding Data Instruction Fine-Tuning on Large Language Models Reasoning30 May
  8. 2024LogicBench: Towards Systematic Evaluation of Logical Reasoning Ability of Large Language Models23 Apr
  9. 2024LogicAsker: Evaluating and Improving the Logical Reasoning Ability of Large Language Models1 Jan
  10. 2023DyVal: Dynamic Evaluation of Large Language Models for Reasoning Tasks29 Sep
  11. 2023Can ChatGPT Defend its Belief in Truth? Evaluating LLM Reasoning via Debate22 May
  12. 2023Natural Language Reasoning, A Survey26 Mar
1 more
  1. 2022Towards Reasoning in Large Language Models: A Survey20 Dec

Other references · 67

  1. 2018Representation Learning with Contrastive Predictive Codingcited by 7,777
  2. 2022Locating and Editing Factual Associations in GPTcited by 2,691
  3. 2023A Survey of Large Language Modelscited by 2,576
  4. 2013Sinkhorn Distances: Lightspeed Computation of Optimal Transportation Distancescited by 2,316
  5. 2022Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language modelscited by 1,998
  6. 2023A Survey on Hallucination in Large Language Models: Principles, Taxonomy, Challenges, and Open Questionscited by 1,601
  7. 2022Mass-Editing Memory in a Transformercited by 1,001
  8. 2025Does Reinforcement Learning Really Incentivize Reasoning Capacity in LLMs Beyond the Base Model?cited by 982
  9. 2021Editing Factual Knowledge in Language Modelscited by 553
  10. 2021Fast Model Editing at Scalecited by 498
  11. 2022Memory-Based Model Editing at Scalecited by 447
  12. 2024Improve Mathematical Reasoning in Language Models by Automated Process Supervisioncited by 441
38 more
  1. 2025Towards Reasoning Era: A Survey of Long Chain-of-Thought for Reasoning Large Language Modelscited by 384
  2. 2024Large Language Models for Mathematical Reasoning: Progresses and Challengescited by 284
  3. 2025SWE-RL: Advancing LLM Reasoning via Reinforcement Learning on Open Software Evolutioncited by 263
  4. 2023Does Localization Inform Editing? Surprising Differences in Causality-Based Localization vs. Knowledge Editing in Language Modelscited by 243
  5. 2024ReFT: Reasoning with Reinforced Fine-Tuningcited by 239
  6. 2024AlphaEdit: Null-Space Constrained Knowledge Editing for Language Modelscited by 236
  7. 2023Attribution Patching Outperforms Automated Circuit Discoverycited by 209
  8. 2024When Scaling Meets LLM Finetuning: The Effect of Data, Model and Finetuning Methodcited by 204
  9. 2022Will we run out of data? Limits of LLM scaling based on human-generated datacited by 195
  10. 2023Knowledge Editing for Large Language Models: A Surveycited by 194
  11. 2025ThinkPrune: Pruning Long Chain-of-Thought of LLMs via Reinforcement Learningcited by 192
  12. 2024Do Large Language Models Latently Perform Multi-Hop Reasoning?cited by 169
  13. 2024Teaching Large Language Models to Reason with Reinforcement Learningcited by 160
  14. 2024Rethinking the Bounds of LLM Reasoning: Are Multi-Agent Discussions the Key?cited by 159
  15. 2025From LLM Reasoning to Autonomous AI Agents: A Comprehensive Reviewcited by 149
  16. 2025Med-R1: Reinforcement Learning for Generalizable Medical Reasoning in Vision-Language Modelscited by 144
  17. 2024Exploring the Reasoning Abilities of Multimodal Large Language Models (MLLMs): A Comprehensive Survey on Emerging Trends in Multimodal Reasoningcited by 136
  18. 2024Forest-of-Thought: Scaling Test-Time Compute for Enhancing LLM Reasoningcited by 110
  19. 2023Are Emergent Abilities in Large Language Models just In-Context Learning?cited by 109
  20. 2024GLoRe: When, Where, and How to Improve LLM Reasoning via Global and Local Refinementscited by 103
  21. 2024LLM as a Mastermind: A Survey of Strategic Reasoning with Large Language Modelscited by 99
  22. 2024WISE: Rethinking the Knowledge Memory for Lifelong Model Editing of Large Language Modelscited by 92
  23. 2024Formal Mathematical Reasoning: A New Frontier in AIcited by 81
  24. 2023Massive Editing for Large Language Models via Meta Learningcited by 63
  25. 2024(A)I Am Not a Lawyer, But...: Engaging Legal Experts towards Responsible LLM Policies for Legal Advicecited by 63
  26. 2024Knowledge Circuits in Pretrained Transformerscited by 60
  27. 2023A Short Survey of Viewing Large Language Models in Legal Aspectcited by 52
  28. 2025Stepwise Perplexity-Guided Refinement for Efficient Chain-of-Thought Reasoning in Large Language Modelscited by 51
  29. 2022TEMPERA: Test-Time Prompting via Reinforcement Learningcited by 50
  30. 2023Unveiling the Pitfalls of Knowledge Editing for Large Language Modelscited by 43
  31. 2024Learning to Edit: Aligning LLMs with Knowledge Editingcited by 43
  32. 2024WilKE: Wise-Layer Knowledge Editor for Lifelong Knowledge Editingcited by 40
  33. 2023Seeing is Believing: Brain-Inspired Modular Training for Mechanistic Interpretabilitycited by 38
  34. 2024Locate-then-edit for Multi-hop Factual Recall under Knowledge Editingcited by 37
  35. 2024In-Context Editing: Learning Knowledge from Self-Induced Distributionscited by 34
  36. 2024Causal Inference with Large Language Model: A Surveycited by 32
  37. 2021Self-Supervised Video Representation Learning with Meta-Contrastive Networkcited by 28
  38. 2023Mathematical Language Models: A Surveycited by 24

50 most cited of 67 All 67 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2025CaKE: Circuit-aware Editing Enables Generalizable Knowledge Learners
  2. 2026Addressing the Reasoning Gap: Mechanistic Circuit-Based Knowledge Editing in Large Language Models
  3. 2026Identifying and Transferring Reasoning-Critical Neurons: Improving LLM Inference Reliability via Activation Steering
  4. 2024Enhancing Multi-hop Reasoning through Knowledge Erasure in Large Language Model Editing
  5. 2025From Long to Short: LLMs Excel at Trimming Own Reasoning Chains
  6. 2025"Well, Keep Thinking": Enhancing LLM Reasoning with Adaptive Injection Decoding
  7. 2024Understanding Language Model Circuits through Knowledge Editing
  8. 2024Reasoning Circuits in Language Models: A Mechanistic Interpretation of Syllogistic Inference