Conflict-Aware Fusion: Mitigating Logic Inertia in Large Language Models via Structured Cognitive Priors
Not on the map. Why?
Abstract (arXiv)
Large language models (LLMs) achieve high accuracy on many reasoning benchmarks but remain brittle under structural perturbations of rule-based systems. We introduce a diagnostic framework with four stress tests -- redundant vs. essential rule deletion, contradictory-rule injection, logic-preserving rewrites, and multi-law stacking -- and use it to expose Logic Inertia: the tendency of generative LLMs (Qwen2/3, TinyLlama, GPT-4o, Gemma-3-4B-IT) and the encoder-only BERT baseline to persist along learned deductive trajectories under inconsistent premises. The collapse is sharp: untreated baselines fall from accuracy 1.00 on the base task to 0.00 on contradiction injection (instance-level exact match), and GPT-4o resolves only 56.0% of contradiction cases. We propose Conflict-Aware Fusion, a four-stage training pipeline that enforces verification-before-deduction as a learned structural prior: (i) SFT establishes the verification preamble; (ii) DPO sharpens the halt-on-contradiction decision boundary; (iii) Logical Invariance REgularisation (LIRE) penalises divergence between logically equivalent rule formulations via symmetric KL; (iv) Reinforcement Learning from Verification Feedback (RLVF) uses a symbolic forward-chaining engine as a deterministic oracle reward, jointly optimising invariance and sensitivity. The pipeline saturates all four primary stress tests for both 1.5B and 8B backbones. We further validate a Phase 2 extension that replaces the propositional oracle with a Lean 4 kernel, attaining 99.0% kernel agreement on the 105 classically-derivable (T) questions within a stratified 187-question Lean-translated sample (overall 71.7% across both polarities), providing a sound upgrade path to formally verified RL training. Code and benchmark: https://github.com/14H034160212/lemo
Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Builds on 39 of its 52 references that are in the map. First posted on arXiv 6 Dec 2025.
Builds on
39 of 52 references.
References · 39
- 2017Proximal Policy Optimization Algorithmscited by 15,215
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 8,065
- 2023Let's Verify Step by Stepcited by 3,789
- 2017A Broad-Coverage Challenge Corpus for Sentence Understanding through Inferencecited by 2,682
- 2022Emergent Abilities of Large Language Modelscited by 2,512
- 2023Large Language Models Cannot Self-Correct Reasoning Yetcited by 1,017
- 2023Are Emergent Abilities of Large Language Models a Mirage?cited by 523
- 2023LeanDojo: Theorem Proving with Retrieval-Augmented Language Modelscited by 427
- 2023The Reversal Curse: LLMs trained on "A is B" fail to learn "B is A"cited by 407
- 2020Generative Language Modeling for Automated Theorem Provingcited by 388
27 more
- 2024Deliberative Alignment: Reasoning Enables Safer Language Modelscited by 308
- 2020Transformers as Soft Reasoners over Languagecited by 270
- 2023ARES: An Automated Evaluation Framework for Retrieval-Augmented Generation Systemscited by 265
- 2024DeepSeek-Prover-V1.5: Harnessing Proof Assistant Feedback for Reinforcement Learning and Monte-Carlo Tree Searchcited by 197
- 2020Logic-Guided Data Augmentation and Regularization for Consistent Question Answeringcited by 78
- 2019A Logic-Driven Framework for Consistency of Neural Modelscited by 64
- 2023Large Language Models Are Not Strong Abstract Reasonerscited by 53
- 2025Empowering LLMs with Logical Reasoning: A Comprehensive Surveycited by 51
- 2021Logic-Driven Context Extension and Data Augmentation for Logical Reasoning of Textcited by 46
- 2023Benchmarks for Automated Commonsense Reasoning: A Surveycited by 40
- 2025Leanabell-Prover-V2: Verifier-integrated Reasoning for Formal Theorem Proving via Reinforcement Learningcited by 27
- 2024Deliberate Reasoning in Language Models as Structure-Aware Planning with an Accurate World Modelcited by 23
- 2022AbductionRules: Training Transformers to Explain Unexpected Inputscited by 17
- 2022Multi-Step Deductive Reasoning Over Natural Language: An Empirical Study on Out-of-Distribution Generalisationcited by 15
- 2025Don't Let It Hallucinate: Premise Verification via Retrieval-Augmented Logical Reasoningcited by 15
- 2025CodeCrash: Exposing LLM Fragility to Misleading Natural Language in Code Reasoningcited by 14
- 2023Mathematics, word problems, common sense, and artificial intelligencecited by 12
- 2023Abstract Meaning Representation-Based Logic-Driven Data Augmentation for Logical Reasoningcited by 11
- 2025VeriCoT: Neuro-symbolic Chain-of-Thought Validation via Logical Consistency Checkscited by 11
- 2023Assessing and Enhancing the Robustness of Large Language Models with Task Structure Variations for Logical Reasoningcited by 10
- 2025Inverse IFEval: Can LLMs Unlearn Stubborn Training Conventions to Follow Real Instructions?cited by 10
- 2025MultiHoax: A Dataset of Multi-hop False-Premise Questionscited by 9
- 2025Don't Take the Premise for Granted: Evaluating the Premise Critique Ability of Large Language Modelscited by 8
- 2025Causal Consistency Regularization: Training Verifiably Sensitive Reasoning in Large Language Modelscited by 8
- 2024ChatLogic: Integrating Logic Programming with Large Language Models for Multi-Step Reasoningcited by 7
- 2024RULEBREAKERS: Challenging LLMs at the Crossroads between Formal Logic and Human-like Reasoningcited by 4
- 2024Testing GPT-4-o1-preview on math and science problems: A follow-up studycited by 4
Built on by
Citing papers per year: 2026: 5.
5 papers.
- 2026DIVE: Unlocking Self-Improvement in Frozen Language Models Through Diversity-Driven Skill Evolutioncited by 5
- 2026SciTrue: Reliable Scientific Claim Validation with Frontier and Open Language Models at the NTCIR SciClaimEval Taskcited by 1
- 2026Nous: An Attempt to Extract and Inject the Cognition Behind Prediction-Market Behaviorcited by 0
- 2026Beyond Surface Forms: Symbolic Edits as a Test for Logical Reasoning with LLMscited by 0
- 2026Can Language Models Learn to Reject Their Own Bad Reasoning Steps?cited by 0
- 2026Can Language Models Learn to Reject Their Own Bad Reasoning Steps?5 Oct 2026
- 2026SciTrue: Reliable Scientific Claim Validation with Frontier and Open Language Models at the NTCIR SciClaimEval Task1 Sep 2026
- 2026Beyond Surface Forms: Symbolic Edits as a Test for Logical Reasoning with LLMs31 Aug 2026
- 2026DIVE: Unlocking Self-Improvement in Frozen Language Models Through Diversity-Driven Skill Evolution12 Aug 2026
- 2026Nous: An Attempt to Extract and Inject the Cognition Behind Prediction-Market Behavior11 Jun 2026
Similar, not cited
Close in wording, no citation either way
- 2026Compliance vs. Sensibility: On the Reasoning Controllability in Large Language Models
- 2025seqBench: A Tunable Benchmark to Quantify Sequential Reasoning Limits of LLMs
- 2025Cross-Lingual Consistency: A Novel Inference Framework for Advancing Reasoning in Large Language Models
- 2026Towards a Mechanistic Understanding of Propositional Logical Reasoning in Large Language Models
- 2025Advancing Reasoning in Large Language Models: Promising Methods and Approaches
- 2026Diagnosing Knowledge Conflict in Multimodal Long-Chain Reasoning
- 2026Dissecting Failure Dynamics in Large Language Model Reasoning
- 2026Enhancing reasoning accuracy in large language models during inference time