Where Reasoning Breaks: Logic-Aware Path Selection by Controlling Logical Connectives in LLMs Reasoning Chains
On the map: LLM reasoning → Test-time compute and efficient thinking
Abstract (arXiv)
While LLMs demonstrate impressive reasoning capabilities, they remain fragile in multi-step logical deduction, where a single transition error can propagate through the entire reasoning chain, leading to unstable performance. In this work, we identify logical connectives as primary points of this structural fragility. Through empirical analysis, we show that connective tokens function as high entropy forking points, at which models frequently struggle to determine the correct logical direction. Motivated by this observation, we hypothesize that intervening in logical connective selection can guide LLMs toward more correct logical direction, thereby improving the overall reasoning chain. To validate this hypothesis, we propose a multi-layered framework that intervenes specifically at these logic-critical junctions in the reasoning process. Our framework includes (1) Gradient-based Logical Steering to guide LLMs internal representations towards valid reasoning subspaces, (2) Localized Branching to resolve ambiguity via targeted look-ahead search, and (3) Targeted Transition Preference Optimization, a surgical reinforcement learning objective that selectively optimizes single-token preferences at logical pivots. Crucially, by concentrating intervention solely on logic-critical transitions, our framework achieves a favorable accuracy--efficiency trade-off compared to global inference time scaling methods like beam search and self-consistency.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Test-time compute and efficient thinking, one of 17 directions in LLM reasoning. Builds on 21 of its 38 references that are in the map. First posted on arXiv 22 Apr 2026.
Builds on
21 of 38 references.
Closest ancestors · 2
Same direction, newest first
- 2025Deep Think with Confidence21 Aug
- 2024Critical Tokens Matter: Token-Level Contrastive Estimation Enhances LLM's Reasoning Capability29 Nov
Other references · 19
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,601
- 2025Gemma 3 Technical Reportcited by 1,686
- 2023Accelerating Large Language Model Decoding with Speculative Samplingcited by 975
- 2024Phi-4 Technical Reportcited by 675
- 2025Beyond the 80/20 Rule: High-Entropy Minority Tokens Drive Effective Reinforcement Learning for LLM Reasoningcited by 540
- 2025Towards Reasoning Era: A Survey of Long Chain-of-Thought for Reasoning Large Language Modelscited by 381
- 2022Language Models Are Greedy Reasoners: A Systematic Formal Analysis of Chain-of-Thoughtcited by 334
- 2022Selection-Inference: Exploiting Large Language Models for Interpretable Logical Reasoningcited by 331
- 2025OpenThoughts: Data Recipes for Reasoning Modelscited by 287
- 2025ZebraLogic: On the Scaling Limits of LLMs for Logical Reasoningcited by 186
- 2022Faithful Reasoning Using Large Language Modelscited by 130
7 more
- 2025Thought Anchors: Which LLM Reasoning Steps Matter?cited by 126
- 2023Logical Reasoning over Natural Language as Knowledge Representation: A Surveycited by 32
- 2021RuleBert: Teaching Soft Rules to Pre-trained Language Modelscited by 25
- 2025Safe: Enhancing Mathematical Reasoning in Large Language Models via Retrospective Step-aware Formal Verificationcited by 16
- 2024Boosting Logical Fallacy Reasoning in LLMs via Logical Structure Treecited by 8
- 2025Are language models aware of the road not taken? Token-level uncertainty and hidden state dynamicscited by 8
- 2024Automated Theorem Provers Help Improve Large Language Model Reasoningcited by 7
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026LLM Reasoning as Trajectories: Step-Specific Representation Geometry and Correctness Signals
- 2026Logical Phase Transitions: Understanding Collapse in LLM Logical Reasoning
- 2026Discovering a Shared Logical Subspace: Steering LLM Logical Reasoning via Alignment of Natural-Language and Symbolic Views
- 2026Agentic Chain-of-Thought Steering for Efficient and Controllable LLM Reasoning
- 2026When Do LLMs Reason? A Dynamical Systems View via Entropy Phase Transitions
- 2025Not All Tokens Matter: Towards Efficient LLM Reasoning via Token Significance in Reinforcement Learning
- 2025Don't Think Longer, Think Wisely: Optimizing Thinking Dynamics for Large Reasoning Models
- 2025LogiDynamics: Unraveling the Dynamics of Inductive, Abductive and Deductive Logical Inferences in LLM Reasoning