Semiotic logical hexagon theory for LLM logical reasoning
On the map: LLM reasoning → Reasoning benchmarks and evaluation
Abstract (arXiv)
Large language models (LLMs) have become powerful tools for language understanding and logical reasoning. However, they still make mistakes when a problem requires both understanding meaning and following logic. A key reason is that natural-language statements often carry implicit semantic relations before any formal reasoning begins. If these hidden meanings are not properly organized, the model may reach incorrect conclusions even when the subsequent reasoning process appears logically valid. Existing methods improve reasoning through decomposition, symbolic translation, external solvers, or self-verification, but pay comparatively less attention to the semantic structure on which reasoning depends. In this paper, we further investigate how semantic organization influences logical reasoning in LLMs. To this end, we propose HexLogicAgent, a framework that first organizes the meaning of natural-language statements and then guides logical reasoning through structured verification. In our investigation, we also make two observations. First, incomplete semantic representations, rather than deductive inference itself, are a major source of logical reasoning failures in LLMs. Second, explicitly modeling the complete structure of semantic opposition substantially delays the degradation of reasoning performance as logical complexity increases. Experiments on challenging logical reasoning benchmarks demonstrate that HexLogicAgent consistently improves reasoning reliability across multiple LLMs. The core idea is supported by a logical hexagon theory, which explains why a complete structure of opposing meanings is necessary for reliable reasoning.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Reasoning benchmarks and evaluation, one of 17 directions in LLM reasoning. Builds on 40 of its 51 references that are in the map. First posted on arXiv 24 Jul 2026.
Builds on
40 of 51 references.
Closest ancestors · 13
Same direction, newest first
- 2026Logical Phase Transitions: Understanding Collapse in LLM Logical Reasoning6 Jan
- 2025Semantic-Aware Logical Reasoning via a Semiotic Framework29 Sep
- 2025Are LLMs Stable Formal Logic Translators in Logical Reasoning Across Linguistically Diversified Texts?5 Jun
- 2025Large Language Models Meet Symbolic Provers for Logical Reasoning Evaluation10 Feb
- 2024Aristotle: Mastering Logical Reasoning with A Logic-Complete Decompose-Search-Resolve Framework22 Dec
- 2024Exploring the Role of Reasoning Structures for Constructing Proofs in Multi-Step Natural Language Reasoning with Large Language Models11 Oct
- 2024Divide and Translate: Compositional First-Order Logic Translation and Verification for Complex Logical Reasoning10 Oct
- 2023DetermLR: Augmenting LLM-based Logical Reasoning from Indeterminacy to Determinacy28 Oct
- 2023Cumulative Reasoning with Large Language Models8 Aug
- 2023Logic-LM: Empowering Large Language Models with Symbolic Solvers for Faithful Logical Reasoning20 May
- 2023Explicit Planning Helps Language Models in Logical Reasoning28 Mar
- 2022Language Models Are Greedy Reasoners: A Systematic Formal Analysis of Chain-of-Thought3 Oct
1 more
Other references · 27
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
- 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,708
- 2024GPT-4o System Cardcited by 4,588
- 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,211
- 2024GSM-Symbolic: Understanding the Limitations of Mathematical Reasoning in Large Language Modelscited by 550
- 2020ProofWriter: Generating Implications, Proofs, and Abductive Statements over Natural Languagecited by 324
- 2023OpenAGI: When LLM Meets Domain Expertscited by 197
- 2025Qwen2.5-1M Technical Reportcited by 164
- 2023MathCoder: Seamless Code Integration in LLMs for Enhanced Mathematical Reasoningcited by 156
- 2024Faithful Logical Reasoning via Symbolic Chain-of-Thoughtcited by 100
- 2025Efficient Reasoning Models: A Surveycited by 95
15 more
- 2023Harnessing the Power of Large Language Models for Natural Language to First-Order Logic Translationcited by 59
- 2022Formal Specifications from Natural Languagecited by 33
- 2024Coupled Mamba: Enhanced Multi-modal Fusion with Coupled State Space Modelcited by 31
- 2025Why Prompt Design Matters and Works: A Complexity Analysis of Prompt Search Space in LLMscited by 31
- 2024CANDLE: Iterative Conceptualization and Instantiation Distillation from Large Language Models for Commonsense Reasoningcited by 28
- 2024TnT-LLM: Text Mining at Scale with Large Language Modelscited by 26
- 2024Properties and Challenges of LLM-Generated Explanationscited by 24
- 2024Deep SE(3)-Equivariant Geometric Reasoning for Precise Placement Taskscited by 19
- 2025MAGIC-VQA: Multimodal And Grounded Inference with Commonsense Knowledge for Visual Question Answeringcited by 19
- 2025GA-S3: Comprehensive Social Network Simulation with Group Agentscited by 19
- 2025LoRA-Mixer: Coordinate Modular LoRA Experts Through Serial Attention Routingcited by 18
- 2026Double: Breaking the Acceleration Limit via Double Retrieval Speculative Parallelismcited by 16
- 2026Coupling Macro Dynamics and Micro States for Long-Horizon Social Simulationcited by 15
- 2026Seeing Further and Wider: Joint Spatio-Temporal Enlargement for Micro-Video Popularity Predictioncited by 5
- 2026HotComment: A Benchmark for Evaluating Popularity of Online Commentscited by 3
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025Dissecting Logical Reasoning in LLMs: A Fine-Grained Evaluation and Supervision Study
- 2024A Closer Look at Logical Reasoning with LLMs: The Choice of Tool Matters
- 2023Are Large Language Models Really Good Logical Reasoners? A Comprehensive Evaluation and Beyond
- 2026Beyond Surface Forms: Symbolic Edits as a Test for Logical Reasoning with LLMs
- 2025JustLogic: A Comprehensive Benchmark for Evaluating Deductive Reasoning in Large Language Models
- 2025Logical Reasoning in Large Language Models: A Survey
- 2023Towards LogiGLUE: A Brief Survey and A Benchmark for Analyzing Logical Reasoning Capabilities of Language Models
- 2025Flying Pigs, FaR and Beyond: Evaluating LLM Reasoning in Counterfactual Worlds