LOGicalThought: Logic-Based Ontological Grounding of LLMs for High-Assurance Reasoning
On the map: LLM reasoning → Reasoning benchmarks and evaluation
Abstract (arXiv)
High-assurance reasoning, particularly in critical domains such as law and medicine, requires conclusions that are accurate, verifiable, and explicitly grounded in evidence. This reasoning relies on premises codified from rules, statutes, and contracts, inherently involving defeasible or non-monotonic logic due to numerous exceptions, where the introduction of a single fact can invalidate general rules, posing significant challenges. While large language models (LLMs) excel at processing natural language, their capabilities in standard inference tasks do not translate to the rigorous reasoning required over high-assurance text guidelines. Core reasoning challenges within such texts often manifest specific logical structures involving negation, implication, and, most critically, defeasible rules and exceptions. In this paper, we propose a novel neurosymbolically-grounded architecture called LOGicalThought (LogT) that uses an advanced logical language and reasoner in conjunction with an LLM to construct a dual symbolic graph context and logic-based context. These two context representations transform the problem from inference over long-form guidelines into a compact grounded evaluation. Evaluated on four multi-domain benchmarks against four baselines, LogT improves overall performance by 11.84% across all LLMs. Performance improves significantly across all three modes of reasoning: by up to +10.2% on negation, +13.2% on implication, and +5.5% on defeasible reasoning compared to the strongest baseline.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Placed in Reasoning benchmarks and evaluation, one of 17 directions in LLM reasoning. Builds on 18 of its 55 references that are in the map. First posted on arXiv 2 Oct 2025.
Builds on
18 of 55 references.
Closest ancestors · 1
Same direction, newest first
- 2023Logic-LM: Empowering Large Language Models with Symbolic Solvers for Faithful Logical Reasoning20 May
Other references · 17
- 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,601
- 2015A large annotated corpus for learning natural language inferencecited by 1,837
- 2024A Survey on LLM-as-a-Judgecited by 1,384
- 2023Measuring Faithfulness in Chain-of-Thought Reasoningcited by 668
- 2025Towards Reasoning Era: A Survey of Long Chain-of-Thought for Reasoning Large Language Modelscited by 381
- 2024Graph Retrieval-Augmented Generation: A Surveycited by 320
- 2023Large Language Model Guided Tree-of-Thoughtcited by 218
- 2023LooGLE: Can Long-Context Language Models Understand Long Contexts?cited by 200
- 2020What Can We Learn from Collective Human Opinions on Natural Language Inference Data?cited by 148
- 2018Dialogue Natural Language Inferencecited by 135
- 2024Simple Is Effective: The Roles of Graphs and Large Language Models in Knowledge-Graph-Based Retrieval-Augmented Generationcited by 78
- 2019Recent Advances in Natural Language Inference: A Survey of Benchmarks, Resources, and Approachescited by 64
5 more
- 2023Towards Better Chain-of-Thought Prompting Strategies: A Surveycited by 62
- 2024Beyond Chain-of-Thought: A Survey of Chain-of-X Paradigms for LLMscited by 48
- 2019Can neural networks understand monotonicity reasoning?cited by 45
- 2021Embracing Ambiguity: Shifting the Training Target of NLI Modelscited by 22
- 2021Could you give me a hint? Generating inference graphs for defeasible reasoningcited by 10
Built on by
Citing papers per year: 2025: 1; 2026: 3.
4 papers.
- 2026DeonticBench: A Benchmark for Reasoning over Rulescited by 4
- 2025GraphGhost: Tracing Structures Behind Large Language Modelscited by 0
- 2026OCCAM: Open-set Causal Concept explAnation and Ontology induction for black-box vision Modelscited by 0
- 2026Natural Language to First-Order Logic LLM-based Autoformalizationcited by 0
- 2026Natural Language to First-Order Logic LLM-based Autoformalization8 Oct 2026
- 2026OCCAM: Open-set Causal Concept explAnation and Ontology induction for black-box vision Models18 May 2026
- 2026DeonticBench: A Benchmark for Reasoning over Rules6 Apr 2026
- 2025GraphGhost: Tracing Structures Behind Large Language Models7 Oct 2025
Similar, not cited
Close in wording, no citation either way
- 2025Sound and Complete Neurosymbolic Reasoning with LLM-Grounded Interpretations
- 2024Leveraging LLMs for Hypothetical Deduction in Logical Inference: A Neuro-Symbolic Approach
- 2025Towards Robust Legal Reasoning: Harnessing Logical LLMs in Law
- 2023Towards LogiGLUE: A Brief Survey and A Benchmark for Analyzing Logical Reasoning Capabilities of Language Models
- 2025Dissecting Logical Reasoning in LLMs: A Fine-Grained Evaluation and Supervision Study
- 2026Logic-Parametric Neuro-Symbolic NLI: Controlling Logical Formalisms for Verifiable LLM Reasoning
- 2026Beyond Surface Forms: Symbolic Edits as a Test for Logical Reasoning with LLMs
- 2025VeriCoT: Neuro-symbolic Chain-of-Thought Validation via Logical Consistency Checks