Theorem-Grounded Execution Ontologies for Interpretable Machine Reasoning
On the map: LLM reasoning → Reasoning benchmarks and evaluation
Abstract (arXiv)
Large language models have achieved impressive performance on reasoning tasks spanning mathematics, science, programming, and commonsense inference. Despite these advances, their reasoning processes remain largely latent, making them difficult to interpret, verify, replay, debug, and transfer across domains. Existing approaches such as chain-of-thought, tree-of-thoughts, graph-of-thoughts, and tool-augmented reasoning expose intermediate reasoning artifacts but typically lack explicit execution semantics, formal state representations, and verifiable reasoning structures. We introduce Theorem-Grounded Execution Ontologies (TGEO), a framework that models reasoning as an executable state-transition process rather than a sequence of generated tokens. Given an input problem, TGEO identifies relevant theorem families, binds the problem to a domain ontology, discovers semantic objects, instantiates states and operators, constructs predicates and contracts, and synthesizes an executable reasoning graph. The resulting graph provides an interpretable, replayable, and auditable representation of reasoning in which every state transition, operator application, and validation step is explicitly represented. TGEO integrates five architectural components: (1) theorem-grounded reasoning priors, (2) executable ontologies, (3) operator-mediated state transitions, (4) predicate and contract-based execution validation, and (5) architectural auditing and failure localization. We evaluate TGEO on theorem-intensive reasoning tasks derived from mathematical benchmark domains and a curated Golden Execution Suite. Our findings demonstrate the value of executable reasoning representations for interpretable, verifiable, and reproducible AI reasoning systems.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Reasoning benchmarks and evaluation, one of 17 directions in LLM reasoning. Builds on 15 of its 53 references that are in the map. First posted on arXiv 14 Jun 2026.
Builds on
15 of 53 references.
Closest ancestors · 1
Same direction, newest first
- 2022PAL: Program-aided Language Models18 Nov
Other references · 14
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2023GPT-4 Technical Reportcited by 18,132
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2021Training Verifiers to Solve Math Word Problemscited by 9,743
- 2021Evaluating Large Language Models Trained on Codecited by 8,053
- 2020Measuring Massive Multitask Language Understandingcited by 7,768
- 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,203
- 2022Large Language Models are Zero-Shot Reasonerscited by 4,323
- 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,072
- 2021Program Synthesis with Large Language Modelscited by 3,509
- 2023GPQA: A Graduate-Level Google-Proof Q&A Benchmarkcited by 2,748
- 2023Sparks of Artificial General Intelligence: Early experiments with GPT-4cited by 2,579
2 more
- 2018World Modelscited by 1,444
- 2019On the Measure of Intelligencecited by 129
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Understanding Benchmark Language Under Weakened Formal Semantics
- 2026ReasonOps: A Unified Operational Paradigm for Trustworthy Verified LLM Reasoning
- 2025Beyond Semantics: The Unreasonable Effectiveness of Reasonless Intermediate Tokens
- 2025Reasoning Systems as Structured Processes: Foundations, Failures, and Formal Criteria
- 2026Large Language Model for OWL Proofs
- 2026Self-Supervised Theorem Discovery in a Formal Axiomatic System
- 2026Beyond Surface Forms: Symbolic Edits as a Test for Logical Reasoning with LLMs
- 2026From Chains to DAGs: Probing the Graph Structure of Reasoning in LLMs