mlsanityData to 14 Oct 2026

Current Practices for Building LLM-Powered Reasoning Tools Are Ad Hoc -- and We Can Do Better

arXiv 2507.05886 ↗First posted 8 Jul 2025cs.AI cs.PLcited by 1

On the map: LLM reasoning → Reasoning benchmarks and evaluation

Abstract (arXiv)

There is growing excitement about building software verifiers, synthesizers, and other Automated Reasoning (AR) tools by combining traditional symbolic algorithms and Large Language Models (LLMs). Unfortunately, the current practice for constructing such neurosymbolic AR systems is an ad hoc programming model that does not have the strong guarantees of traditional symbolic algorithms, nor a deep enough synchronization of neural networks and symbolic reasoning to unlock the full potential of LLM-powered reasoning. I propose Neurosymbolic Transition Systems as a principled computational model that can underlie infrastructure for building neurosymbolic AR tools. In this model, symbolic state is paired with intuition, and state transitions operate over symbols and intuition in parallel. I argue why this new paradigm can scale logical reasoning beyond current capabilities while retaining the strong guarantees of symbolic algorithms, and I sketch out how the computational model I propose can be reified in a logic programming language.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Reasoning benchmarks and evaluation, one of 17 directions in LLM reasoning. Builds on 1 of its 34 references that are in the map. First posted on arXiv 8 Jul 2025.

Builds on

1 of 34 references.

References · 1

  1. 2023GPT-4 Technical Reportcited by 18,396

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2023LINC: A Neurosymbolic Approach for Logical Reasoning by Combining Language Models with First-Order Logic Provers
  2. 2025Neuro-Symbolic Artificial Intelligence: Towards Improving the Reasoning Abilities of Large Language Models
  3. 2024Leveraging LLMs for Hypothetical Deduction in Logical Inference: A Neuro-Symbolic Approach
  4. 2025A Comparative Study of Neurosymbolic AI Approaches to Interpretable Logical Reasoning
  5. 2026Pushing the Boundaries of Natural Reasoning: Interleaved Bonus from Formal-Logic Verification
  6. 2025Intermediate Languages Matter: Formal Languages and LLMs affect Neurosymbolic Reasoning
  7. 2024Reliable Reasoning Beyond Natural Language
  8. 2023Scallop: A Language for Neurosymbolic Programming