mlsanityData to 7 Oct 2026

Forethought: Verifiable Reasoning from Neurosymbolic Primitive Programming

arXiv 2607.04096 ↗First posted 5 Jul 2026cs.AIcited by 0

On the map: LLM reasoning → Reasoning benchmarks and evaluation

also in 1 more
Abstract (arXiv)

Current agentic workflows usually involve decomposing user requests into sequences of tool calls with correctly resolved parameters, the results of which are processed through reasoning traces in the language model's context window. The prevailing route to improve such reasoning is test-time scaling, which trains models to search over long chains of thought; but the resulting capability is entangled in model weights, is not verifiable step-by-step, and is costly at inference. We present Forethought, a neurosymbolic reasoning system that instead treats reasoning as an explicit, verifiable program, that builds from a library of symbolic and neural primitives which are composed through a domain-specific language. The result are reasoning programs, which are concrete representations of the model's work, and as such can be inspected and modified before deployment. Instantiated as a tool-calling execution kernel and evaluated across five benchmarks, Forethought improves base-model accuracy by about 30% relative and outperforms vanilla prompting, reinforcement learning scaffolds, and prompt-evolution methods, enabling small models to match or exceed frontier models capabilities. In a direct comparison, a non-reasoning model augmented with Forethought competes with a dedicated reasoning model while requiring roughly three orders of magnitude less post-training investment, and remains model-agnostic and auditable.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Reasoning benchmarks and evaluation, one of 17 directions in LLM reasoning. Builds on 14 of its 24 references that are in the map. First posted on arXiv 5 Jul 2026.

Builds on

14 of 24 references.

Closest ancestors · 3

Same direction, newest first

  1. 2024DeepSeek-V3 Technical Report27 Dec
  2. 2024Proof of Thought : Neurosymbolic Program Synthesis allows Robust and Interpretable Reasoning25 Sep
  3. 2023Logic-LM: Empowering Large Language Models with Symbolic Solvers for Faithful Logical Reasoning20 May

Other references · 11

  1. 2025Gemma 3 Technical Reportcited by 1,686
  2. 2024τ-bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domainscited by 1,280
  3. 2023DSPy: Compiling Declarative Language Model Calls into Self-Improving Pipelinescited by 803
  4. 2025GEPA: Reflective Prompt Evolution Can Outperform Reinforcement Learningcited by 449
  5. 2025Recursive Language Modelscited by 94
  6. 2025LiveMCPBench: Can Agents Navigate an Ocean of MCP Tools?cited by 47
  7. 2026MCP-Atlas: A Large-Scale Benchmark for Tool-Use Competency with Real MCP Serverscited by 46
  8. 2026SEVerA: Verified Synthesis of Self-Evolving Agentscited by 6
  9. 2025NeSyPr: Neurosymbolic Proceduralization For Efficient Embodied Reasoningcited by 5
  10. 2026Composing Verifiable Conceptual Models via Building Blocks: Towards Design-Time Verification of Agentic AI Workflowscited by 2
  11. 2026Decidable By Construction: Design-Time Verification for Truly Fearless Systemscited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2023Scallop: A Language for Neurosymbolic Programming
  2. 2023LINC: A Neurosymbolic Approach for Logical Reasoning by Combining Language Models with First-Order Logic Provers
  3. 2025Right for the Right Reasons: Avoiding Reasoning Shortcuts via Prototypical Neurosymbolic AI
  4. 2026NeuroProlog: Multi-Task Fine-Tuning for Neurosymbolic Mathematical Reasoning via the Cocktail Effect
  5. 2025A Comparative Study of Neurosymbolic AI Approaches to Interpretable Logical Reasoning
  6. 2025Current Practices for Building LLM-Powered Reasoning Tools Are Ad Hoc -- and We Can Do Better
  7. 2025CoreThink: A Symbolic Reasoning Layer to reason over Long Horizon Tasks with LLMs
  8. 2024Reliable Reasoning Beyond Natural Language