mlsanityData to 14 Oct 2026

Neuro-Symbolic Software Verification: Hyper-charging Local Language Models with Symbolic Reasoning at Scale

arXiv 2606.16886 ↗First posted 15 Jun 2026cs.SEcited by 0

On the map: LLM reasoning → Reasoning benchmarks and evaluation

Abstract (arXiv)

Loop invariant synthesis remains a central and pivotal bottleneck in formal software verification. Recent LLM-based Neuro-Symbolic tools have achieved impressive solve rates. However, these tools rely on proprietary, often expensive cloud APIs, which constitute a hurdle for privacy-sensitive industrial deployments where the source code cannot leave the organisation or where cost is a factor. We present VerIbmc, a neuro-symbolic pipeline that pairs symbolic invariant generation with locally deployable open-weight language models with the ESBMC verification tool. Our pipeline combines a deterministic symbolic invariant synthesis phase with an iterative LLM refinement loop driven by structured verifier feedback. In addition, we provide two types of pipelines that differ in their prompting strategy: Chain-of-Thought vs. Tree-of-Thought. We conduct an extensive experimental evaluation with five open-weight models (ranging from 7B to 120B parameters) across five benchmark families comprising of 520 problems (499 after excluding 21 with unavoidable overflow). Overall, the best single configuration (GPT-OSS-120B) solves 431 of 499 problems (86.4%). Additionally, on the four benchmark suites shared with the strongest cloud-API tools, VerIbmc is competitive running only on a single local machine. The evaluation shows symbolic invariant synthesis solves 75 problems without any LLM call and yields up to +35 additional problems for the weakest model. Importantly, all inference runs entirely on a single local machine using open-weight models -- no cloud API or proprietary model is required. Overall, we demonstrate that a neuro-symbolic approach based on LLMs can be used effectively for invariant synthesis in a privacy-preserving and energy-efficient manner, without having to resort to expensive proprietary frontier models locked behind APIs.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Reasoning benchmarks and evaluation, one of 17 directions in LLM reasoning. Builds on 15 of its 86 references that are in the map. First posted on arXiv 15 Jun 2026.

Builds on

15 of 86 references.

Closest ancestors · 1

Same direction, newest first

  1. 2023LLaMA: Open and Efficient Foundation Language Models27 Feb

Other references · 14

  1. 2023GPT-4 Technical Reportcited by 18,396
  2. 2024The Llama 3 Herd of Modelscited by 14,715
  3. 2021Evaluating Large Language Models Trained on Codecited by 8,320
  4. 2020Scaling Laws for Neural Language Modelscited by 6,586
  5. 2024Qwen2.5 Technical Reportcited by 4,942
  6. 2023Qwen Technical Reportcited by 3,344
  7. 2022Training Compute-Optimal Large Language Modelscited by 3,019
  8. 2025gpt-oss-120b & gpt-oss-20b Model Cardcited by 1,386
  9. 2024DeepSeek-Coder: When the Large Language Model Meets Programming -- The Rise of Code Intelligencecited by 1,181
  10. 2023Gemini: A Family of Highly Capable Multimodal Modelscited by 872
  11. 2023Efficient Guided Generation for Large Language Modelscited by 200
  12. 2023Finding Inductive Loop Invariants using Large Language Modelscited by 36
2 more
  1. 2025The 2025 Foundation Model Transparency Indexcited by 11
  2. 2026Synthesizing Inductive Invariants for Distributed Protocols via IC3 and Large Language Modelscited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025A Neurosymbolic Approach to Loop Invariant Generation via Weakest Precondition Reasoning
  2. 2026Neuro-Symbolic Proof Generation for Scaling Systems Software Verification
  3. 2025Loop Invariant Generation: A Hybrid Framework of Reasoning optimised LLMs and SMT Solvers
  4. 2026Natural Synthesis: Outperforming Reactive Synthesis Tools with Large Reasoning Models
  5. 2026Resource-Aware Neuro-Symbolic Reasoning for Local Small Language Models
  6. 2026Pushing the Boundaries of Natural Reasoning: Interleaved Bonus from Formal-Logic Verification
  7. 2026Neuro-Formal Verification: Agentic Language-Agnostic Formal Program Reasoning
  8. 2026ReaComp: Compiling LLM Reasoning into Symbolic Solvers for Efficient Program Synthesis