Agentic Model Checking
On the map: LLM agents and tool use → Software engineering coding agents
Abstract (arXiv)
Verifying LLM-generated systems code is hard: bugs are prevalent, formal specifications are missing, and safety contracts are encoded implicitly at call sites rather than enforced at function boundaries. We propose agentic model checking, a paradigm that couples LLM agents with a bounded model checking backend under the principle agents propose, solvers verify: agents handle tasks requiring semantic judgment (spec inference, check selection, counterexample classification, refinement proposal) while BMC discharges every soundness-relevant decision. The paradigm rests on three commitments. Specifications are inferred top-down from caller context in a restricted DSL that translates deterministically into the backend's assume/assert primitives, with optional functional-correctness clauses lifting verification from panic-freeness to behavioural faithfulness. Verification is compositional: each function is checked in isolation against its spec with callees replaced by postcondition-constrained stubs, so per-query cost scales with a single function's state space and refinements propagate automatically to callers. Counterexamples are not bug reports: they pass through a validation pipeline (reachability, callee feasibility, dynamic replay, realism audit) that distinguishes active in-tree crashes from latent public-API failures, while modelling artifacts drive a refinement loop rather than being suppressed. We instantiate the approach in BMC-Agent and evaluate it on LLM-generated kernel and compiler code in C and Rust alongside mature OSS-Fuzz-hardened libraries, confirming real defects, producing bounded clean verifications on heavily-fuzzed surfaces, and establishing functional equivalence on selected algorithmic functions.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Software engineering coding agents, one of 16 directions in LLM agents and tool use. Builds on 4 of its 17 references that are in the map. First posted on arXiv 20 May 2026.
Builds on
4 of 17 references.
Closest ancestors · 1
Same direction, newest first
Other references · 3
- 2024Enchanting Program Specification Synthesis by Large Language Models using Static Analysis and Program Verificationcited by 58
- 2023Lemur: Integrating Large Language Models in Automated Program Verificationcited by 49
- 2024Enhancing Automated Loop Invariant Generation for Complex Programs with Large Language Modelscited by 7
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Verification as an Architectural Layer for LLM Agents: A V-Model Design, and a Pilot Study of Its Deterministic Core
- 2026Schwarz: Solver-Aware Agentic Program Verification
- 2026Formal Verification of Agentic Systems over Operational Data
- 2026Automating Formal Verification with Agent-Guided Tree Search
- 2026Methods for Formal Verification of Agent Skills: Three Layers Toward a Mechanically Checkable Capability-Containment Proof
- 2026LLM-as-Code: Agentic Programming for Agent Harness
- 2026Verified Tool Calls Improve LLM Agent Reliability Under Non-Atomic Failures
- 2026SWE-Proof: Can Language Models Resolve Real-World Issues with Machine-Checked Proofs?