mlsanityData to 14 Oct 2026

Natural Language based Specification and Verification

arXiv 2605.11315 ↗First posted 11 May 2026cs.SE cs.AI cs.CRcited by 0

Not on the map. Why?

Abstract (arXiv)

Recent frontier large language models (LLMs) have shown strong performance in identifying security vulnerabilities in large, mature open-source systems. As LLM-generated code becomes increasingly common, a natural goal is to prevent such models from producing vulnerable implementations in the first place. Formal verification offers a principled route to this objective, but existing verification pipelines typically require specifications written in rigid formal languages. Prior work has explored using LLMs to synthesize such specifications, with limited success. In this paper, we investigate a different approach: using LLMs both to generate specifications and to verify implementations compositionally when the specifications are expressed in natural language. Our preliminary results suggest that this approach is promising.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 9 of its 26 references that are in the map. First posted on arXiv 11 May 2026.

Builds on

9 of 26 references.

References · 9

  1. 2024LongBench v2: Towards Deeper Understanding and Reasoning on Realistic Long-context Multitaskscited by 379
  2. 2024Enchanting Program Specification Synthesis by Large Language Models using Static Analysis and Program Verificationcited by 58
  3. 2023Can Large Language Models Transform Natural Language Intent into Formal Method Postconditions?cited by 57
  4. 2024SpecGen: Automated Generation of Formal Program Specifications via Large Language Modelscited by 53
  5. 2023Lemur: Integrating Large Language Models in Automated Program Verificationcited by 49
  6. 2023Ranking LLM-Generated Loop Invariants for Program Verificationcited by 33
  7. 2024Laurel: Unblocking Automated Verification with Large Language Modelscited by 11
  8. 2026DafnyPro: LLM-Assisted Automated Verification for Dafny Programscited by 11
  9. 2025Local Success Does Not Compose: Benchmarking Large Language Models for Compositional Formal Verificationcited by 6

Built on by

Not cited yet.