AutoICE: Automatically Synthesizing Verifiable C Code via LLM-driven Evolution
Not on the map. Why?
Abstract (arXiv)
Automatically synthesizing verifiable code from natural language requirements ensures software correctness and reliability while significantly lowering the barrier to adopting the techniques of formal methods. With the rise of large language models (LLMs), long-standing efforts at autoformalization have gained new momentum. However, existing approaches suffer from severe syntactic and semantic errors due to the scarcity of domain-specific pre-training corpora and often fail to formalize implicit knowledge effectively. In this paper, we propose AutoICE, an LLM-driven evolutionary search for synthesizing verifiable C code. It introduces the diverse individual initialization and the collaborative crossover to enable diverse iterative updates, thereby mitigating error propagation inherent in single-agent iterations. Besides, it employs the self-reflective mutation to facilitate the discovery of implicit knowledge. Evaluation results demonstrate the effectiveness of AutoICE: it successfully verifies 90.36% of code, outperforming the state-of-the-art (SOTA) approach. Besides, on a developer-friendly dataset variant, AutoICE achieves a 88.33% verification success rate, significantly surpassing the 65% success rate of the SOTA approach.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 47 of its 95 references that are in the map. First posted on arXiv 8 Dec 2025.
Builds on
47 of 95 references.
References · 47
- 2017Attention Is All You Needcited by 59,932
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2025Qwen3 Technical Reportcited by 8,195
- 2021Evaluating Large Language Models Trained on Codecited by 8,053
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
- 2024Qwen2.5 Technical Reportcited by 4,713
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
- 2023A Survey on Evaluation of Large Language Modelscited by 1,227
- 2024Qwen2.5-Coder Technical Reportcited by 1,151
- 2024Tulu 3: Pushing Frontiers in Open Language Model Post-Trainingcited by 988
- 2023Enhancing Chat Language Models by Scaling High-quality Instructional Conversationscited by 825
35 more
- 2021CodeXGLUE: A Machine Learning Benchmark Dataset for Code Understanding and Generationcited by 732
- 2021Prompt Programming for Large Language Models: Beyond the Few-Shot Paradigmcited by 599
- 2023LeanDojo: Theorem Proving with Retrieval-Augmented Language Modelscited by 414
- 2022PromptSource: An Integrated Development Environment and Repository for Natural Language Promptscited by 288
- 2024ReEvo: Large Language Models as Hyper-Heuristics with Reflective Evolutioncited by 266
- 2024Evolution of Heuristics: Towards Efficient Automatic Algorithm Design Using Large Language Modelcited by 258
- 2022Autoformalization with Large Language Modelscited by 252
- 2024TextGrad: Automatic "Differentiation" via Textcited by 250
- 2022Making Large Language Models Better Reasoners with Step-Aware Verifiercited by 231
- 2021Design Guidelines for Prompt Engineering Text-to-Image Generative Modelscited by 216
- 2023Take a Step Back: Evoking Reasoning via Abstraction in Large Language Modelscited by 157
- 2023Baldur: Whole-Proof Generation and Repair with Large Language Modelscited by 118
- 2022Prompting Is Programming: A Query Language for Large Language Modelscited by 110
- 2024HSEvo: Elevating Automatic Heuristic Design with Diversity-Driven Harmony Search and Genetic Algorithm Using LLMscited by 68
- 2024Towards AI-Assisted Synthesis of Verified Dafny Methodscited by 58
- 2023nl2spec: Interactively Translating Unstructured Natural Language to Temporal Logics with Large Language Modelscited by 57
- 2024Enchanting Program Specification Synthesis by Large Language Models using Static Analysis and Program Verificationcited by 55
- 2023TIM: Teaching Large Language Models to Translate with Comparisoncited by 50
- 2023Lemur: Integrating Large Language Models in Automated Program Verificationcited by 49
- 2022How to Prompt? Opportunities and Challenges of Zero- and Few-Shot Learning for Human-AI Interaction in Creative Applications of Generative Modelscited by 43
- 2024Evolving Code with A Large Language Modelcited by 42
- 2023LLMs for Science: Usage for Code Generation and Data Analysiscited by 34
- 2024FVEL: Interactive Formal Verification Environment with Large Language Models via Theorem Provingcited by 22
- 2019CLN2INV: Learning Loop Invariants with Continuous Logic Networkscited by 20
- 2022MetaPrompting: Learning to Learn Better Promptscited by 19
- 2020Learning Nonlinear Loop Invariants with Gated Continuous Logic Networks (Extended Version)cited by 17
- 2025From Informal to Formal -- Incorporating and Evaluating LLMs on Natural Language Requirements to Verifiable Formal Proofscited by 17
- 2024VeCoGen: Automating Generation of Formally Verified C Code with Large Language Modelscited by 10
- 2024Guiding Enumerative Program Synthesis with Large Language Modelscited by 9
- 2022The Infinite Index: Information Retrieval on Generative Text-To-Image Modelscited by 6
- 2015An experimental Study using ACSL and Frama-C to formulate and verify Low-Level Requirements from a DO-178C compliant Avionics Projectcited by 4
- 2025Requirements Development and Formalization for Reliable Code Generation: A Multi-Agent Visioncited by 3
- 2022More Programming Than Programming: Teaching Formal Methods in a Software Engineering Programmecited by 2
- 2023Case studies of development of verified programs with Dafny for accessibility assessmentcited by 2
- 2025Enhancing LLM-based Specification Generation via Program Slicing and Logical Deletioncited by 2
Built on by
Not cited yet.