mlsanityData to 14 Oct 2026

Adaptive Plan-Execute Framework for Smart Contract Security Auditing

arXiv 2505.15242 ↗First posted 21 May 2025cs.CR cs.AIcited by 2

Not on the map. Why?

Abstract (arXiv)

Large Language Models (LLMs) have shown great promise in code analysis and auditing; however, they still struggle with hallucinations and limited context-aware reasoning. We introduce SmartAuditFlow, a novel Plan-Execute framework that enhances smart contract security analysis through dynamic audit planning and structured execution. Unlike conventional LLM-based auditing approaches that follow fixed workflows and predefined steps, SmartAuditFlow dynamically generates and refines audit plans based on the unique characteristics of each smart contract. It continuously adjusts its auditing strategy in response to intermediate LLM outputs and newly detected vulnerabilities, ensuring a more adaptive and precise security assessment. The framework then executes these plans step by step, applying a structured reasoning process to enhance vulnerability detection accuracy while minimizing hallucinations and false positives. To further improve audit precision, SmartAuditFlow integrates iterative prompt optimization and external knowledge sources, such as static analysis tools and Retrieval-Augmented Generation (RAG). This ensures audit decisions are contextually informed and backed by real-world security knowledge, producing comprehensive security reports. Extensive evaluations across multiple benchmarks demonstrate that SmartAuditFlow outperforms existing methods, achieving 100 percent accuracy on common and critical vulnerabilities, 41.2 percent accuracy for comprehensive coverage of known smart contract weaknesses in real-world projects, and successfully identifying all 13 tested CVEs. These results highlight SmartAuditFlow's scalability, cost-effectiveness, and superior adaptability over traditional static analysis tools and contemporary LLM-based approaches, establishing it as a robust solution for automated smart contract auditing.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 38 of its 46 references that are in the map. First posted on arXiv 21 May 2025.

Builds on

38 of 46 references.

References · 38

  1. 2017Attention Is All You Needcited by 60,361
  2. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
  3. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
  4. 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,211
  5. 2023G-Eval: NLG Evaluation using GPT-4 with Better Human Alignmentcited by 2,276
  6. 2023A Survey on Large Language Model based Autonomous Agentscited by 2,242
  7. 2023CAMEL: Communicative Agents for "Mind" Exploration of Large Language Model Societycited by 1,395
  8. 2023Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generationcited by 1,391
  9. 2023HuggingGPT: Solving AI Tasks with ChatGPT and its Friends in Hugging Facecited by 1,190
  10. 2022Large Language Models Are Human-Level Prompt Engineerscited by 1,045
  11. 2023Graph of Thoughts: Solving Elaborate Problems with Large Language Modelscited by 886
  12. 2024GSM-Symbolic: Understanding the Limitations of Mathematical Reasoning in Large Language Modelscited by 550
26 more
  1. 2024AFlow: Automating Agentic Workflow Generationcited by 432
  2. 2023Ragas: Automated Evaluation of Retrieval Augmented Generationcited by 418
  3. 2024Measuring short-form factuality in large language modelscited by 373
  4. 2023GPTScore: Evaluate as You Desirecited by 361
  5. 2024Deliberative Alignment: Reasoning Enables Safer Language Modelscited by 308
  6. 2022Large Language Models are Better Reasoners with Self-Verificationcited by 307
  7. 2024Data Interpreter: An LLM Agent For Data Sciencecited by 225
  8. 2024Chain-of-Thought Reasoning Without Promptingcited by 210
  9. 2024Evaluation of OpenAI o1: Opportunities and Challenges of AGIcited by 127
  10. 2023Black-Box Prompt Optimization: Aligning Large Language Models without Model Trainingcited by 122
  11. 2024IRIS: LLM-Assisted Static Analysis for Detecting Security Vulnerabilitiescited by 103
  12. 2023DiverseVul: A New Vulnerable Source Code Dataset for Deep Learning Based Vulnerability Detectioncited by 102
  13. 2023GPTScan: Detecting Logic Vulnerabilities in Smart Contracts by Combining GPT with Program Analysiscited by 65
  14. 2023Understanding the Effectiveness of Large Language Models in Detecting Security Vulnerabilitiescited by 59
  15. 2024LLM4Vuln: A Unified Evaluation Framework for Decoupling and Enhancing LLMs' Vulnerability Reasoningcited by 59
  16. 2023When ChatGPT Meets Smart Contract Vulnerability Detection: How Far Are We?cited by 42
  17. 2024Combining Fine-Tuning and LLM-based Agents for Intuitive Smart Contract Auditing with Justificationscited by 41
  18. 2024PropertyGPT: LLM-driven Formal Verification of Smart Contracts through Retrieval-Augmented Property Generationcited by 37
  19. 2019Empirical Review of Automated Analysis Tools on 47,587 Ethereum Smart Contractscited by 36
  20. 2023Do you still need a manual smart contract audit?cited by 35
  21. 2024Multitask-based Evaluation of Open-Source LLM on Software Vulnerabilitycited by 23
  22. 2023Exploring ChatGPT's Capabilities on Vulnerability Managementcited by 19
  23. 2020A Survey of Smart Contract Formal Specification and Verificationcited by 14
  24. 2024AuditGPT: Auditing Smart Contracts with ChatGPTcited by 9
  25. 2023Smart Contract and DeFi Security Tools: Do They Meet the Needs of Practitioners?cited by 8
  26. 2023Survey on Quality Assurance of Smart Contractscited by 4

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 1.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Decoupled Smart Contract Audits: Lightweight LLM Framework via Distillation and Aggregation
  2. 2024LLM-SmartAudit: Advanced Smart Contract Vulnerability Detection
  3. 2024FTSmartAudit: A Knowledge Distillation-Enhanced Framework for Automated Smart Contract Auditing Using Fine-Tuned LLMs
  4. 2025Large Language Model based Smart Contract Auditing with LLMBugScanner
  5. 2026On the Shoulders of Giants: Empowering Automated Smart Contract Auditing via the GiAnt Corpus ↗
  6. 2025SmartLLM: Smart Contract Auditing using Custom Generative AI
  7. 2026Demystifying Agent Skills for Smart Contract Auditing: Design, Effectiveness, Behavioral Impact
  8. 2025LISA Technical Report: An Agentic Framework for Smart Contract Auditing