mlsanityData to 14 Oct 2026

Decoupled Smart Contract Audits: Lightweight LLM Framework via Distillation and Aggregation

arXiv 2606.03128 ↗First posted 2 Jun 2026cs.CR cs.AI cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

Smart contracts face critical security challenges that require thorough auditing in decentralized web services. While Large Language Models (LLMs) have shown promise in automated vulnerability detection, existing approaches lack severity evaluations with actionable remediation and demand unnecessarily massive computational overhead. In this study, we introduce an efficient end-to-end smart contract security audit framework utilizing lightweight, highly optimized open-source LLMs (0.6B-4B parameters). Our framework decouples comprehensive audit tasks into four interconnected components: vulnerability detection, explanation, severity classification, and remediation recommendation. To maintain high accuracy without massive parameters, we implement Rank-Stabilized Low-Rank Adapters (rsLoRA), knowledge distillation, and a custom Chain-of-Verification (CoVe) aggregation strategy to systematically screen and consolidate multiple draft responses from the model into a highly accurate audit report. Experimental results demonstrate that our lightweight pipeline consistently outperforms state-of-the-art open-source coder dense LLMs (7B to 34B parameters), achieving 98.25% accuracy in vulnerability detection and an alignment score of 0.4375 in generative explanation tasks. Furthermore, our extensive ablation studies empirically validate the superiority of our decoupled audit processes over unified prompting and uncover a novel severity centrality bias, establishing a critical benchmark for future research in LLM-assisted auditing.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 30 of its 45 references that are in the map. First posted on arXiv 2 Jun 2026.

Builds on

30 of 45 references.

References · 30

  1. 2017Attention Is All You Needcited by 60,361
  2. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  3. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
  4. 2025Qwen3 Technical Reportcited by 8,820
  5. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
  6. 2022Large Language Models are Zero-Shot Reasonerscited by 4,374
  7. 2023Code Llama: Open Foundation Models for Codecited by 2,139
  8. 2024Qwen2.5-Coder Technical Reportcited by 1,203
  9. 2024DeepSeek-Coder: When the Large Language Model Meets Programming -- The Rise of Code Intelligencecited by 1,181
  10. 2023Distilling Step-by-Step! Outperforming Larger Language Models with Less Training Data and Smaller Model Sizescited by 737
  11. 2023Chain-of-Verification Reduces Hallucination in Large Language Modelscited by 324
  12. 2023A Rank Stabilization Scaling Factor for Fine-Tuning with LoRAcited by 243
18 more
  1. 2024CodeGemma: Open Code Models Based on Gemmacited by 150
  2. 2025RewardBench 2: Advancing Reward Model Evaluationcited by 150
  3. 2023GPTScan: Detecting Logic Vulnerabilities in Smart Contracts by Combining GPT with Program Analysiscited by 65
  4. 2024LLM4Vuln: A Unified Evaluation Framework for Decoupling and Enhancing LLMs' Vulnerability Reasoningcited by 59
  5. 2024Beyond Answers: Transferring Reasoning Capabilities to Smaller LLMs Using Multi-Teacher Knowledge Distillationcited by 47
  6. 2024Combining Fine-Tuning and LLM-based Agents for Intuitive Smart Contract Auditing with Justificationscited by 41
  7. 2023Do you still need a manual smart contract audit?cited by 35
  8. 2024LMUnit: Fine-grained Evaluation with Natural Language Unit Testscited by 33
  9. 2025Atla Selene Mini: A General Purpose Evaluation Modelcited by 27
  10. 2024LLM-SmartAudit: Advanced Smart Contract Vulnerability Detectioncited by 10
  11. 2024AuditGPT: Auditing Smart Contracts with ChatGPTcited by 9
  12. 2025Decoupling Task-Solving and Output Formatting in LLM Generationcited by 9
  13. 2024Smart-LLaMA: Two-Stage Post-Training of Large Language Models for Smart Contract Vulnerability Detection and Explanationcited by 8
  14. 2025Assessing Small Language Models for Code Generation: An Empirical Study with Benchmarkscited by 8
  15. 2025Small Language Models for Efficient Agentic Tool Calling: Outperforming Large Models with Targeted Fine-tuningcited by 7
  16. 2024SmartLLMSentry: A Comprehensive LLM Based Smart Contract Vulnerability Detection Frameworkcited by 3
  17. 2025A Large-Scale Collection Of (Non-)Actionable Static Code Analysis Reportscited by 2
  18. 2025Large Language Model based Smart Contract Auditing with LLMBugScannercited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2024FTSmartAudit: A Knowledge Distillation-Enhanced Framework for Automated Smart Contract Auditing Using Fine-Tuned LLMs
  2. 2025Adaptive Plan-Execute Framework for Smart Contract Security Auditing
  3. 2025LLMs as verification oracles for Solidity
  4. 2025ParaVul: A Parallel Large Language Model and Retrieval-Augmented Framework for Smart Contract Vulnerability Detection
  5. 2025SmartLLM: Smart Contract Auditing using Custom Generative AI
  6. 2024Retrieval Augmented Generation Integrated Large Language Models in Smart Contract Vulnerability Detection
  7. 2025LISA Technical Report: An Agentic Framework for Smart Contract Auditing
  8. 2025SAEL: Leveraging Large Language Models with Adaptive Mixture-of-Experts for Smart Contract Vulnerability Detection