SmartBugs: A Framework to Analyze Solidity Smart Contracts
Not on the map. Why?
Abstract (arXiv)
Over the last few years, there has been substantial research on automated analysis, testing, and debugging of Ethereum smart contracts. However, it is not trivial to compare and reproduce that research. To address this, we present SmartBugs, an extensible and easy-to-use execution framework that simplifies the execution of analysis tools on smart contracts written in Solidity, the primary language used in Ethereum. SmartBugs is currently distributed with support for 10 tools and two datasets of Solidity contracts. The first dataset can be used to evaluate the precision of analysis tools, as it contains 143 annotated vulnerable contracts with 208 tagged vulnerabilities. The second dataset contains 47,518 unique contracts collected through Etherscan. We discuss how SmartBugs supported the largest experimental setup to date both in the number of tools and in execution time. Moreover, we show how it enables easy integration and comparison of analysis tools by presenting a new extension to the tool SmartCheck that improves substantially the detection of vulnerabilities related to the DASP10 categories Bad Randomness, Time Manipulation, and Access Control (identified vulnerabilities increased from 11% to 24%).
Key facts. Cited by 18 papers in the map (data through 13 Oct 2026). First posted on arXiv 8 Jul 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2022: 1; 2023: 3; 2024: 4; 2025: 8; 2026: 2.
18 papers.
Sort:
By area:
- 2025LLMs in Software Security: A Survey of Vulnerability Detection Techniques and Insightscited by 44
- 2024Smart-LLaMA: Two-Stage Post-Training of Large Language Models for Smart Contract Vulnerability Detection and Explanationcited by 8
- 2025Vulnerability Detection: From Formal Verification to Large Language Models and Hybrid Approaches: A Comprehensive Overviewcited by 7
- 2025Smart-LLaMA-DPO: Reinforced Large Language Model for Explainable Smart Contract Vulnerability Detectioncited by 7
- 2025Logic Meets Magic: LLMs Cracking Smart Contract Vulnerabilitiescited by 5
- 2022MANDO: Multi-Level Heterogeneous Graph Embeddings for Fine-Grained Detection of Smart Contract Vulnerabilitiescited by 4
- 2023VulnSense: Efficient Vulnerability Detection in Ethereum Smart Contracts by Multimodal Learning with Graph Neural Network and Language Modelcited by 4
- 2025Prompt to Pwn: Automated Exploit Generation for Smart Contractscited by 4
- 2024Detecting Buggy Contracts via Smart Testingcited by 3
- 2023Usenix'23 Extended Version: Smart Learning to Find Dumb Contractscited by 2
- 2024Vulnerability Detection in Ethereum Smart Contracts via Machine Learning: A Qualitative Analysiscited by 2
- 2024Detection Made Easy: Potentials of Large Language Models for Solidity Vulnerabilitiescited by 2
6 more
- 2025SAEL: Leveraging Large Language Models with Adaptive Mixture-of-Experts for Smart Contract Vulnerability Detectioncited by 2
- 2023Schooling to Exploit Foolish Contractscited by 0
- 2025Towards Automated Smart Contract Generation: Evaluation, Benchmarking, and Retrieval-Augmented Repaircited by 0
- 2025Towards Understanding Deep Learning Model in Image Recognition via Coverage Testcited by 0
- 2026Towards Compositional Generalization in LLMs for Smart Contract Security: A Case Study on Reentrancy Vulnerabilitiescited by 0
- 2026Benchmarking LLM-Based Static Analysis for Secure Smart Contract Development: Reliability, Limitations, and Potential Hybrid Solutionscited by 0
- 2026Benchmarking LLM-Based Static Analysis for Secure Smart Contract Development: Reliability, Limitations, and Potential Hybrid Solutions11 May 2026
- 2026Towards Compositional Generalization in LLMs for Smart Contract Security: A Case Study on Reentrancy Vulnerabilities11 Jan 2026
- 2025Prompt to Pwn: Automated Exploit Generation for Smart Contracts2 Aug 2025
- 2025SAEL: Leveraging Large Language Models with Adaptive Mixture-of-Experts for Smart Contract Vulnerability Detection30 Jul 2025
- 2025Smart-LLaMA-DPO: Reinforced Large Language Model for Explainable Smart Contract Vulnerability Detection23 Jun 2025
- 2025Towards Understanding Deep Learning Model in Image Recognition via Coverage Test12 May 2025
- 2025Vulnerability Detection: From Formal Verification to Large Language Models and Hybrid Approaches: A Comprehensive Overview13 Mar 2025
- 2025Towards Automated Smart Contract Generation: Evaluation, Benchmarking, and Retrieval-Augmented Repair3 Mar 2025
- 2025LLMs in Software Security: A Survey of Vulnerability Detection Techniques and Insights10 Feb 2025
- 2025Logic Meets Magic: LLMs Cracking Smart Contract Vulnerabilities13 Jan 2025
- 2024Smart-LLaMA: Two-Stage Post-Training of Large Language Models for Smart Contract Vulnerability Detection and Explanation9 Nov 2024
- 2024Detection Made Easy: Potentials of Large Language Models for Solidity Vulnerabilities15 Sep 2024
6 more
- 2024Detecting Buggy Contracts via Smart Testing6 Sep 2024
- 2024Vulnerability Detection in Ethereum Smart Contracts via Machine Learning: A Qualitative Analysis26 Jul 2024
- 2023VulnSense: Efficient Vulnerability Detection in Ethereum Smart Contracts by Multimodal Learning with Graph Neural Network and Language Model15 Sep 2023
- 2023Schooling to Exploit Foolish Contracts21 Apr 2023
- 2023Usenix'23 Extended Version: Smart Learning to Find Dumb Contracts21 Apr 2023
- 2022MANDO: Multi-Level Heterogeneous Graph Embeddings for Fine-Grained Detection of Smart Contract Vulnerabilities28 Aug 2022
- 2025LLMs in Software Security: A Survey of Vulnerability Detection Techniques and Insightscited by 44
- 2024Smart-LLaMA: Two-Stage Post-Training of Large Language Models for Smart Contract Vulnerability Detection and Explanationcited by 8
- 2025Vulnerability Detection: From Formal Verification to Large Language Models and Hybrid Approaches: A Comprehensive Overviewcited by 7
- 2025Logic Meets Magic: LLMs Cracking Smart Contract Vulnerabilitiescited by 5
- 2022MANDO: Multi-Level Heterogeneous Graph Embeddings for Fine-Grained Detection of Smart Contract Vulnerabilitiescited by 4
- 2023VulnSense: Efficient Vulnerability Detection in Ethereum Smart Contracts by Multimodal Learning with Graph Neural Network and Language Modelcited by 4
- 2025Prompt to Pwn: Automated Exploit Generation for Smart Contractscited by 4
- 2024Detecting Buggy Contracts via Smart Testingcited by 3
- 2023Usenix'23 Extended Version: Smart Learning to Find Dumb Contractscited by 2
- 2024Vulnerability Detection in Ethereum Smart Contracts via Machine Learning: A Qualitative Analysiscited by 2
- 2024Detection Made Easy: Potentials of Large Language Models for Solidity Vulnerabilitiescited by 2
- 2023Schooling to Exploit Foolish Contractscited by 0
12 most cited of 16 All 16 (JSON)
- 2026Benchmarking LLM-Based Static Analysis for Secure Smart Contract Development: Reliability, Limitations, and Potential Hybrid Solutions11 May 2026
- 2026Towards Compositional Generalization in LLMs for Smart Contract Security: A Case Study on Reentrancy Vulnerabilities11 Jan 2026
- 2025Prompt to Pwn: Automated Exploit Generation for Smart Contracts2 Aug 2025
- 2025Towards Understanding Deep Learning Model in Image Recognition via Coverage Test12 May 2025
- 2025Vulnerability Detection: From Formal Verification to Large Language Models and Hybrid Approaches: A Comprehensive Overview13 Mar 2025
- 2025Towards Automated Smart Contract Generation: Evaluation, Benchmarking, and Retrieval-Augmented Repair3 Mar 2025
- 2025LLMs in Software Security: A Survey of Vulnerability Detection Techniques and Insights10 Feb 2025
- 2025Logic Meets Magic: LLMs Cracking Smart Contract Vulnerabilities13 Jan 2025
- 2024Smart-LLaMA: Two-Stage Post-Training of Large Language Models for Smart Contract Vulnerability Detection and Explanation9 Nov 2024
- 2024Detection Made Easy: Potentials of Large Language Models for Solidity Vulnerabilities15 Sep 2024
- 2024Detecting Buggy Contracts via Smart Testing6 Sep 2024
- 2024Vulnerability Detection in Ethereum Smart Contracts via Machine Learning: A Qualitative Analysis26 Jul 2024
12 newest of 16 All 16 (JSON)