mlsanityData to 7 Oct 2026

Efficacy of Various Large Language Models in Generating Smart Contracts

arXiv 2407.11019 ↗First posted 28 Jun 2024cs.SE cs.AI cs.CLcited by 4

Not on the map. Why?

Abstract (arXiv)

This study analyzes the application of code-generating Large Language Models in the creation of immutable Solidity smart contracts on the Ethereum Blockchain. Other works have previously analyzed Artificial Intelligence code generation abilities. This paper aims to expand this to a larger scope to include programs where security and efficiency are of utmost priority such as smart contracts. The hypothesis leading into the study was that LLMs in general would have difficulty in rigorously implementing security details in the code, which was shown through our results, but surprisingly generally succeeded in many common types of contracts. We also discovered a novel way of generating smart contracts through new prompting strategies.

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 25 of its 44 references that are in the map. First posted on arXiv 28 Jun 2024.

Builds on

25 of 44 references.

References · 25

  1. 2020Language Models are Few-Shot Learnerscited by 32,199
  2. 2021Evaluating Large Language Models Trained on Codecited by 8,053
  3. 2023PaLM 2 Technical Reportcited by 1,154
  4. 2014Neural Turing Machinescited by 630
  5. 2021Asleep at the Keyboard? Assessing the Security of GitHub Copilot's Code Contributionscited by 417
  6. 2016DeepCoder: Learning to Write Programscited by 145
  7. 2014Learning to Executecited by 105
  8. 2023Learning Performance-Improving Code Editscited by 103
  9. 2015Neural Programmer-Interpreterscited by 96
  10. 2017Abstract Syntax Networks for Code Generation and Semantic Parsingcited by 92
  11. 2016Neuro-Symbolic Program Synthesiscited by 84
  12. 2023Exploring the Benefits of Training Expert Language Models over Instruction Tuningcited by 80
13 more
  1. 2019GNN-FiLM: Graph Neural Networks with Feature-wise Linear Modulationcited by 75
  2. 2016Latent Predictor Networks for Code Generationcited by 73
  3. 2023On the Robustness of Code Generation Techniques: An Empirical Study on GitHub Copilotcited by 64
  4. 2023Large Language Model-Powered Smart Contract Vulnerability Detection: New Perspectivescited by 48
  5. 2024Combining Fine-Tuning and LLM-based Agents for Intuitive Smart Contract Auditing with Justificationscited by 41
  6. 2014Structured Generative Models of Natural Source Codecited by 19
  7. 2023The Hitchhiker's Guide to Program Analysis: A Journey with Large Language Modelscited by 18
  8. 2018NAPS: Natural Program Synthesis Datasetcited by 14
  9. 2024LLbezpeky: Leveraging Large Language Models for Vulnerability Detectioncited by 13
  10. 2022Benchmarking Language Models for Code Syntax Understandingcited by 8
  11. 2023Automatic Smart Contract Comment Generation via Large Language Models and In-Context Learningcited by 6
  12. 2021Recent Developments in Program Synthesis with Evolutionary Algorithmscited by 5
  13. 2023An Empirical Study of AI-based Smart Contract Creationcited by 4

Built on by

Cited by year

Citing papers per year: 2025: 4.

4 papers.

  1. 2025Guiding LLM-based Smart Contract Generation with Finite State Machinecited by 5
  2. 2025Giving AI Agents Access to Cryptocurrency and Smart Contracts Creates New Vectors of AI Harmcited by 3
  3. 2025DMind Benchmark: Toward a Holistic Assessment of LLM Capabilities across the Web3 Domaincited by 1
  4. 2025On LLM-Assisted Generation of Smart Contracts from Business Processescited by 1