Optimizing AI-Assisted Code Generation
Not on the map. Why?
Abstract (arXiv)
In recent years, the rise of AI-assisted code-generation tools has significantly transformed software development. While code generators have mainly been used to support conventional software development, their use will be extended to powerful and secure AI systems. Systems capable of generating code, such as ChatGPT, OpenAI Codex, GitHub Copilot, and AlphaCode, take advantage of advances in machine learning (ML) and natural language processing (NLP) enabled by large language models (LLMs). However, it must be borne in mind that these models work probabilistically, which means that although they can generate complex code from natural language input, there is no guarantee for the functionality and security of the generated code. However, to fully exploit the considerable potential of this technology, the security, reliability, functionality, and quality of the generated code must be guaranteed. This paper examines the implementation of these goals to date and explores strategies to optimize them. In addition, we explore how these systems can be optimized to create safe, high-performance, and executable artificial intelligence (AI) models, and consider how to improve their accessibility to make AI development more inclusive and equitable.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 39 of its 92 references that are in the map. First posted on arXiv 14 Dec 2024.
Builds on
39 of 92 references.
References · 39
- 2017Attention Is All You Needcited by 60,361
- 2021Evaluating Large Language Models Trained on Codecited by 8,320
- 2021Prefix-Tuning: Optimizing Continuous Prompts for Generationcited by 3,915
- 2021Program Synthesis with Large Language Modelscited by 3,637
- 2016Membership Inference Attacks against Machine Learning Modelscited by 2,281
- 2022Competition-Level Code Generation with AlphaCodecited by 1,462
- 2023CAMEL: Communicative Agents for "Mind" Exploration of Large Language Model Societycited by 1,395
- 2020CodeBERT: A Pre-Trained Model for Programming and Natural Languagescited by 1,310
- 2017BadNets: Identifying Vulnerabilities in the Machine Learning Model Supply Chaincited by 1,106
- 2021CodeT5: Identifier-aware Unified Pre-trained Encoder-Decoder Models for Code Understanding and Generationcited by 906
- 2022CodeGen: An Open Large Language Model for Code with Multi-Turn Program Synthesiscited by 885
- 2015The Limitations of Deep Learning in Adversarial Settingscited by 790
27 more
- 2021CodeXGLUE: A Machine Learning Benchmark Dataset for Code Understanding and Generationcited by 744
- 2022GPT-NeoX-20B: An Open-Source Autoregressive Language Modelcited by 713
- 2020GraphCodeBERT: Pre-training Code Representations with Data Flowcited by 609
- 2022InCoder: A Generative Model for Code Infilling and Synthesiscited by 498
- 2021Asleep at the Keyboard? Assessing the Security of GitHub Copilot's Code Contributionscited by 431
- 2022A Systematic Evaluation of Large Language Models of Codecited by 363
- 2022CodeRL: Mastering Code Generation through Pretrained Models and Deep Reinforcement Learningcited by 358
- 2022Do Users Write More Insecure Code with AI Assistants?cited by 192
- 2023Large Language Models for Code: Security Hardening and Adversarial Testingcited by 155
- 2023From ChatGPT to ThreatGPT: Impact of Generative AI in Cybersecurity and Privacycited by 143
- 2021Examining Zero-Shot Vulnerability Repair with Large Language Modelscited by 105
- 2022Lost at C: A User Study on the Security Implications of Large Language Model Code Assistantscited by 91
- 2023On the Robustness of Code Generation Techniques: An Empirical Study on GitHub Copilotcited by 64
- 2020Kaggle forecasting competitions: An overlooked learning opportunitycited by 56
- 2023Adversarial Attacks and Defenses in Large Language Models: Old and New Threatscited by 49
- 2022What is it like to program with artificial intelligence?cited by 39
- 2023Natural Language Generation and Understanding of Big Code for AI-Assisted Programming: A Reviewcited by 32
- 2024Using AI Assistants in Software Development: A Qualitative Study on Security Practices and Concernscited by 28
- 2024MegaVul: A C/C++ Vulnerability Dataset with Comprehensive Code Representationcited by 27
- 2021Shellcode_IA32: A Dataset for Automatic Shellcode Generationcited by 16
- 2021EVIL: Exploiting Software via Natural Languagecited by 12
- 2021Becoming Good at AI for Goodcited by 8
- 2024DeVAIC: A Tool for Security Assessment of AI-generated Codecited by 8
- 2024DeepCode AI Fix: Fixing Security Vulnerabilities with Large Language Modelscited by 7
- 2024Poisoning Programs by Un-Repairing Code: Security Concerns of AI-generated Codecited by 6
- 2024Enhancing Security of AI-Based Code Synthesis with GitHub Copilot via Cheap and Efficient Prompt-Engineeringcited by 6
- 2019Machine Teaching by Domain Experts: Towards More Humane,Inclusive, and Intelligent Machine Learning Systemscited by 5
Built on by
Citing papers per year: 2026: 2.
2 papers.