EaTVul: ChatGPT-based Evasion Attack Against Software Vulnerability Detection
Not on the map. Why?
Abstract (arXiv)
Recently, deep learning has demonstrated promising results in enhancing the accuracy of vulnerability detection and identifying vulnerabilities in software. However, these techniques are still vulnerable to attacks. Adversarial examples can exploit vulnerabilities within deep neural networks, posing a significant threat to system security. This study showcases the susceptibility of deep learning models to adversarial attacks, which can achieve 100% attack success rate (refer to Table 5). The proposed method, EaTVul, encompasses six stages: identification of important samples using support vector machines, identification of important features using the attention mechanism, generation of adversarial data based on these features using ChatGPT, preparation of an adversarial attack pool, selection of seed data using a fuzzy genetic algorithm, and the execution of an evasion attack. Extensive experiments demonstrate the effectiveness of EaTVul, achieving an attack success rate of more than 83% when the snippet size is greater than 2. Furthermore, in most cases with a snippet size of 4, EaTVul achieves a 100% attack success rate. The findings of this research emphasize the necessity of robust defenses against adversarial attacks in software vulnerability detection.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 25 of its 58 references that are in the map. First posted on arXiv 27 Jul 2024.
Builds on
25 of 58 references.
References · 25
- 2017Attention Is All You Needcited by 59,932
- 2019Is BERT Really Robust? A Strong Baseline for Natural Language Attack on Text Classification and Entailmentcited by 663
- 2020BERT-ATTACK: Adversarial Attack Against BERT Using BERTcited by 488
- 2019Fooling LIME and SHAP: Adversarial Attacks on Post hoc Explanation Methodscited by 440
- 2020BAE: BERT-based Adversarial Examples for Text Classificationcited by 316
- 2020You Autocomplete Me: Poisoning Vulnerabilities in Neural Code Completioncited by 112
- 2021Examining Zero-Shot Vulnerability Repair with Large Language Modelscited by 105
- 2020OpenAttack: An Open-source Textual Adversarial Attack Toolkitcited by 84
- 2017Generating Adversarial Malware Examples for Black-Box Attacks Based on GANcited by 74
- 2022Natural Attack for Pre-trained Models of Codecited by 72
- 2019Adversarial Examples for Models of Codecited by 61
- 2018Adversarial Malware Binaries: Evading Deep Learning for Malware Detection in Executablescited by 60
13 more
- 2020Adversarial Machine Learning in Image Classification: A Survey Towards the Defender's Perspectivecited by 58
- 2020Semantic Robustness of Models of Source Codecited by 43
- 2018Greedy Attack and Gumbel Attack: Generating Adversarial Examples for Discrete Datacited by 37
- 2022LineVD: Statement-level Vulnerability Detection using Graph Neural Networkscited by 35
- 2020Backdoors in Neural Models of Source Codecited by 27
- 2021Adversarial Robustness of Deep Code Comment Generationcited by 22
- 2022Query-Efficient and Scalable Black-Box Adversarial Attacks on Discrete Sequential Data via Bayesian Optimizationcited by 22
- 2021Generating Adversarial Computer Programs using Optimized Obfuscationscited by 20
- 2021A Survey on Data-driven Software Vulnerability Assessment and Prioritizationcited by 18
- 2020Arms Race in Adversarial Malware Detection: A Surveycited by 16
- 2020ConAML: Constrained Adversarial Machine Learning for Cyber-Physical Systemscited by 13
- 2023Transformer-based Vulnerability Detection in Code at EditTime: Zero-shot, Few-shot, or Fine-tuning?cited by 13
- 2021Asteria: Deep Learning-based AST-Encoding for Cross-platform Binary Code Similarity Detectioncited by 8
Built on by
Citing papers per year: 2025: 2.
2 papers.