On using distributed representations of source code for the detection of C security vulnerabilities
Not on the map. Why?
Abstract (arXiv)
This paper presents an evaluation of the code representation model Code2vec when trained on the task of detecting security vulnerabilities in C source code. We leverage the open-source library astminer to extract path-contexts from the abstract syntax trees of a corpus of labeled C functions. Code2vec is trained on the resulting path-contexts with the task of classifying a function as vulnerable or non-vulnerable. Using the CodeXGLUE benchmark, we show that the accuracy of Code2vec for this task is comparable to simple transformer-based methods such as pre-trained RoBERTa, and outperforms more naive NLP-based methods. We achieved an accuracy of 61.43% while maintaining low computational requirements relative to larger models.
Key facts. Cited by 10 papers in the map (data through 7 Oct 2026). Builds on 16 of its 28 references that are in the map. First posted on arXiv 1 Jun 2021.
Builds on
16 of 28 references.
References · 16
- 2017Attention Is All You Needcited by 59,932
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
- 2020CodeBERT: A Pre-Trained Model for Programming and Natural Languagescited by 1,286
- 2014Convolutional Neural Networks for Sentence Classificationcited by 1,124
- 2021CodeXGLUE: A Machine Learning Benchmark Dataset for Code Understanding and Generationcited by 732
- 2021Unified Pre-training for Program Understanding and Generationcited by 361
- 2019Devign: Effective Vulnerability Identification by Learning Comprehensive Program Semantics via Graph Neural Networkscited by 266
- 2018code2vec: Learning Distributed Representations of Codecited by 249
- 2020Deep Learning based Vulnerability Detection: Are We There Yet?cited by 142
- 2018Automated Vulnerability Detection in Source Code Using Deep Representation Learningcited by 114
- 2018SySeVR: A Framework for Using Deep Learning to Detect Software Vulnerabilitiescited by 91
4 more
- 2019Low-Memory Neural Network Training: A Technical Reportcited by 56
- 2018Automated software vulnerability detection with machine learningcited by 34
- 2020Exploring Software Naturalness through Neural Language Modelscited by 32
- 2018A General Path-Based Representation for Predicting Program Propertiescited by 28
Built on by
Citing papers per year: 2021: 1; 2022: 4; 2023: 1; 2024: 3; 2025: 1.
10 papers.
- 2021SynCoBERT: Syntax-Guided Multi-Modal Contrastive Pre-Training for Code Representationcited by 63
- 2022VulBERTa: Simplified Source Code Pre-Training for Vulnerability Detectioncited by 51
- 2022An Empirical Study of Deep Learning Models for Vulnerability Detectioncited by 44
- 2022Deep Learning Meets Software Engineering: A Survey on Pre-Trained Models of Source Codecited by 20
- 2024Harnessing the Power of LLMs in Source Code Vulnerability Detectioncited by 6
- 2024A Survey of Source Code Representations for Machine Learning-Based Cybersecurity Taskscited by 4
- 2022A Hierarchical Deep Neural Network for Detecting Lines of Codes with Vulnerabilitiescited by 2
- 2025Semantic-Preserving Transformations as Mutation Operators: A Study on Their Effectiveness in Defect Detectioncited by 2
- 2023Test Case Recommendations with Distributed Representation of Code Syntactic Featurescited by 0
- 2024CLNX: Bridging Code and Natural Language for C/C++ Vulnerability-Contributing Commits Identificationcited by 0
- 2025Semantic-Preserving Transformations as Mutation Operators: A Study on Their Effectiveness in Defect Detection30 Mar 2025
- 2024CLNX: Bridging Code and Natural Language for C/C++ Vulnerability-Contributing Commits Identification11 Sep 2024
- 2024Harnessing the Power of LLMs in Source Code Vulnerability Detection7 Aug 2024
- 2024A Survey of Source Code Representations for Machine Learning-Based Cybersecurity Tasks15 Mar 2024
- 2023Test Case Recommendations with Distributed Representation of Code Syntactic Features4 Oct 2023
- 2022An Empirical Study of Deep Learning Models for Vulnerability Detection15 Dec 2022
- 2022A Hierarchical Deep Neural Network for Detecting Lines of Codes with Vulnerabilities15 Nov 2022
- 2022VulBERTa: Simplified Source Code Pre-Training for Vulnerability Detection25 May 2022
- 2022Deep Learning Meets Software Engineering: A Survey on Pre-Trained Models of Source Code24 May 2022
- 2021SynCoBERT: Syntax-Guided Multi-Modal Contrastive Pre-Training for Code Representation10 Aug 2021