mlsanityData to 7 Oct 2026

On using distributed representations of source code for the detection of C security vulnerabilities

arXiv 2106.01367 ↗First posted 1 Jun 2021cs.CR cs.AI cs.LGcited by 10

Not on the map. Why?

Abstract (arXiv)

This paper presents an evaluation of the code representation model Code2vec when trained on the task of detecting security vulnerabilities in C source code. We leverage the open-source library astminer to extract path-contexts from the abstract syntax trees of a corpus of labeled C functions. Code2vec is trained on the resulting path-contexts with the task of classifying a function as vulnerable or non-vulnerable. Using the CodeXGLUE benchmark, we show that the accuracy of Code2vec for this task is comparable to simple transformer-based methods such as pre-trained RoBERTa, and outperforms more naive NLP-based methods. We achieved an accuracy of 61.43% while maintaining low computational requirements relative to larger models.

Key facts. Cited by 10 papers in the map (data through 7 Oct 2026). Builds on 16 of its 28 references that are in the map. First posted on arXiv 1 Jun 2021.

Builds on

16 of 28 references.

References · 16

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
  4. 2020CodeBERT: A Pre-Trained Model for Programming and Natural Languagescited by 1,286
  5. 2014Convolutional Neural Networks for Sentence Classificationcited by 1,124
  6. 2021CodeXGLUE: A Machine Learning Benchmark Dataset for Code Understanding and Generationcited by 732
  7. 2021Unified Pre-training for Program Understanding and Generationcited by 361
  8. 2019Devign: Effective Vulnerability Identification by Learning Comprehensive Program Semantics via Graph Neural Networkscited by 266
  9. 2018code2vec: Learning Distributed Representations of Codecited by 249
  10. 2020Deep Learning based Vulnerability Detection: Are We There Yet?cited by 142
  11. 2018Automated Vulnerability Detection in Source Code Using Deep Representation Learningcited by 114
  12. 2018SySeVR: A Framework for Using Deep Learning to Detect Software Vulnerabilitiescited by 91
4 more
  1. 2019Low-Memory Neural Network Training: A Technical Reportcited by 56
  2. 2018Automated software vulnerability detection with machine learningcited by 34
  3. 2020Exploring Software Naturalness through Neural Language Modelscited by 32
  4. 2018A General Path-Based Representation for Predicting Program Propertiescited by 28

Built on by

Cited by year

Citing papers per year: 2021: 1; 2022: 4; 2023: 1; 2024: 3; 2025: 1.

10 papers.