Devign: Effective Vulnerability Identification by Learning Comprehensive Program Semantics via Graph Neural Networks
Not on the map. Why?
Cited by 23 in LLM agents and tool use, but placed by its own abstract, which didn’t fit.
Abstract (arXiv)
Vulnerability identification is crucial to protect the software systems from attacks for cyber security. It is especially important to localize the vulnerable functions among the source code to facilitate the fix. However, it is a challenging and tedious process, and also requires specialized security expertise. Inspired by the work on manually-defined patterns of vulnerabilities from various code representation graphs and the recent advance on graph neural networks, we propose Devign, a general graph neural network based model for graph-level classification through learning on a rich set of code semantic representations. It includes a novel Conv module to efficiently extract useful features in the learned rich node representations for graph-level classification. The model is trained over manually labeled datasets built on 4 diversified large-scale open-source C projects that incorporate high complexity and variety of real source code instead of synthesis code used in previous works. The results of the extensive evaluation on the datasets demonstrate that Devign outperforms the state of the arts significantly with an average of 10.51% higher accuracy and 8.68% F1 score, increases averagely 4.66% accuracy and 6.37% F1 by the Conv module.
Key facts. Cited by 266 papers in the map (data through 7 Oct 2026). First posted on arXiv 8 Sep 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2020: 1; 2021: 26; 2022: 38; 2023: 45; 2024: 55; 2025: 59; 2026: 42.
266 papers.
Sort:
By area:
- 2021CodeT5: Identifier-aware Unified Pre-trained Encoder-Decoder Models for Code Understanding and Generationcited by 890
- 2021CodeXGLUE: A Machine Learning Benchmark Dataset for Code Understanding and Generationcited by 732
- 2023Large Language Models for Software Engineering: A Systematic Literature Reviewcited by 389
- 2021Unified Pre-training for Program Understanding and Generationcited by 361
- 2021CodeNet: A Large-Scale AI for Code Dataset for Learning a Diversity of Coding Taskscited by 199
- 2023Large Language Models for Code: Security Hardening and Adversarial Testingcited by 149
- 2024Vulnerability Detection with Code Language Models: How Far Are We?cited by 133
- 2023DiverseVul: A New Vulnerable Source Code Dataset for Deep Learning Based Vulnerability Detectioncited by 98
- 2020Retrieval-Augmented Generation for Code Summarization via Hybrid GNNcited by 89
- 2021CVEfixes: Automated Collection of Vulnerabilities and Their Fixes from Open-Source Softwarecited by 89
- 2023Large Language Models for Test-Free Fault Localizationcited by 67
- 2024Vul-RAG: Enhancing LLM-based Vulnerability Detection via Knowledge-level RAGcited by 67
38 more
- 2022CoCoMIC: Code Completion By Jointly Modeling In-file and Cross-file Contextcited by 64
- 2021SynCoBERT: Syntax-Guided Multi-Modal Contrastive Pre-Training for Code Representationcited by 63
- 2021CoTexT: Multi-task Learning with Code-Text Transformercited by 61
- 2024LLM4Vuln: A Unified Evaluation Framework for Decoupling and Enhancing LLMs' Vulnerability Reasoningcited by 57
- 2022VulBERTa: Simplified Source Code Pre-Training for Vulnerability Detectioncited by 51
- 2023Evaluating Instruction-Tuned Large Language Models on Code Comprehension and Generationcited by 49
- 2021D2A: A Dataset Built for AI-Based Vulnerability Detection Methods Using Differential Analysiscited by 48
- 2022CodeAttack: Code-Based Adversarial Attacks for Pre-trained Programming Language Modelscited by 48
- 2023xCodeEval: A Large Scale Multilingual Multitask Benchmark for Code Understanding, Generation, Translation and Retrievalcited by 46
- 2022An Empirical Study of Deep Learning Models for Vulnerability Detectioncited by 44
- 2025LLMs in Software Security: A Survey of Vulnerability Detection Techniques and Insightscited by 44
- 2023A New Era in Software Security: Towards Self-Healing Software via Large Language Models and Formal Verificationcited by 42
- 2022No More Fine-Tuning? An Experimental Evaluation of Prompt Tuning in Code Intelligencecited by 41
- 2022Transformer-Based Language Models for Software Vulnerability Detectioncited by 39
- 2021Combining Graph Neural Networks with Expert Knowledge for Smart Contract Vulnerability Detectioncited by 34
- 2022Fault-Aware Neural Code Rankerscited by 33
- 2021ReGVD: Revisiting Graph Neural Networks for Vulnerability Detectioncited by 32
- 2023The FormAI Dataset: Generative AI in Software Security Through the Lens of Formal Verificationcited by 32
- 2023Natural Language Generation and Understanding of Big Code for AI-Assisted Programming: A Reviewcited by 32
- 2024AST-T5: Structure-Aware Pretraining for Code Generation and Understandingcited by 32
- 2024An LLM-Assisted Easy-to-Trigger Backdoor Attack on Code Completion Models: Injecting Disguised Vulnerabilities against Strong Detectioncited by 32
- 2023Uncovering the Limits of Machine Learning for Automatic Vulnerability Detectioncited by 30
- 2024Generalization-Enhanced Code Vulnerability Detection via Multi-Task Instruction Fine-Tuningcited by 30
- 2025Benchmarking LLMs and LLM-based Agents in Practical Vulnerability Detection for Code Repositoriescited by 29
- 2025EuroBERT: Scaling Multilingual Encoders for European Languagescited by 28
- 2023How Far Have We Gone in Vulnerability Detection Using Large Language Modelscited by 27
- 2024Top Score on the Wrong Exam: On Benchmarking in Machine Learning for Vulnerability Detectioncited by 27
- 2021How could Neural Networks understand Programs?cited by 26
- 2021On Multi-Modal Learning of Editing Source Codecited by 25
- 2024Astraios: Parameter-Efficient Instruction Tuning Code Large Language Modelscited by 23
- 2024NoFunEval: Funny How Code LMs Falter on Requirements Beyond Functional Correctnesscited by 23
- 2023Deep Learning for Code Intelligence: Survey, Benchmark and Toolkitcited by 22
- 2025Frontier AI's Impact on the Cybersecurity Landscapecited by 21
- 2021Generating Adversarial Computer Programs using Optimized Obfuscationscited by 20
- 2021VELVET: a noVel Ensemble Learning approach to automatically locate VulnErable sTatementscited by 20
- 2022Deep Learning Meets Software Engineering: A Survey on Pre-Trained Models of Source Codecited by 20
- 2023Multi-target Backdoor Attacks for Code Pre-trained Modelscited by 19
- 2021Bridging the Gap between Spatial and Spectral Domains: A Unified Framework for Graph Neural Networkscited by 18
50 most cited of 266 All 266 (JSON)
- 2026The History Is the Detector: Executing CVE Patch History, End-to-End4 Sep 2026
- 2026Synthetic Semantic Supervision for Contrastive Code Representation Learning in Small Transformers: An Empirical Study3 Sep 2026
- 2026CyberFactory: Scaling Cyber Security Capabilities with Instances from the Wild24 Aug 2026
- 2026Large Language Models at the Intersection of Software Engineering and Software Security:An Evidence-Centered Structured Survey and Research Agenda21 Aug 2026
- 2026Beyond FLOPs: Energy-Aware Knowledge Distillation for Sustainable LLMs on Code-Related Task18 Aug 2026
- 2026Probing the Prefill: Detecting Code Vulnerabilities via Latent Activations17 Aug 2026
- 2026Invariant Pretraining for Robust Code Representations15 Aug 2026
- 2026Trident : How to Break Deep Reinforcement Learning Cyber Defenses (Agentic)5 Aug 2026
- 2026HoF-Bench: Rediscovering Real AI-Discovered CVEs Without Frontier Models29 Jul 2026
- 2026Graph Is the Verifier: Agentic Reinforcement Learning for Interprocedural Vulnerability Detection29 Jul 2026
- 2026AutoTrace: From Patches to Triggers via Agentic Interprocedural Exploration13 Jul 2026
- 2026RustMizan: A Compilable, Contamination-Aware Benchmarking Framework for Rust Vulnerabilities6 Jul 2026
38 more
- 2026LLM-Enhanced Hierarchical Heterogeneous Graph Representation Learning for Malicious Python Package Detection3 Jul 2026
- 2026JavaVulBench: A Java Vulnerability Benchmark with Realistic Splits, a Unified Multi-Backend Harness, and a Leakage-Aware Evaluation Mode2 Jul 2026
- 2026Reinforcement Learning for Software Vulnerability Analysis: A Systematic Review with Emphasis on C/C++ Source Code and Static Analysis24 Jun 2026
- 2026GRADE: Graph Representation of LLM Agent Dependency and Execution22 Jun 2026
- 2026Calibration Without Comprehension: Diagnosing the Limits of Fine-Tuning LLMs for Vulnerability Detection in Systems Software18 Jun 2026
- 2026SkillMutator: Benchmarking and Defending Language-and-Code Cross-modal Attacks on LLM Agent Skills12 Jun 2026
- 2026AttackPathGNN: Cross-function vulnerability detection in smart contracts using state interference graphs and conjunction pooling4 Jun 2026
- 2026Willing but Unable: Separating Refusal from Capability in Code LLMs via Abliteration3 Jun 2026
- 2026FuzzingBrain V2: A Multi-Agent LLM System for Automated Vulnerability Discovery and Reproduction20 May 2026
- 2026ClaHF: A Human Feedback-inspired Reinforcement Learning Framework for Improving Classification Tasks17 May 2026
- 2026A Comprehensive Evaluation of Code Language Models for Security Patch Detection13 May 2026
- 2026MARGIN: Margin-Aware Regularized Geometry for Imbalanced Vulnerability Detection11 May 2026
- 2026VulTriage: Triple-Path Context Augmentation for LLM-Based Vulnerability Detection10 May 2026
- 2026QASecClaw: A Multi-Agent LLM Approach for False Positive Reduction in Static Application Security Testing3 May 2026
- 2026VulStyle: A Multi-Modal Pre-Training for Code Stylometry-Augmented Vulnerability Detection29 Apr 2026
- 2026Verify Before You Fix: Agentic Execution Grounding for Trustworthy Cross-Language Code Analysis12 Apr 2026
- 2026Software Vulnerability Detection Using a Lightweight Graph Neural Network31 Mar 2026
- 2026VulnAgent-R2: Evidence-Calibrated Multi-Agent Auditing for Repository-Level Vulnerability Detection11 Mar 2026
- 2026RTLocating: Intent-aware RTL Localization for Hardware Design Iteration28 Feb 2026
- 2026Enhancing Continual Learning for Software Vulnerability Prediction: Addressing Catastrophic Forgetting via Hybrid-Confidence-Aware Selective Replay for Temporal LLM Fine-Tuning27 Feb 2026
- 2026From SFT to RL: Demystifying the Post-Training Pipeline for LLM-based Vulnerability Detection15 Feb 2026
- 2026An Empirical Study of the Imbalance Issue in Software Vulnerability Detection12 Feb 2026
- 2026Pro-ZD: A Transferable Graph Neural Network Approach for Proactive Zero-Day Threats Mitigation6 Feb 2026
- 2026One Model, Many Skills: Parameter-Efficient Fine-Tuning for Multitask Code Analysis3 Feb 2026
- 2026Towards Comprehensive Benchmarking Infrastructure for LLMs In Software Engineering28 Jan 2026
- 2026MulVul: Retrieval-augmented Multi-Agent Code Vulnerability Detection via Cross-Model Prompt Evolution26 Jan 2026
- 2026Many Hands Make Light Work: An LLM-based Multi-Agent System for Detecting Malicious PyPI Packages17 Jan 2026
- 2026HogVul: Black-box Adversarial Code Generation Framework Against LM-based Vulnerability Detectors9 Jan 2026
- 2026SastBench: A Benchmark for Testing Agentic SAST Triage6 Jan 2026
- 2026Focus on What Matters: Fisher-Guided Adaptive Multimodal Fusion for Vulnerability Detection5 Jan 2026
- 2025From Illusion to Insight: Change-Aware File-Level Software Defect Prediction Using Agentic AI29 Dec 2025
- 2025Beyond Single Bugs: Benchmarking Large Language Models for Multi-Vulnerability Detection26 Dec 2025
- 2025VulnLLM-R: Specialized Reasoning LLM with Agent Scaffold for Vulnerability Detection8 Dec 2025
- 2025UncertaintyZoo: A Unified Toolkit for Quantifying Predictive Uncertainty in Deep Learning Systems6 Dec 2025
- 2025Is Vibe Coding Safe? Benchmarking Vulnerability of Agent-Generated Code in Real-World Tasks2 Dec 2025
- 2025Large Language Models Cannot Reliably Detect Vulnerabilities in JavaScript: The First Systematic Benchmark and Evaluation1 Dec 2025
- 2025A Metamorphic Testing Perspective on Knowledge Distillation for Language Models of Code: Does the Student Deeply Mimic the Teacher?7 Nov 2025
- 2025On the Difficulty of Selecting Few-Shot Examples for Effective LLM-based Vulnerability Detection31 Oct 2025
50 newest of 266 All 266 (JSON)
- 2025Benchmarking LLMs and LLM-based Agents in Practical Vulnerability Detection for Code Repositoriescited by 29
- 2025Is Vibe Coding Safe? Benchmarking Vulnerability of Agent-Generated Code in Real-World Taskscited by 18
- 2025From CVE Entries to Verifiable Exploits: An Automated Multi-Agent Framework for Reproducing CVEscited by 17
- 2026SkillMutator: Benchmarking and Defending Language-and-Code Cross-modal Attacks on LLM Agent Skillscited by 5
- 2025DefenderBench: A Toolkit for Evaluating Language Agents in Cybersecurity Environmentscited by 4
- 2025From Trace to Line: LLM Agent for Real-World OSS Vulnerability Localizationcited by 4
- 2025Towards Engineering Multi-Agent LLMs: A Protocol-Driven Approachcited by 4
- 2026GRADE: Graph Representation of LLM Agent Dependency and Executioncited by 4
- 2026FuzzingBrain V2: A Multi-Agent LLM System for Automated Vulnerability Discovery and Reproductioncited by 3
- 2026SastBench: A Benchmark for Testing Agentic SAST Triagecited by 2
- 2026Many Hands Make Light Work: An LLM-based Multi-Agent System for Detecting Malicious PyPI Packagescited by 1
- 2026VulnAgent-R2: Evidence-Calibrated Multi-Agent Auditing for Repository-Level Vulnerability Detectioncited by 1
12 most cited of 21 All 21 (JSON)
- 2026CyberFactory: Scaling Cyber Security Capabilities with Instances from the Wild24 Aug 2026
- 2026Trident : How to Break Deep Reinforcement Learning Cyber Defenses (Agentic)5 Aug 2026
- 2026Graph Is the Verifier: Agentic Reinforcement Learning for Interprocedural Vulnerability Detection29 Jul 2026
- 2026AutoTrace: From Patches to Triggers via Agentic Interprocedural Exploration13 Jul 2026
- 2026RustMizan: A Compilable, Contamination-Aware Benchmarking Framework for Rust Vulnerabilities6 Jul 2026
- 2026GRADE: Graph Representation of LLM Agent Dependency and Execution22 Jun 2026
- 2026SkillMutator: Benchmarking and Defending Language-and-Code Cross-modal Attacks on LLM Agent Skills12 Jun 2026
- 2026FuzzingBrain V2: A Multi-Agent LLM System for Automated Vulnerability Discovery and Reproduction20 May 2026
- 2026QASecClaw: A Multi-Agent LLM Approach for False Positive Reduction in Static Application Security Testing3 May 2026
- 2026Verify Before You Fix: Agentic Execution Grounding for Trustworthy Cross-Language Code Analysis12 Apr 2026
- 2026VulnAgent-R2: Evidence-Calibrated Multi-Agent Auditing for Repository-Level Vulnerability Detection11 Mar 2026
- 2026Many Hands Make Light Work: An LLM-based Multi-Agent System for Detecting Malicious PyPI Packages17 Jan 2026
12 newest of 21 All 21 (JSON)
- 2024LLM4Vuln: A Unified Evaluation Framework for Decoupling and Enhancing LLMs' Vulnerability Reasoningcited by 57
- 2025PurpCode: Reasoning for Safer Code Generationcited by 17
- 2025VulnLLM-R: Specialized Reasoning LLM with Agent Scaffold for Vulnerability Detectioncited by 11
- 2025Improving LLM Reasoning for Vulnerability Detection via Group Relative Policy Optimizationcited by 4
- 2025LLM-Driven Collaborative Model for Untangling Commits via Explicit and Implicit Dependency Reasoningcited by 2
- 2025Using Contrastive Learning to Improve Two-Way Reasoning in Large Language Models: The Obfuscation Task as a Case Studycited by 0
- 2025LLaVul: A Multimodal LLM for Interpretable Vulnerability Reasoning about Source Codecited by 0
- 2025VulnLLM-R: Specialized Reasoning LLM with Agent Scaffold for Vulnerability Detection8 Dec 2025
- 2025LLaVul: A Multimodal LLM for Interpretable Vulnerability Reasoning about Source Code22 Sep 2025
- 2025Using Contrastive Learning to Improve Two-Way Reasoning in Large Language Models: The Obfuscation Task as a Case Study6 Sep 2025
- 2025PurpCode: Reasoning for Safer Code Generation25 Jul 2025
- 2025LLM-Driven Collaborative Model for Untangling Commits via Explicit and Implicit Dependency Reasoning22 Jul 2025
- 2025Improving LLM Reasoning for Vulnerability Detection via Group Relative Policy Optimization3 Jul 2025
- 2024LLM4Vuln: A Unified Evaluation Framework for Decoupling and Enhancing LLMs' Vulnerability Reasoning29 Jan 2024
- 2024An LLM-Assisted Easy-to-Trigger Backdoor Attack on Code Completion Models: Injecting Disguised Vulnerabilities against Strong Detectioncited by 32
- 2023Multi-target Backdoor Attacks for Code Pre-trained Modelscited by 19
- 2022Poison Attack and Defense on Deep Source Code Processing Modelscited by 8
- 2025Show Me Your Code! Kill Code Poisoning: A Lightweight Method Based on Code Naturalnesscited by 3
- 2024Eliminating Backdoors in Neural Code Models for Secure Code Understandingcited by 2
- 2024CodePurify: Defend Backdoor Attacks on Neural Code Models via Entropy-based Purificationcited by 0
- 2025Signature in Code Backdoor Detection, how far are we?cited by 0
- 2025Signature in Code Backdoor Detection, how far are we?15 Oct 2025
- 2025Show Me Your Code! Kill Code Poisoning: A Lightweight Method Based on Code Naturalness20 Feb 2025
- 2024CodePurify: Defend Backdoor Attacks on Neural Code Models via Entropy-based Purification26 Oct 2024
- 2024Eliminating Backdoors in Neural Code Models for Secure Code Understanding8 Aug 2024
- 2024An LLM-Assisted Easy-to-Trigger Backdoor Attack on Code Completion Models: Injecting Disguised Vulnerabilities against Strong Detection10 Jun 2024
- 2023Multi-target Backdoor Attacks for Code Pre-trained Models14 Jun 2023
- 2022Poison Attack and Defense on Deep Source Code Processing Models31 Oct 2022
- 2021CodeT5: Identifier-aware Unified Pre-trained Encoder-Decoder Models for Code Understanding and Generationcited by 890
- 2021CodeXGLUE: A Machine Learning Benchmark Dataset for Code Understanding and Generationcited by 732
- 2023Large Language Models for Software Engineering: A Systematic Literature Reviewcited by 389
- 2021Unified Pre-training for Program Understanding and Generationcited by 361
- 2021CodeNet: A Large-Scale AI for Code Dataset for Learning a Diversity of Coding Taskscited by 199
- 2023Large Language Models for Code: Security Hardening and Adversarial Testingcited by 149
- 2024Vulnerability Detection with Code Language Models: How Far Are We?cited by 133
- 2023DiverseVul: A New Vulnerable Source Code Dataset for Deep Learning Based Vulnerability Detectioncited by 98
- 2021CVEfixes: Automated Collection of Vulnerabilities and Their Fixes from Open-Source Softwarecited by 89
- 2023Large Language Models for Test-Free Fault Localizationcited by 67
- 2024Vul-RAG: Enhancing LLM-based Vulnerability Detection via Knowledge-level RAGcited by 67
- 2022CoCoMIC: Code Completion By Jointly Modeling In-file and Cross-file Contextcited by 64
12 most cited of 227 All 227 (JSON)
- 2026The History Is the Detector: Executing CVE Patch History, End-to-End4 Sep 2026
- 2026Synthetic Semantic Supervision for Contrastive Code Representation Learning in Small Transformers: An Empirical Study3 Sep 2026
- 2026Large Language Models at the Intersection of Software Engineering and Software Security:An Evidence-Centered Structured Survey and Research Agenda21 Aug 2026
- 2026Beyond FLOPs: Energy-Aware Knowledge Distillation for Sustainable LLMs on Code-Related Task18 Aug 2026
- 2026Probing the Prefill: Detecting Code Vulnerabilities via Latent Activations17 Aug 2026
- 2026Invariant Pretraining for Robust Code Representations15 Aug 2026
- 2026HoF-Bench: Rediscovering Real AI-Discovered CVEs Without Frontier Models29 Jul 2026
- 2026LLM-Enhanced Hierarchical Heterogeneous Graph Representation Learning for Malicious Python Package Detection3 Jul 2026
- 2026JavaVulBench: A Java Vulnerability Benchmark with Realistic Splits, a Unified Multi-Backend Harness, and a Leakage-Aware Evaluation Mode2 Jul 2026
- 2026Reinforcement Learning for Software Vulnerability Analysis: A Systematic Review with Emphasis on C/C++ Source Code and Static Analysis24 Jun 2026
- 2026Calibration Without Comprehension: Diagnosing the Limits of Fine-Tuning LLMs for Vulnerability Detection in Systems Software18 Jun 2026
- 2026AttackPathGNN: Cross-function vulnerability detection in smart contracts using state interference graphs and conjunction pooling4 Jun 2026
12 newest of 227 All 227 (JSON)