mlsanityData to 7 Oct 2026

MulVuln: Enhancing Pre-trained LMs with Shared and Language-Specific Knowledge for Multilingual Vulnerability Detection

arXiv 2510.04397 ↗First posted 5 Oct 2025cs.CR cs.AI cs.SEcited by 0

Not on the map. Why?

Abstract (arXiv)

Software vulnerabilities (SVs) pose a critical threat to safety-critical systems, driving the adoption of AI-based approaches such as machine learning and deep learning for software vulnerability detection. Despite promising results, most existing methods are limited to a single programming language. This is problematic given the multilingual nature of modern software, which is often complex and written in multiple languages. Current approaches often face challenges in capturing both shared and language-specific knowledge of source code, which can limit their performance on diverse programming languages and real-world codebases. To address this gap, we propose MULVULN, a novel multilingual vulnerability detection approach that learns from source code across multiple languages. MULVULN captures both the shared knowledge that generalizes across languages and the language-specific knowledge that reflects unique coding conventions. By integrating these aspects, it achieves more robust and effective detection of vulnerabilities in real-world multilingual software systems. The rigorous and extensive experiments on the real-world and diverse REEF dataset, consisting of 4,466 CVEs with 30,987 patches across seven programming languages, demonstrate the superiority of MULVULN over thirteen effective and state-of-the-art baselines. Notably, MULVULN achieves substantially higher F1-score, with improvements ranging from 1.45% to 23.59% compared to the baseline methods.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 37 of its 76 references that are in the map. First posted on arXiv 5 Oct 2025.

Builds on

37 of 76 references.

References · 37

  1. 2024The Llama 3 Herd of Modelscited by 14,192
  2. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  3. 2017Neural Discrete Representation Learningcited by 4,650
  4. 2019HuggingFace's Transformers: State-of-the-art Natural Language Processingcited by 2,201
  5. 2023Code Llama: Open Foundation Models for Codecited by 2,105
  6. 2020CodeBERT: A Pre-Trained Model for Programming and Natural Languagescited by 1,286
  7. 2024DeepSeek-Coder: When the Large Language Model Meets Programming -- The Rise of Code Intelligencecited by 1,154
  8. 2014Convolutional Neural Networks for Sentence Classificationcited by 1,124
  9. 2021CodeT5: Identifier-aware Unified Pre-trained Encoder-Decoder Models for Code Understanding and Generationcited by 890
  10. 2021CodeXGLUE: A Machine Learning Benchmark Dataset for Code Understanding and Generationcited by 732
  11. 2020GraphCodeBERT: Pre-training Code Representations with Data Flowcited by 600
  12. 2023A Survey on Large Language Model (LLM) Security and Privacy: The Good, the Bad, and the Uglycited by 380
25 more
  1. 2022UniXcoder: Unified Cross-Modal Pre-training for Code Representationcited by 355
  2. 2023CodeT5+: Open Code Large Language Models for Code Understanding and Generationcited by 327
  3. 2019Devign: Effective Vulnerability Identification by Learning Comprehensive Program Semantics via Graph Neural Networkscited by 266
  4. 2018Automated Vulnerability Detection in Source Code Using Deep Representation Learningcited by 114
  5. 2018SySeVR: A Framework for Using Deep Learning to Detect Software Vulnerabilitiescited by 91
  6. 2021CVEfixes: Automated Collection of Vulnerabilities and Their Fixes from Open-Source Softwarecited by 89
  7. 2023Refining ChatGPT-Generated Code: Characterizing and Mitigating Code Quality Issuescited by 78
  8. 2021D2A: A Dataset Built for AI-Based Vulnerability Detection Methods Using Differential Analysiscited by 48
  9. 2023ChatGPT for Vulnerability Detection, Classification, and Repair: How Far Are We?cited by 44
  10. 2021ReGVD: Revisiting Graph Neural Networks for Vulnerability Detectioncited by 32
  11. 2024Generalization-Enhanced Code Vulnerability Detection via Multi-Task Instruction Fine-Tuningcited by 30
  12. 2023How Far Have We Gone in Vulnerability Detection Using Large Language Modelscited by 27
  13. 2024Multitask-based Evaluation of Open-Source LLM on Software Vulnerabilitycited by 23
  14. 2021VELVET: a noVel Ensemble Learning approach to automatically locate VulnErable sTatementscited by 20
  15. 2023AIBugHunter: A Practical Tool for Predicting, Classifying and Repairing Software Vulnerabilitiescited by 17
  16. 2024Pre-training by Predicting Program Dependencies for Vulnerability Analysis Taskscited by 17
  17. 2020Predicting Defective Lines Using a Model-Agnostic Techniquecited by 14
  18. 2023"False negative -- that one is going to kill you": Understanding Industry Perspectives of Static Analysis based Security Testingcited by 8
  19. 2023REEF: A Framework for Collecting Real-World Vulnerabilities and Fixescited by 8
  20. 2024Coca: Improving and Explaining Graph Neural Network-Based Vulnerability Detection Systemscited by 8
  21. 2023Empirical Analysis of Vulnerabilities Life Cycle in Golang Ecosystemcited by 5
  22. 2024AI for DevSecOps: A Landscape and Future Opportunitiescited by 3
  23. 2022Statement-Level Vulnerability Detection: Learning Vulnerability Patterns Through Information Theory and Contrastive Learningcited by 2
  24. 2024Deep Learning-Based Out-of-distribution Source Code Data Identification: How Far Have We Gone?cited by 2
  25. 2024SAFE: Advancing Large Language Models in Leveraging Semantic and Syntactic Relationships for Software Vulnerability Detectioncited by 2

Built on by

Not cited yet.