mlsanityData to 14 Oct 2026

On Predicting Vulnerability Severity Using In-Context Learning: An Industrial Case Study

arXiv 2608.22089 ↗First posted 22 Aug 2026cs.CR cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Modern software systems require earlier and more scalable vulnerability severity assessment to reduce exposure to high-impact security flaws. Security analysts typically assign CVSS scores, but this manual triage does not scale with the growth of disclosed vulnerabilities and often depends on cloud LLM services that raise confidentiality concerns. This paper presents an industrial case study on predicting CVSS v3.1 scores directly from vulnerable C/C++ snippets using in-context learning with locally deployable, open-source LLMs. We compare proprietary data with the Big-Vul dataset, showing sufficiently aligned CVSS distributions to justify Big-Vul as a proxy for industrial data when constructing prompt-based testbeds. We then vary in-context configurations and model parameters, evaluating CodeLlama2-7B, CodeLlama2-13B, Mistral-7B, gpt-oss, and GPT4o-mini using mean squared error (MSE) and feasibility metrics. Our results show that medium-sized open-source code models, particularly CodeLlama2-7B, can approximate the best cloud performance for CVSS regression when guided by lightweight, output-constraining prompts, offering a practical, privacy-preserving building block for severity triage in industrial settings.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 20 of its 51 references that are in the map. First posted on arXiv 22 Aug 2026.

Builds on

20 of 51 references.

References · 20

  1. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
  2. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
  3. 2016XGBoost: A Scalable Tree Boosting Systemcited by 5,166
  4. 2022Few-Shot Parameter-Efficient Fine-Tuning is Better and Cheaper than In-Context Learningcited by 896
  5. 2024Are Language Models Actually Useful for Time Series Forecasting?cited by 168
  6. 2018Automated Vulnerability Detection in Source Code Using Deep Representation Learningcited by 114
  7. 2024IRIS: LLM-Assisted Static Analysis for Detecting Security Vulnerabilitiescited by 103
  8. 2023Large Language Models are Few-Shot Summarizers: Multi-Intent Comment Generation via In-Context Learningcited by 72
  9. 2023Understanding the Effectiveness of Large Language Models in Detecting Security Vulnerabilitiescited by 59
  10. 2021Vulnerability Detection with Fine-grained Interpretationscited by 56
  11. 2022VulBERTa: Simplified Source Code Pre-Training for Vulnerability Detectioncited by 51
  12. 2018FIRST: A Framework for Optimizing Information Quality in Mobile Crowdsensing Systemscited by 50
8 more
  1. 2023ChatGPT for Vulnerability Detection, Classification, and Repair: How Far Are We?cited by 44
  2. 2024Calibrating Long-form Generations from Large Language Modelscited by 32
  3. 2024Top Score on the Wrong Exam: On Benchmarking in Machine Learning for Vulnerability Detectioncited by 28
  4. 2024Does Data Contamination Detection Work (Well) for LLMs? A Survey and Evaluation on Detection Assumptionscited by 26
  5. 2019Exploit Prediction Scoring System (EPSS)cited by 22
  6. 2024LLMDFA: Analyzing Dataflow in Code with Large Language Modelscited by 22
  7. 2025Can LLMs Classify CVEs? Investigating LLMs Capabilities in Computing CVSS Vectorscited by 4
  8. 2026Automated Vulnerability Detection in Source Code Using Deep Representation Learningcited by 1

Built on by

Not cited yet.