mlsanityData to 7 Oct 2026

ChatNVD: Advancing Cybersecurity Vulnerability Assessment with Large Language Models

arXiv 2412.04756 ↗First posted 6 Dec 2024cs.CR cs.CLcited by 11

Not on the map. Why?

Abstract (arXiv)

The increasing frequency and sophistication of cybersecurity vulnerabilities in software systems underscores the need for more robust and effective vulnerability assessment methods. However, existing approaches often rely on highly technical and abstract frameworks, which hinder understanding and increase the likelihood of exploitation, resulting in severe cyberattacks. In this paper, we introduce ChatNVD, a support tool powered by Large Language Models (LLMs) that leverages the National Vulnerability Database (NVD) to generate accessible, context-rich summaries of software vulnerabilities. We develop three variants of ChatNVD, utilizing three prominent LLMs: GPT-4o Mini by OpenAI, LLaMA 3 by Meta, and Gemini 1.5 Pro by Google. To evaluate their performance, we conduct a comparative evaluation focused on their ability to identify, interpret, and explain software vulnerabilities. Our results demonstrate that GPT-4o Mini outperforms the other models, achieving over 92% accuracy and the lowest error rates, making it the most reliable option for real-world vulnerability assessment.

Key facts. Cited by 11 papers in the map (data through 7 Oct 2026). Builds on 37 of its 105 references that are in the map. First posted on arXiv 6 Dec 2024.

Builds on

37 of 105 references.

References · 37

  1. 2017Attention Is All You Needcited by 59,932
  2. 2020Language Models are Few-Shot Learnerscited by 32,199
  3. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
  4. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
  5. 2021Training Verifiers to Solve Math Word Problemscited by 9,743
  6. 2020Measuring Massive Multitask Language Understandingcited by 7,768
  7. 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,601
  8. 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,907
  9. 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,383
  10. 2024Gemini 1.5: Unlocking multimodal understanding across millions of tokens of contextcited by 3,175
  11. 2022Survey of Hallucination in Natural Language Generationcited by 2,056
  12. 2023A Survey on Evaluation of Large Language Modelscited by 1,227
25 more
  1. 2023Practical and Ethical Challenges of Large Language Models in Education: A Systematic Scoping Reviewcited by 83
  2. 2022SecureBERT: A Domain-Specific Language Model for Cybersecuritycited by 60
  3. 2023Automating Customer Service using LangChain: Building custom open-source GPT Chatbot for organizationscited by 59
  4. 2023Generative Pre-trained Transformer: A Comprehensive Review on Enabling Technologies, Potential Applications, Emerging Challenges, and Future Directionscited by 55
  5. 2022VulBERTa: Simplified Source Code Pre-Training for Vulnerability Detectioncited by 51
  6. 2024CultureLLM: Incorporating Cultural Differences into Large Language Modelscited by 49
  7. 2023MusiLingo: Bridging Music and Text with Pre-trained Language Models for Music Captioning and Query Responsecited by 45
  8. 2024MoDeGPT: Modular Decomposition for Large Language Model Compressioncited by 45
  9. 2024Towards Evaluating and Building Versatile Large Language Models for Medicinecited by 38
  10. 2018Automated software vulnerability detection with machine learningcited by 34
  11. 2023CPLLM: Clinical Prediction with Large Language Modelscited by 34
  12. 2022"I think this is the most disruptive technology": Exploring Sentiments of ChatGPT Early Adopters using Twitter Datacited by 32
  13. 2022CySecBERT: A Domain-Adapted Language Model for the Cybersecurity Domaincited by 31
  14. 2023An In-depth Look at Gemini's Language Abilitiescited by 28
  15. 2023How Useful are Educational Questions Generated by Large Language Models?cited by 23
  16. 2024Closing the gap between open-source and commercial large language models for medical evidence summarizationcited by 21
  17. 2024Outside the Comfort Zone: Analysing LLM Capabilities in Software Vulnerability Detectioncited by 16
  18. 2017Learning to Compute Word Embeddings On the Flycited by 12
  19. 2023Impacts and Risk of Generative AI Technology on Cyber Defensecited by 8
  20. 2024A Survey of Large Language Models in Cybersecuritycited by 8
  21. 2021A Review on C3I Systems' Security: Vulnerabilities, Attacks, and Countermeasurescited by 6
  22. 2024Using Large Language Models for Natural Language Processing Tasks in Requirements Engineering: A Systematic Guidelinecited by 6
  23. 2024Towards Deep Learning Enabled Cybersecurity Risk Assessment for Microservice Architecturescited by 6
  24. 2024Microservice Vulnerability Analysis: A Literature Review with Empirical Insightscited by 5
  25. 2023Enhancing Network Resilience through Machine Learning-powered Graph Combinatorial Optimization: Applications in Cyber Defense and Information Diffusioncited by 4

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 2; 2025: 4; 2026: 5.

11 papers.

  1. 2025Large Language Models for Security Operations Centers: A Comprehensive Surveycited by 9
  2. 2024Machine Learning Driven Smishing Detection Framework for Mobile Securitycited by 6
  3. 2025RegimeFolio: A Regime Aware ML System for Sectoral Portfolio Optimization in Dynamic Marketscited by 6
  4. 2025SCALAR: Self-Calibrating Adaptive Latent Attention Representation Learningcited by 5
  5. 2026Australian Bushfire Intelligence with AI-Driven Environmental Analyticscited by 3
  6. 2026Explainable Autonomous Cyber Defense using Adversarial Multi-Agent Reinforcement Learningcited by 3
  7. 2024On the Validity of Traditional Vulnerability Scoring Systems for Adversarial Attacks against LLMscited by 2
  8. 2025LLM Embedding-based Attribution (LEA): Quantifying Source Contributions to Generative Model's Response for Vulnerability Analysiscited by 2
  9. 2026AgenticVM: Agentic AI for Adaptive Software Vulnerability Managementcited by 2
  10. 2026Comparative Analysis of Large Language Models in Healthcarecited by 1
  11. 2026MITRE-SAGE: A Multi-Agent Cybersecurity Question-Answering Modelcited by 0