mlsanityData to 14 Oct 2026

Llama-3.1-FoundationAI-SecurityLLM-8B-Instruct Technical Report

arXiv 2508.01059 ↗First posted 1 Aug 2025cs.CR cs.AIcited by 23

Not on the map. Why?

Abstract (arXiv)

Large language models (LLMs) have shown remarkable success across many domains, yet their integration into cybersecurity applications remains limited due to a lack of general-purpose cybersecurity data, representational complexity, and safety and regulatory concerns. To address this gap, we previously introduced Foundation-Sec-8B, a cybersecurity-focused LLM suitable for fine-tuning on downstream tasks. That model, however, was not designed for chat-style interactions or instruction-following. In this report, we release Foundation-Sec-8B-Instruct: a model specifically trained for general-purpose cybersecurity dialogue. Built on Foundation-Sec-8B, it combines domain-specific knowledge with instruction-following, conversational capabilities, and alignment with human preferences to produce high-quality, relevant responses. Comprehensive evaluations show that Foundation-Sec-8B-Instruct outperforms Llama 3.1-8B-Instruct on a range of cybersecurity tasks while matching its instruction-following performance. It is also competitive with GPT-4o-mini on cyber threat intelligence and instruction-following tasks. We envision Foundation-Sec-8B-Instruct becoming an indispensable assistant in the daily workflows of cybersecurity professionals. We release the model publicly at https://huggingface.co/fdtn-ai/Foundation-Sec-8B-Instruct.

Key facts. Cited by 23 papers in the map (data through 14 Oct 2026). Builds on 57 of its 76 references that are in the map. First posted on arXiv 1 Aug 2025.

Builds on

57 of 76 references.

References · 57

  1. 2020Language Models are Few-Shot Learnerscited by 32,419
  2. 2022Training language models to follow instructions with human feedbackcited by 15,971
  3. 2017Proximal Policy Optimization Algorithmscited by 15,215
  4. 2024The Llama 3 Herd of Modelscited by 14,715
  5. 2021Training Verifiers to Solve Math Word Problemscited by 10,109
  6. 2025Qwen3 Technical Reportcited by 8,820
  7. 2021Evaluating Large Language Models Trained on Codecited by 8,320
  8. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 8,065
  9. 2020Measuring Massive Multitask Language Understandingcited by 7,963
  10. 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,371
  11. 2024GPT-4o System Cardcited by 4,588
  12. 2022Scaling Instruction-Finetuned Language Modelscited by 3,024
38 more
  1. 2023Code Llama: Open Foundation Models for Codecited by 2,139
  2. 2022Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language modelscited by 1,998
  3. 2025Gemma 3 Technical Reportcited by 1,824
  4. 2022Challenging BIG-Bench Tasks and Whether Chain-of-Thought Can Solve Themcited by 1,807
  5. 2024HarmBench: A Standardized Evaluation Framework for Automated Red Teaming and Robust Refusalcited by 1,429
  6. 2023Instruction-Following Evaluation for Large Language Modelscited by 1,228
  7. 2023Llama Guard: LLM-based Input-Output Safeguard for Human-AI Conversationscited by 1,207
  8. 2024Tulu 3: Pushing Frontiers in Open Language Model Post-Trainingcited by 1,053
  9. 2024Length-Controlled AlpacaEval: A Simple Way to Debias Automatic Evaluatorscited by 897
  10. 2016Bag of Tricks for Efficient Text Classificationcited by 876
  11. 2022Super-NaturalInstructions: Generalization via Declarative Instructions on 1600+ NLP Taskscited by 868
  12. 2024Phi-4 Technical Reportcited by 711
  13. 2024Smarter, Better, Faster, Longer: A Modern Bidirectional Encoder for Fast, Memory Efficient, and Long Context Finetuning and Inferencecited by 554
  14. 20242 OLMo 2 Furiouscited by 340
  15. 2023LegalBench: A Collaboratively Built Benchmark for Measuring Legal Reasoning in Large Language Modelscited by 336
  16. 2023MEDITRON-70B: Scaling Medical Pretraining for Large Language Modelscited by 274
  17. 2024A Comprehensive Survey of Hallucination Mitigation Techniques in Large Language Modelscited by 269
  18. 2024Does Fine-Tuning LLMs on New Knowledge Encourage Hallucinations?cited by 232
  19. 2023Camels in a Changing Climate: Enhancing LM Adaptation with Tulu 2cited by 229
  20. 2020Reducing conversational agents' overconfidence through linguistic calibrationcited by 210
  21. 2023Rethinking Benchmark and Contamination for Language Models with Rephrased Samplescited by 195
  22. 2024Cybench: A Framework for Evaluating Cybersecurity Capabilities and Risks of Language Modelscited by 164
  23. 2025Llama-Nemotron: Efficient Reasoning Modelscited by 158
  24. 2023Platypus: Quick, Cheap, and Powerful Refinement of LLMscited by 150
  25. 2024Benchmark Data Contamination of Large Language Models: A Surveycited by 147
  26. 2024SaulLM-7B: A pioneering Large Language Model for Lawcited by 142
  27. 2023Investigating Data Contamination in Modern Benchmarks for Large Language Modelscited by 138
  28. 2024OLMES: A Standard for Language Model Evaluationscited by 106
  29. 2024PersonaGym: Evaluating Persona Agents and LLMscited by 97
  30. 2024When LLMs Meet Cybersecurity: A Systematic Literature Reviewcited by 71
  31. 2024Large Language Models for Cyber Security: A Systematic Literature Reviewcited by 68
  32. 2024CTIBench: A Benchmark for Evaluating LLMs in Cyber Threat Intelligencecited by 62
  33. 2024CyberMetric: A Benchmark Dataset based on Retrieval-Augmented Generation for Evaluating LLMs in Cybersecurity Knowledgecited by 55
  34. 2022BERTScore is Unfair: On Social Bias in Language Model-Based Metrics for Text Generationcited by 48
  35. 2024SaulLM-54B & SaulLM-141B: Scaling Up Domain Adaptation for the Legal Domaincited by 39
  36. 2023SecQA: A Concise Question-Answering Dataset for Evaluating Large Language Models in Computer Securitycited by 37
  37. 2024Large Language Models in Cybersecurity: State-of-the-Artcited by 34
  38. 2022CySecBERT: A Domain-Adapted Language Model for the Cybersecurity Domaincited by 31

50 most cited of 57 All 57 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 4; 2026: 19.

23 papers.

Sort:

By area:

  1. 2026Llama-3.1-FoundationAI-SecurityLLM-Reasoning-8B Technical Reportcited by 7
  2. 2025Uncovering Vulnerabilities of LLM-Assisted Cyber Threat Intelligencecited by 6
  3. 2026Trust Me, Import This: Dependency Steering Attacks via Malicious Agent Skillscited by 5
  4. 2025Toward Cybersecurity-Expert Small Language Modelscited by 4
  5. 2025Personalized Learning Path Planning with Goal-Driven Learner State Modelingcited by 2
  6. 2026UrduBench: An Urdu Reasoning Benchmark using Contextually Ensembled Translations with Human-in-the-Loopcited by 2
  7. 2026Antares: Foundation Models for Agentic Vulnerability Localizationcited by 2
  8. 2026Netflix Artwork Personalization via LLM Post-trainingcited by 1
  9. 2026RedSage: A Cybersecurity Generalist LLMcited by 1
  10. 2026HypRAG: Hyperbolic Dense Retrieval for Retrieval Augmented Generationcited by 1
  11. 2026RLAR: An Agentic Reward System for Multi-task Reinforcement Learning on Large Language Modelscited by 1
  12. 2026Sirens' Whisper: Inaudible Near-Ultrasonic Jailbreaks of Speech-Driven LLMscited by 1
11 more
  1. 2026FAPO: Fully Automated Prompt Optimization of Multi-Step LLM Pipelinescited by 1
  2. 2026TACTIC-KG: Toward Small Agent Teams for Cyber Threat Intelligence Knowledge Graph Constructioncited by 1
  3. 2025Repairing Regex Vulnerabilities via Localization-Guided Instructionscited by 0
  4. 2026Event-Centric Human Value Understanding in News-Domain Texts: An Actor-Conditioned, Multi-Granularity Benchmarkcited by 0
  5. 2026Threat Modelling using Domain-Adapted Language Models: Empirical Evaluation and Insightscited by 0
  6. 2026LLM Evolution as an Industry-Scale Ecosystem: A Lifecycle Perspective on Continual Learningcited by 0
  7. 2026Supervised Fine-Tuning vs. In-Context Learning: An Equilibrium Analysis of LLM Personalization under Congestioncited by 0
  8. 2026MITRE-SAGE: A Multi-Agent Cybersecurity Question-Answering Modelcited by 0
  9. 2026MiST: Mid-Training LLMs for Cybersecuritycited by 0
  10. 2026KaliBench: A Fine-Grained Benchmark for Cybersecurity Tool Use on Kali Linux with Runtime-Free Verifiable Rewardscited by 0
  11. 2026Rethinking Quality in Large Language Model Routing: Security-Conditioned Model-and-Budget Selectioncited by 0