On Large Language Models in National Security Applications
Not on the map. Why?
Abstract (arXiv)
The overwhelming success of GPT-4 in early 2023 highlighted the transformative potential of large language models (LLMs) across various sectors, including national security. This article explores the implications of LLM integration within national security contexts, analyzing their potential to revolutionize information processing, decision-making, and operational efficiency. Whereas LLMs offer substantial benefits, such as automating tasks and enhancing data analysis, they also pose significant risks, including hallucinations, data privacy concerns, and vulnerability to adversarial attacks. Through their coupling with decision-theoretic principles and Bayesian reasoning, LLMs can significantly improve decision-making processes within national security organizations. Namely, LLMs can facilitate the transition from data to actionable decisions, enabling decision-makers to quickly receive and distill available information with less manpower. Current applications within the US Department of Defense and beyond are explored, e.g., the USAF's use of LLMs for wargaming and automatic summarization, that illustrate their potential to streamline operations and support decision-making. However, these applications necessitate rigorous safeguards to ensure accuracy and reliability. The broader implications of LLM integration extend to strategic planning, international relations, and the broader geopolitical landscape, with adversarial nations leveraging LLMs for disinformation and cyber operations, emphasizing the need for robust countermeasures. Despite exhibiting "sparks" of artificial general intelligence, LLMs are best suited for supporting roles rather than leading strategic decisions. Their use in training and wargaming can provide valuable insights and personalized learning experiences for military personnel, thereby improving operational readiness.
Key facts. Cited by 19 papers in the map (data through 14 Oct 2026). Builds on 28 of its 89 references that are in the map. First posted on arXiv 3 Jul 2024.
Builds on
28 of 89 references.
References · 28
- 2017A Unified Approach to Interpreting Model Predictionscited by 6,555
- 2023Sparks of Artificial General Intelligence: Early experiments with GPT-4cited by 2,592
- 2022Emergent Abilities of Large Language Modelscited by 2,512
- 2018This Looks Like That: Deep Learning for Interpretable Image Recognitioncited by 737
- 2022Towards Reasoning in Large Language Models: A Surveycited by 596
- 2024Large Language Models: A Surveycited by 525
- 2023Are Emergent Abilities of Large Language Models a Mirage?cited by 523
- 2021Recent Advances in Natural Language Processing via Large Pre-Trained Language Models: A Surveycited by 463
- 2023Benchmarking Large Language Models for News Summarizationcited by 445
- 2023Can LLM-Generated Misinformation Be Detected?cited by 177
- 2023Generative Language Models and Automated Influence Operations: Emerging Threats and Potential Mitigationscited by 158
- 2023BooookScore: A systematic exploration of book-length summarization in the era of LLMscited by 137
16 more
- 2024Is LLM-as-a-Judge Robust? Investigating Universal Adversarial Attacks on Zero-shot LLM Assessmentcited by 126
- 2024Automatic and Universal Prompt Injection Attacks against Large Language Modelscited by 119
- 2023Are Emergent Abilities in Large Language Models just In-Context Learning?cited by 109
- 2021Spinning Language Models: Risks of Propaganda-As-A-Service and Countermeasurescited by 73
- 2024Escalation Risks from Language Models in Military and Diplomatic Decision-Makingcited by 63
- 2023From task structures to world models: What do LLMs know?cited by 46
- 2024DELL: Generating Reactions and Explanations for LLM-Based Misinformation Detectioncited by 41
- 2023DisasterResponseGPT: Large Language Models for Accelerated Plan of Action Development in Disaster Response Scenarioscited by 34
- 2023Human-like Few-Shot Learning via Bayesian Reasoning over Natural Languagecited by 22
- 2024A Survey on Game Playing Agents and Large Models: Methods, Applications, and Challengescited by 22
- 2023Does Human Collaboration Enhance the Accuracy of Identifying LLM-Generated Deepfake Texts?cited by 21
- 2024AI-Powered Autonomous Weapons Risk Geopolitical Instability and Threaten AI Researchcited by 13
- 2024COA-GPT: Generative Pre-trained Transformers for Accelerated Course of Action Development in Military Operationscited by 12
- 2024Fakes of Varying Shades: How Warning Affects Human Perception and Engagement Regarding LLM Hallucinationscited by 12
- 2023Stochastic LLMs do not Understand Language: Towards Symbolic, Explainable and Ontologically Based LLMscited by 9
- 2024Open-Ended Wargames with Large Language Modelscited by 8
Built on by
Citing papers per year: 2024: 3; 2025: 13; 2026: 3.
19 papers.
Sort:
By area:
- 2024Measuring Free-Form Decision-Making Inconsistency of Language Models in Military Crisis Simulationscited by 11
- 2024Large Language Models in Politics and Democracy: A Comprehensive Surveycited by 5
- 2025Multi-level Value Alignment in Agentic AI Systems: Survey and Perspectivescited by 5
- 2025Military AI Needs Technically-Informed Regulation to Safeguard AI Research and its Applicationscited by 4
- 2025MAD-Fact: A Multi-Agent Debate Framework for Long-Form Factuality Evaluation in LLMscited by 4
- 2025Causes and Consequences of Representational Similarity in Machine Learning Modelscited by 3
- 2025Managing Escalation in Off-the-Shelf Large Language Modelscited by 2
- 2025Shall We Play a Game? Language Models for Open-ended Wargamescited by 2
- 2025DispatchMAS: Fusing taxonomy and artificial intelligence agents for emergency medical servicescited by 2
- 2025Sovereign Large Language Models: Advantages, Strategy and Regulationscited by 1
- 2025Mitigating LLM Hallucinations with Knowledge Graphs: A Case Studycited by 1
- 2025Semantic Scheduling for LLM Inferencecited by 1
7 more
- 2025Cross-Lingual Stability and Bias in Instruction-Tuned Language Models for Humanitarian NLPcited by 1
- 2024ROK Defense M&S in the Age of Hyperscale AI: Concepts, Challenges, and Future Directionscited by 0
- 2025Towards AI-Assisted Generation of Military Training Scenarioscited by 0
- 2025Data Analysis and Performance Evaluation of Simulation Deduction Based on LLMscited by 0
- 2026Domain Adapted Large Language Models for Additive Manufacturingcited by 0
- 2026Application of LLMs to Threat Assessment of Foreign Peacekeeping Missionscited by 0
- 2026Quantization-Triggered Backdoors in Language Models: Cross-Quantizer Transferability and the Validation--Deployment Gapcited by 0
- 2026Quantization-Triggered Backdoors in Language Models: Cross-Quantizer Transferability and the Validation--Deployment Gap27 Aug 2026
- 2026Application of LLMs to Threat Assessment of Foreign Peacekeeping Missions25 Jun 2026
- 2026Domain Adapted Large Language Models for Additive Manufacturing23 Mar 2026
- 2025Towards AI-Assisted Generation of Military Training Scenarios10 Nov 2025
- 2025Data Analysis and Performance Evaluation of Simulation Deduction Based on LLMs1 Nov 2025
- 2025MAD-Fact: A Multi-Agent Debate Framework for Long-Form Factuality Evaluation in LLMs27 Oct 2025
- 2025Cross-Lingual Stability and Bias in Instruction-Tuned Language Models for Humanitarian NLP26 Oct 2025
- 2025DispatchMAS: Fusing taxonomy and artificial intelligence agents for emergency medical services24 Oct 2025
- 2025Shall We Play a Game? Language Models for Open-ended Wargames21 Sep 2025
- 2025Managing Escalation in Off-the-Shelf Large Language Models1 Aug 2025
- 2025Semantic Scheduling for LLM Inference13 Jun 2025
- 2025Multi-level Value Alignment in Agentic AI Systems: Survey and Perspectives11 Jun 2025
7 more
- 2025Military AI Needs Technically-Informed Regulation to Safeguard AI Research and its Applications23 May 2025
- 2025Causes and Consequences of Representational Similarity in Machine Learning Models20 May 2025
- 2025Mitigating LLM Hallucinations with Knowledge Graphs: A Case Study16 Apr 2025
- 2025Sovereign Large Language Models: Advantages, Strategy and Regulations5 Feb 2025
- 2024Large Language Models in Politics and Democracy: A Comprehensive Survey1 Dec 2024
- 2024Measuring Free-Form Decision-Making Inconsistency of Language Models in Military Crisis Simulations17 Oct 2024
- 2024ROK Defense M&S in the Age of Hyperscale AI: Concepts, Challenges, and Future Directions1 Oct 2024
- 2024Measuring Free-Form Decision-Making Inconsistency of Language Models in Military Crisis Simulationscited by 11
- 2024Large Language Models in Politics and Democracy: A Comprehensive Surveycited by 5
- 2025Military AI Needs Technically-Informed Regulation to Safeguard AI Research and its Applicationscited by 4
- 2025Causes and Consequences of Representational Similarity in Machine Learning Modelscited by 3
- 2025Managing Escalation in Off-the-Shelf Large Language Modelscited by 2
- 2025Shall We Play a Game? Language Models for Open-ended Wargamescited by 2
- 2025Sovereign Large Language Models: Advantages, Strategy and Regulationscited by 1
- 2025Mitigating LLM Hallucinations with Knowledge Graphs: A Case Studycited by 1
- 2025Semantic Scheduling for LLM Inferencecited by 1
- 2025Cross-Lingual Stability and Bias in Instruction-Tuned Language Models for Humanitarian NLPcited by 1
- 2024ROK Defense M&S in the Age of Hyperscale AI: Concepts, Challenges, and Future Directionscited by 0
- 2025Towards AI-Assisted Generation of Military Training Scenarioscited by 0
12 most cited of 15 All 15 (JSON)
- 2026Application of LLMs to Threat Assessment of Foreign Peacekeeping Missions25 Jun 2026
- 2026Domain Adapted Large Language Models for Additive Manufacturing23 Mar 2026
- 2025Towards AI-Assisted Generation of Military Training Scenarios10 Nov 2025
- 2025Data Analysis and Performance Evaluation of Simulation Deduction Based on LLMs1 Nov 2025
- 2025Cross-Lingual Stability and Bias in Instruction-Tuned Language Models for Humanitarian NLP26 Oct 2025
- 2025Shall We Play a Game? Language Models for Open-ended Wargames21 Sep 2025
- 2025Managing Escalation in Off-the-Shelf Large Language Models1 Aug 2025
- 2025Semantic Scheduling for LLM Inference13 Jun 2025
- 2025Military AI Needs Technically-Informed Regulation to Safeguard AI Research and its Applications23 May 2025
- 2025Causes and Consequences of Representational Similarity in Machine Learning Models20 May 2025
- 2025Mitigating LLM Hallucinations with Knowledge Graphs: A Case Study16 Apr 2025
- 2025Sovereign Large Language Models: Advantages, Strategy and Regulations5 Feb 2025
12 newest of 15 All 15 (JSON)
Similar, not cited
Close in wording, no citation either way
- 2025Large Language Models in Cybersecurity: Applications, Vulnerabilities, and Defense Techniques
- 2025From Texts to Shields: Convergence of Large Language Models and Cybersecurity
- 2024Unique Security and Privacy Threats of Large Language Models: A Comprehensive Survey
- 2026ARMOR 2025: A Military-Aligned Benchmark for Evaluating Large Language Model Safety Beyond Civilian Contexts
- 2025Data Security in Large Language Models: Risks, Defense, and Directions
- 2023A Survey on Large Language Model (LLM) Security and Privacy: The Good, the Bad, and the Ugly
- 2024Recent Advances in Attack and Defense Approaches of Large Language Models
- 2024Current state of LLM Risks and AI Guardrails