mlsanityData to 7 Oct 2026

Impacts and Risk of Generative AI Technology on Cyber Defense

arXiv 2306.13033 ↗First posted 22 Jun 2023cs.CR cs.AIcited by 8

Not on the map. Why?

Abstract (arXiv)

Generative Artificial Intelligence (GenAI) has emerged as a powerful technology capable of autonomously producing highly realistic content in various domains, such as text, images, audio, and videos. With its potential for positive applications in creative arts, content generation, virtual assistants, and data synthesis, GenAI has garnered significant attention and adoption. However, the increasing adoption of GenAI raises concerns about its potential misuse for crafting convincing phishing emails, generating disinformation through deepfake videos, and spreading misinformation via authentic-looking social media posts, posing a new set of challenges and risks in the realm of cybersecurity. To combat the threats posed by GenAI, we propose leveraging the Cyber Kill Chain (CKC) to understand the lifecycle of cyberattacks, as a foundational model for cyber defense. This paper aims to provide a comprehensive analysis of the risk areas introduced by the offensive use of GenAI techniques in each phase of the CKC framework. We also analyze the strategies employed by threat actors and examine their utilization throughout different phases of the CKC, highlighting the implications for cyber defense. Additionally, we propose GenAI-enabled defense strategies that are both attack-aware and adaptive. These strategies encompass various techniques such as detection, deception, and adversarial training, among others, aiming to effectively mitigate the risks posed by GenAI-induced cyber threats.

Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Builds on 43 of its 104 references that are in the map. First posted on arXiv 22 Jun 2023.

Builds on

43 of 104 references.

References · 43

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2020Language Models are Few-Shot Learnerscited by 32,199
  3. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
  4. 2021Evaluating Large Language Models Trained on Codecited by 8,053
  5. 2022Generative Adversarial Networkscited by 5,603
  6. 2021Zero-Shot Text-to-Image Generationcited by 4,276
  7. 2013Auto-Encoding Variational Bayescited by 3,980
  8. 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 3,972
  9. 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,006
  10. 2021Variational Diffusion Modelscited by 1,145
  11. 2017BadNets: Identifying Vulnerabilities in the Machine Learning Model Supply Chaincited by 1,052
  12. 2015Distillation as a Defense to Adversarial Perturbations against Deep Neural Networkscited by 675
31 more
  1. 2022AudioLM: a Language Modeling Approach to Audio Generationcited by 611
  2. 2022Phenaki: Variable Length Video Generation From Open Domain Textual Descriptioncited by 475
  3. 2016NIPS 2016 Tutorial: Generative Adversarial Networkscited by 284
  4. 2019MAD-GAN: Multivariate Anomaly Detection for Time Series Data with Generative Adversarial Networkscited by 176
  5. 2020TweepFake: about Detecting Deepfake Tweetscited by 117
  6. 2019Deep Reinforcement Learning for Cyber Securitycited by 92
  7. 2017Generating Adversarial Malware Examples for Black-Box Attacks Based on GANcited by 74
  8. 2019SteganoGAN: High Capacity Image Steganography with GANscited by 70
  9. 2021T-Miner: A Generative Approach to Defend Against Trojan Attacks on DNN-based Text Classificationcited by 56
  10. 2020TadGAN: Time Series Anomaly Detection Using Generative Adversarial Networkscited by 55
  11. 2019Generating Sentiment-Preserving Fake Online Reviews Using Neural Language Models and Their Human- and Machine-based Detectioncited by 50
  12. 2018IDSGAN: Generative Adversarial Networks for Attack Generation against Intrusion Detectioncited by 41
  13. 2019When Explainability Meets Adversarial Learning: Detecting Adversarial Examples using SHAP Signaturescited by 40
  14. 2021The Threat of Offensive AI to Organizationscited by 37
  15. 2020TAnoGAN: Time Series Anomaly Detection with Generative Adversarial Networkscited by 29
  16. 2021Generating Fake Cyber Threat Intelligence Using Transformer-Based Modelscited by 28
  17. 2022Explainable Intrusion Detection Systems (X-IDS): A Survey of Current Methods, Challenges, and Opportunitiescited by 25
  18. 2016DeepDGA: Adversarially-Tuned Domain Generation and Detectioncited by 14
  19. 2021EvilModel 2.0: Bringing Neural Network Models into Malware Attackscited by 13
  20. 2019RelExt: Relation Extraction using Deep Learning approaches for Cybersecurity Knowledge Graph Improvementcited by 12
  21. 2019Automated email Generation for Targeted Attacks using Natural Languagecited by 8
  22. 2022Multi-SpacePhish: Extending the Evasion-space of Adversarial Attacks against Phishing Website Detectors using Machine Learningcited by 7
  23. 2022An Intrusion Response System utilizing Deep Q-Networks and System Partitionscited by 6
  24. 2022Creating an Explainable Intrusion Detection System Using Self Organizing Mapscited by 6
  25. 2023TwinExplainer: Explaining Predictions of an Automotive Digital Twincited by 6
  26. 2023Maximizing Penetration Testing Success with Effective Reconnaissance Techniques using ChatGPTcited by 5
  27. 2018Preventing Poisoning Attacks on AI based Threat Intelligence Systemscited by 4
  28. 2020Flow-based detection and proxy-based evasion of encrypted malware C2 trafficcited by 2
  29. 2020DeepC2: AI-powered Covert Command and Control on OSNscited by 2
  30. 2021Deep Generative Models to Extend Active Directory Graphs with Honeypot Userscited by 2
  31. 2019Can Machine Learning Model with Static Features be Fooled: an Adversarial Machine Learning Approachcited by 1

Built on by

Cited by year

Citing papers per year: 2024: 5; 2025: 3.

8 papers.

  1. 2024Large Language Models in Cybersecurity: State-of-the-Artcited by 34
  2. 2024LOCALINTEL: Generating Organizational Threat Intelligence from Global and Local Cyber Knowledgecited by 22
  3. 2024ChatNVD: Advancing Cybersecurity Vulnerability Assessment with Large Language Modelscited by 11
  4. 2024Use of Graph Neural Networks in Aiding Defensive Cyber Operationscited by 7
  5. 2025GenWorld: Towards Detecting AI-generated Real-world Simulation Videoscited by 7
  6. 2024A Survey on Privacy Attacks Against Digital Twin Systems in AI-Roboticscited by 3
  7. 2025Generative AI for Internet of Things Security: Challenges and Opportunitiescited by 1
  8. 2025Challenges in GenAI and Authentication: a scoping reviewcited by 0