A Survey on Offensive AI Within Cybersecurity
Not on the map. Why?
Abstract (arXiv)
Artificial Intelligence (AI) has witnessed major growth and integration across various domains. As AI systems become increasingly prevalent, they also become targets for threat actors to manipulate their functionality for malicious purposes. This survey paper on offensive AI will comprehensively cover various aspects related to attacks against and using AI systems. It will delve into the impact of offensive AI practices on different domains, including consumer, enterprise, and public digital infrastructure. The paper will explore adversarial machine learning, attacks against AI models, infrastructure, and interfaces, along with offensive techniques like information gathering, social engineering, and weaponized AI. Additionally, it will discuss the consequences and implications of offensive AI, presenting case studies, insights, and avenues for further research.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 20 of its 97 references that are in the map. First posted on arXiv 26 Sep 2024.
Builds on
20 of 97 references.
References · 20
- 2014Explaining and Harnessing Adversarial Examplescited by 7,287
- 2013Intriguing properties of neural networkscited by 5,114
- 2016Adversarial examples in the physical worldcited by 1,762
- 2023Fine-tuning Aligned Language Models Compromises Safety, Even When Users Do Not Intend To!cited by 1,106
- 2015Distillation as a Defense to Adversarial Perturbations against Deep Neural Networkscited by 675
- 2018Black-box Adversarial Attacks with Limited Queries and Informationcited by 499
- 2017Parseval Networks: Improving Robustness to Adversarial Examplescited by 288
- 2018Transfer Learning from Speaker Verification to Multispeaker Text-To-Speech Synthesiscited by 280
- 2018Adversarial Attacks and Defences: A Surveycited by 259
- 2022GitHub Copilot AI pair programmer: Asset or Liability?cited by 150
- 2023Use of LLMs for Illicit Purposes: Threats, Prevention Measures, and Vulnerabilitiescited by 76
- 2018Stealing Neural Networks via Timing Side Channelscited by 42
8 more
- 2022On the Impossible Safety of Large AI Modelscited by 27
- 2020Memristors -- from In-memory computing, Deep Learning Acceleration, Spiking Neural Networks, to the Future of Neuromorphic and Bio-inspired Computingcited by 10
- 2021On managing vulnerabilities in AI/ML systemscited by 5
- 2022The Security of Deep Learning Defences for Medical Imagingcited by 4
- 2020Online Abuse toward Candidates during the UK General Election 2019: Working Papercited by 1
- 2021Data Breaches in Healthcare Security Systemscited by 1
- 2023Identifying and examining machine learning biases on Adult datasetcited by 1
- 2023Intell-dragonfly: A Cybersecurity Attack Surface Generation Engine Based On Artificial Intelligence-generated Content Technologycited by 1
Built on by
Citing papers per year: 2025: 2; 2026: 1.
3 papers.