Decoding the Threat Landscape : ChatGPT, FraudGPT, and WormGPT in Social Engineering Attacks
Not on the map. Why?
Abstract (arXiv)
In the ever-evolving realm of cybersecurity, the rise of generative AI models like ChatGPT, FraudGPT, and WormGPT has introduced both innovative solutions and unprecedented challenges. This research delves into the multifaceted applications of generative AI in social engineering attacks, offering insights into the evolving threat landscape using the blog mining technique. Generative AI models have revolutionized the field of cyberattacks, empowering malicious actors to craft convincing and personalized phishing lures, manipulate public opinion through deepfakes, and exploit human cognitive biases. These models, ChatGPT, FraudGPT, and WormGPT, have augmented existing threats and ushered in new dimensions of risk. From phishing campaigns that mimic trusted organizations to deepfake technology impersonating authoritative figures, we explore how generative AI amplifies the arsenal of cybercriminals. Furthermore, we shed light on the vulnerabilities that AI-driven social engineering exploits, including psychological manipulation, targeted phishing, and the crisis of authenticity. To counter these threats, we outline a range of strategies, including traditional security measures, AI-powered security solutions, and collaborative approaches in cybersecurity. We emphasize the importance of staying vigilant, fostering awareness, and strengthening regulations in the battle against AI-enhanced social engineering attacks. In an environment characterized by the rapid evolution of AI models and a lack of training data, defending against generative AI threats requires constant adaptation and the collective efforts of individuals, organizations, and governments. This research seeks to provide a comprehensive understanding of the dynamic interplay between generative AI and social engineering attacks, equipping stakeholders with the knowledge to navigate this intricate cybersecurity landscape.
Key facts. Cited by 23 papers in the map (data through 14 Oct 2026). First posted on arXiv 9 Oct 2023.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2023: 3; 2024: 9; 2025: 9; 2026: 2.
23 papers.
Sort:
By area:
- 2023A Survey on Large Language Model (LLM) Security and Privacy: The Good, the Bad, and the Uglycited by 387
- 2024AutoAttacker: A Large Language Model Guided System to Implement Automatic Cyber-attackscited by 96
- 2025Open Challenges in Multi-Agent Security: Towards Secure Systems of Interacting AI Agentscited by 71
- 2024Large Language Models for Cyber Security: A Systematic Literature Reviewcited by 68
- 2024HackSynth: LLM Agent and Evaluation Framework for Autonomous Penetration Testingcited by 37
- 2023Advancements in Generative AI: A Comprehensive Review of GANs, GPT, Autoencoders, Diffusion Model, and Transformerscited by 36
- 2024Large Language Models in Cybersecurity: State-of-the-Artcited by 34
- 2024JailbreakEval: An Integrated Toolkit for Evaluating Jailbreak Attempts Against Large Language Modelscited by 31
- 2024History, Development, and Principles of Large Language Models-An Introductory Surveycited by 30
- 2024Depending on yourself when you should: Mentoring LLM with RL agents to become the master in cybersecurity gamescited by 20
- 2024Mapping the Ethics of Generative AI: A Comprehensive Scoping Reviewcited by 19
- 2025Estimating Worst-Case Frontier Risks of Open-Weight LLMscited by 19
11 more
- 2025Large Language Model (LLM) for Software Security: Code Analysis, Malware Analysis, Reverse Engineeringcited by 15
- 2024Review of Generative AI Methods in Cybersecuritycited by 9
- 2025Do LLMs Consider Security? An Empirical Study on Responses to Programming Questionscited by 9
- 2025RedTeamLLM: an Agentic AI framework for offensive securitycited by 7
- 2025Automated Privacy Information Annotation in Large Language Model Interactionscited by 6
- 2023Survey on AI Ethics: A Socio-technical Perspectivecited by 4
- 2025Position: It's Time to Act on the Risk of Efficient Personalized Text Generationcited by 1
- 2026UNSEEN: A Cross-Stack LLM Unlearning Defense against AR-LLM Social Engineering Attackscited by 1
- 2026PhySE: A Psychological Framework for Real-Time AR-LLM Social Engineering Attackscited by 1
- 2025Analysing Safety Risks in LLMs Fine-Tuned with Pseudo-Malicious Cyber Security Datacited by 0
- 2025PhishKey: A Novel Centroid-Based Approach for Enhanced Phishing Detection Using Adaptive HTML Component Extractioncited by 0
- 2026PhySE: A Psychological Framework for Real-Time AR-LLM Social Engineering Attacks25 Apr 2026
- 2026UNSEEN: A Cross-Stack LLM Unlearning Defense against AR-LLM Social Engineering Attacks25 Apr 2026
- 2025Estimating Worst-Case Frontier Risks of Open-Weight LLMs5 Aug 2025
- 2025PhishKey: A Novel Centroid-Based Approach for Enhanced Phishing Detection Using Adaptive HTML Component Extraction26 Jun 2025
- 2025Automated Privacy Information Annotation in Large Language Model Interactions27 May 2025
- 2025Analysing Safety Risks in LLMs Fine-Tuned with Pseudo-Malicious Cyber Security Data15 May 2025
- 2025RedTeamLLM: an Agentic AI framework for offensive security11 May 2025
- 2025Open Challenges in Multi-Agent Security: Towards Secure Systems of Interacting AI Agents4 May 2025
- 2025Large Language Model (LLM) for Software Security: Code Analysis, Malware Analysis, Reverse Engineering7 Apr 2025
- 2025Do LLMs Consider Security? An Empirical Study on Responses to Programming Questions20 Feb 2025
- 2025Position: It's Time to Act on the Risk of Efficient Personalized Text Generation10 Feb 2025
- 2024HackSynth: LLM Agent and Evaluation Framework for Autonomous Penetration Testing2 Dec 2024
11 more
- 2024JailbreakEval: An Integrated Toolkit for Evaluating Jailbreak Attempts Against Large Language Models13 Jun 2024
- 2024Large Language Models for Cyber Security: A Systematic Literature Review8 May 2024
- 2024Depending on yourself when you should: Mentoring LLM with RL agents to become the master in cybersecurity games26 Mar 2024
- 2024Review of Generative AI Methods in Cybersecurity13 Mar 2024
- 2024AutoAttacker: A Large Language Model Guided System to Implement Automatic Cyber-attacks2 Mar 2024
- 2024Mapping the Ethics of Generative AI: A Comprehensive Scoping Review13 Feb 2024
- 2024History, Development, and Principles of Large Language Models-An Introductory Survey10 Feb 2024
- 2024Large Language Models in Cybersecurity: State-of-the-Art30 Jan 2024
- 2023A Survey on Large Language Model (LLM) Security and Privacy: The Good, the Bad, and the Ugly4 Dec 2023
- 2023Survey on AI Ethics: A Socio-technical Perspective28 Nov 2023
- 2023Advancements in Generative AI: A Comprehensive Review of GANs, GPT, Autoencoders, Diffusion Model, and Transformers17 Nov 2023
- 2025Open Challenges in Multi-Agent Security: Towards Secure Systems of Interacting AI Agentscited by 71
- 2024JailbreakEval: An Integrated Toolkit for Evaluating Jailbreak Attempts Against Large Language Modelscited by 31
- 2024Review of Generative AI Methods in Cybersecuritycited by 9
- 2026UNSEEN: A Cross-Stack LLM Unlearning Defense against AR-LLM Social Engineering Attackscited by 1
- 2025Analysing Safety Risks in LLMs Fine-Tuned with Pseudo-Malicious Cyber Security Datacited by 0
- 2026UNSEEN: A Cross-Stack LLM Unlearning Defense against AR-LLM Social Engineering Attacks25 Apr 2026
- 2025Analysing Safety Risks in LLMs Fine-Tuned with Pseudo-Malicious Cyber Security Data15 May 2025
- 2025Open Challenges in Multi-Agent Security: Towards Secure Systems of Interacting AI Agents4 May 2025
- 2024JailbreakEval: An Integrated Toolkit for Evaluating Jailbreak Attempts Against Large Language Models13 Jun 2024
- 2024Review of Generative AI Methods in Cybersecurity13 Mar 2024
- 2023A Survey on Large Language Model (LLM) Security and Privacy: The Good, the Bad, and the Uglycited by 387
- 2024AutoAttacker: A Large Language Model Guided System to Implement Automatic Cyber-attackscited by 96
- 2024Large Language Models for Cyber Security: A Systematic Literature Reviewcited by 68
- 2024Large Language Models in Cybersecurity: State-of-the-Artcited by 34
- 2024History, Development, and Principles of Large Language Models-An Introductory Surveycited by 30
- 2024Mapping the Ethics of Generative AI: A Comprehensive Scoping Reviewcited by 19
- 2025Estimating Worst-Case Frontier Risks of Open-Weight LLMscited by 19
- 2025Large Language Model (LLM) for Software Security: Code Analysis, Malware Analysis, Reverse Engineeringcited by 15
- 2025Do LLMs Consider Security? An Empirical Study on Responses to Programming Questionscited by 9
- 2025Automated Privacy Information Annotation in Large Language Model Interactionscited by 6
- 2023Survey on AI Ethics: A Socio-technical Perspectivecited by 4
- 2025Position: It's Time to Act on the Risk of Efficient Personalized Text Generationcited by 1
12 most cited of 14 All 14 (JSON)
- 2026PhySE: A Psychological Framework for Real-Time AR-LLM Social Engineering Attacks25 Apr 2026
- 2025Estimating Worst-Case Frontier Risks of Open-Weight LLMs5 Aug 2025
- 2025PhishKey: A Novel Centroid-Based Approach for Enhanced Phishing Detection Using Adaptive HTML Component Extraction26 Jun 2025
- 2025Automated Privacy Information Annotation in Large Language Model Interactions27 May 2025
- 2025Large Language Model (LLM) for Software Security: Code Analysis, Malware Analysis, Reverse Engineering7 Apr 2025
- 2025Do LLMs Consider Security? An Empirical Study on Responses to Programming Questions20 Feb 2025
- 2025Position: It's Time to Act on the Risk of Efficient Personalized Text Generation10 Feb 2025
- 2024Large Language Models for Cyber Security: A Systematic Literature Review8 May 2024
- 2024AutoAttacker: A Large Language Model Guided System to Implement Automatic Cyber-attacks2 Mar 2024
- 2024Mapping the Ethics of Generative AI: A Comprehensive Scoping Review13 Feb 2024
- 2024History, Development, and Principles of Large Language Models-An Introductory Survey10 Feb 2024
- 2024Large Language Models in Cybersecurity: State-of-the-Art30 Jan 2024
12 newest of 14 All 14 (JSON)