Exploiting Large Language Models (LLMs) through Deception Techniques and Persuasion Principles
Not on the map. Why?
Abstract (arXiv)
With the recent advent of Large Language Models (LLMs), such as ChatGPT from OpenAI, BARD from Google, Llama2 from Meta, and Claude from Anthropic AI, gain widespread use, ensuring their security and robustness is critical. The widespread use of these language models heavily relies on their reliability and proper usage of this fascinating technology. It is crucial to thoroughly test these models to not only ensure its quality but also possible misuses of such models by potential adversaries for illegal activities such as hacking. This paper presents a novel study focusing on exploitation of such large language models against deceptive interactions. More specifically, the paper leverages widespread and borrows well-known techniques in deception theory to investigate whether these models are susceptible to deceitful interactions. This research aims not only to highlight these risks but also to pave the way for robust countermeasures that enhance the security and integrity of language models in the face of sophisticated social engineering tactics. Through systematic experiments and analysis, we assess their performance in these critical security domains. Our results demonstrate a significant finding in that these large language models are susceptible to deception and social engineering attacks.
Key facts. Cited by 17 papers in the map (data through 7 Oct 2026). First posted on arXiv 24 Nov 2023.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2024: 6; 2025: 9; 2026: 2.
17 papers.
Sort:
By area:
- 2024Jailbreak Attacks and Defenses Against Large Language Models: A Surveycited by 215
- 2024Attacks, Defenses and Evaluations for LLM Conversation Safety: A Surveycited by 124
- 2024JailbreakZoo: Survey, Landscapes, and Horizons in Jailbreaking Large Language and Vision-Language Modelscited by 67
- 2024AI Safety in Generative AI Large Language Models: A Surveycited by 31
- 2025NeuroStrike: Neuron-Level Attacks on Aligned LLMscited by 18
- 2025Understanding and Mitigating Overrefusal in LLMs from an Unveiling Perspective of Safety Decision Boundarycited by 17
- 2024Jigsaw Puzzles: Splitting Harmful Questions to Jailbreak Large Language Modelscited by 15
- 2024Has this Fact been Edited? Detecting Knowledge Edits in Language Modelscited by 14
- 2025Persuasion Dynamics in LLMs: Investigating Robustness and Adaptability in Knowledge and Safety with DuET-PDcited by 13
- 2025Must Read: A Comprehensive Survey of Computational Persuasioncited by 12
- 2025From LLMs to MLLMs to Agents: A Survey of Emerging Paradigms in Jailbreak Attacks and Defenses within LLM Ecosystemcited by 11
- 2025Activation Approximations Can Incur Safety Vulnerabilities Even in Aligned LLMs: Comprehensive Analysis and Defensecited by 7
5 more
- 2025AI Awarenesscited by 6
- 2025Jailbreaking LLMs' Safeguard with Universal Magic Words for Text Embedding Modelscited by 5
- 2025SoK: a Comprehensive Causality Analysis Framework for Large Language Model Securitycited by 0
- 2026Fully Homomorphic Encryption on Llama 3 model for privacy preserving LLM inferencecited by 0
- 2026Transcoders for Investigating Deception in Language Modelscited by 0
- 2026Transcoders for Investigating Deception in Language Models16 Jul 2026
- 2026Fully Homomorphic Encryption on Llama 3 model for privacy preserving LLM inference14 Apr 2026
- 2025SoK: a Comprehensive Causality Analysis Framework for Large Language Model Security4 Dec 2025
- 2025NeuroStrike: Neuron-Level Attacks on Aligned LLMs15 Sep 2025
- 2025Persuasion Dynamics in LLMs: Investigating Robustness and Adaptability in Knowledge and Safety with DuET-PD24 Aug 2025
- 2025From LLMs to MLLMs to Agents: A Survey of Emerging Paradigms in Jailbreak Attacks and Defenses within LLM Ecosystem18 Jun 2025
- 2025Understanding and Mitigating Overrefusal in LLMs from an Unveiling Perspective of Safety Decision Boundary23 May 2025
- 2025Must Read: A Comprehensive Survey of Computational Persuasion12 May 2025
- 2025AI Awareness25 Apr 2025
- 2025Activation Approximations Can Incur Safety Vulnerabilities Even in Aligned LLMs: Comprehensive Analysis and Defense2 Feb 2025
- 2025Jailbreaking LLMs' Safeguard with Universal Magic Words for Text Embedding Models30 Jan 2025
- 2024Jigsaw Puzzles: Splitting Harmful Questions to Jailbreak Large Language Models15 Oct 2024
5 more
- 2024AI Safety in Generative AI Large Language Models: A Survey6 Jul 2024
- 2024Jailbreak Attacks and Defenses Against Large Language Models: A Survey5 Jul 2024
- 2024JailbreakZoo: Survey, Landscapes, and Horizons in Jailbreaking Large Language and Vision-Language Models26 Jun 2024
- 2024Has this Fact been Edited? Detecting Knowledge Edits in Language Models4 May 2024
- 2024Attacks, Defenses and Evaluations for LLM Conversation Safety: A Survey14 Feb 2024
- 2024Jailbreak Attacks and Defenses Against Large Language Models: A Surveycited by 215
- 2025Understanding and Mitigating Overrefusal in LLMs from an Unveiling Perspective of Safety Decision Boundarycited by 17
- 2025Jailbreaking LLMs' Safeguard with Universal Magic Words for Text Embedding Modelscited by 5
- 2025SoK: a Comprehensive Causality Analysis Framework for Large Language Model Securitycited by 0
- 2026Fully Homomorphic Encryption on Llama 3 model for privacy preserving LLM inferencecited by 0
- 2026Fully Homomorphic Encryption on Llama 3 model for privacy preserving LLM inference14 Apr 2026
- 2025SoK: a Comprehensive Causality Analysis Framework for Large Language Model Security4 Dec 2025
- 2025Understanding and Mitigating Overrefusal in LLMs from an Unveiling Perspective of Safety Decision Boundary23 May 2025
- 2025Jailbreaking LLMs' Safeguard with Universal Magic Words for Text Embedding Models30 Jan 2025
- 2024Jailbreak Attacks and Defenses Against Large Language Models: A Survey5 Jul 2024
- 2025NeuroStrike: Neuron-Level Attacks on Aligned LLMscited by 18
- 2025NeuroStrike: Neuron-Level Attacks on Aligned LLMs15 Sep 2025
- 2024Attacks, Defenses and Evaluations for LLM Conversation Safety: A Surveycited by 124
- 2024AI Safety in Generative AI Large Language Models: A Surveycited by 31
- 2024Has this Fact been Edited? Detecting Knowledge Edits in Language Modelscited by 14
- 2025Persuasion Dynamics in LLMs: Investigating Robustness and Adaptability in Knowledge and Safety with DuET-PDcited by 13
- 2025Must Read: A Comprehensive Survey of Computational Persuasioncited by 12
- 2025Activation Approximations Can Incur Safety Vulnerabilities Even in Aligned LLMs: Comprehensive Analysis and Defensecited by 7
- 2025AI Awarenesscited by 6
- 2026Transcoders for Investigating Deception in Language Modelscited by 0
- 2026Transcoders for Investigating Deception in Language Models16 Jul 2026
- 2025Persuasion Dynamics in LLMs: Investigating Robustness and Adaptability in Knowledge and Safety with DuET-PD24 Aug 2025
- 2025Must Read: A Comprehensive Survey of Computational Persuasion12 May 2025
- 2025AI Awareness25 Apr 2025
- 2025Activation Approximations Can Incur Safety Vulnerabilities Even in Aligned LLMs: Comprehensive Analysis and Defense2 Feb 2025
- 2024AI Safety in Generative AI Large Language Models: A Survey6 Jul 2024
- 2024Has this Fact been Edited? Detecting Knowledge Edits in Language Models4 May 2024
- 2024Attacks, Defenses and Evaluations for LLM Conversation Safety: A Survey14 Feb 2024