Unique Security and Privacy Threats of Large Language Models: A Comprehensive Survey
Not on the map. Why?
Abstract (arXiv)
With the rapid development of artificial intelligence, large language models (LLMs) have made remarkable advancements in natural language processing. These models are trained on vast datasets to exhibit powerful language understanding and generation capabilities across various applications, including chatbots, and agents. However, LLMs have revealed a variety of privacy and security issues throughout their life cycle, drawing significant academic and industrial attention. Moreover, the risks faced by LLMs differ significantly from those encountered by traditional language models. Given that current surveys lack a clear taxonomy of unique threat models across diverse scenarios, we emphasize the unique privacy and security threats associated with four specific scenarios: pre-training, fine-tuning, deployment, and LLM-based agents. Addressing the characteristics of each risk, this survey outlines and analyzes potential countermeasures. Research on attack and defense situations can offer feasible research directions, enabling more areas to benefit from LLMs.
Key facts. Cited by 20 papers in the map (data through 7 Oct 2026). First posted on arXiv 12 Jun 2024.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2024: 3; 2025: 5; 2026: 12.
20 papers.
Sort:
By area:
- 2024The Emerged Security and Privacy of LLM Agent: A Survey with Case Studiescited by 127
- 2024When Machine Unlearning Meets Retrieval-Augmented Generation (RAG): Keep Secret or Forget Knowledge?cited by 20
- 20251-2-3 Check: Enhancing Contextual Privacy in LLM via Multi-Agent Reasoningcited by 16
- 2025The Trust Paradox in LLM-Based Multi-Agent Systems: When Collaboration Becomes a Security Vulnerabilitycited by 11
- 2025SoK: Trust-Authorization Mismatch in LLM Agent Interactionscited by 11
- 2026SoK: Privacy Risks and Mitigations in Retrieval-Augmented Generation Systemscited by 7
- 2024PromptExp: Multi-granularity Prompt Explanation of Large Language Modelscited by 6
- 2025Toward a Safe Internet of Agentscited by 6
- 2026CAPID: Context-Aware PII Detection for Question-Answering Systemscited by 3
- 2026Guided Collaboration in Heterogeneous LLM-Based Multi-Agent Systems via Entropy-Based Understanding Assessment and Experience Retrievalcited by 2
- 2026Triaging Threats to Specialized Guardrailscited by 1
- 2026FORGE: Research-Trajectory Hijacking Attacks on Deep Research Agentscited by 1
8 more
- 2025Routing-Based Continual Learning for Multimodal Large Language Modelscited by 0
- 2026Towards Privacy-Preserving Mental Health Support with Large Language Modelscited by 0
- 2026A Case Study on the Impact of Anonymization Along the RAG Pipelinecited by 0
- 2026AVISE: Framework for Evaluating the Security of AI Systemscited by 0
- 2026On the Privacy of LLMs: An Ablation Studycited by 0
- 2026On Understanding, Identifying, and Mitigating Vulnerabilities in Agentic Large Language Modelscited by 0
- 2026Where A Small Language Model Helps in Invoice Categorisation, Understood Through Embedding Geometrycited by 0
- 2026Privacy in Personalized AI Is a System Property, Not Just a Model Propertycited by 0
- 2026Privacy in Personalized AI Is a System Property, Not Just a Model Property29 Sep 2026
- 2026Where A Small Language Model Helps in Invoice Categorisation, Understood Through Embedding Geometry18 Aug 2026
- 2026On Understanding, Identifying, and Mitigating Vulnerabilities in Agentic Large Language Models11 Aug 2026
- 2026FORGE: Research-Trajectory Hijacking Attacks on Deep Research Agents6 Jul 2026
- 2026Triaging Threats to Specialized Guardrails29 May 2026
- 2026On the Privacy of LLMs: An Ablation Study4 May 2026
- 2026AVISE: Framework for Evaluating the Security of AI Systems22 Apr 2026
- 2026A Case Study on the Impact of Anonymization Along the RAG Pipeline17 Apr 2026
- 2026Guided Collaboration in Heterogeneous LLM-Based Multi-Agent Systems via Entropy-Based Understanding Assessment and Experience Retrieval14 Feb 2026
- 2026CAPID: Context-Aware PII Detection for Question-Answering Systems10 Feb 2026
- 2026SoK: Privacy Risks and Mitigations in Retrieval-Augmented Generation Systems7 Jan 2026
- 2026Towards Privacy-Preserving Mental Health Support with Large Language Models5 Jan 2026
8 more
- 2025SoK: Trust-Authorization Mismatch in LLM Agent Interactions7 Dec 2025
- 2025Toward a Safe Internet of Agents29 Nov 2025
- 2025Routing-Based Continual Learning for Multimodal Large Language Models3 Nov 2025
- 2025The Trust Paradox in LLM-Based Multi-Agent Systems: When Collaboration Becomes a Security Vulnerability21 Oct 2025
- 20251-2-3 Check: Enhancing Contextual Privacy in LLM via Multi-Agent Reasoning11 Aug 2025
- 2024When Machine Unlearning Meets Retrieval-Augmented Generation (RAG): Keep Secret or Forget Knowledge?20 Oct 2024
- 2024PromptExp: Multi-granularity Prompt Explanation of Large Language Models16 Oct 2024
- 2024The Emerged Security and Privacy of LLM Agent: A Survey with Case Studies28 Jul 2024
- 2024The Emerged Security and Privacy of LLM Agent: A Survey with Case Studiescited by 127
- 2025The Trust Paradox in LLM-Based Multi-Agent Systems: When Collaboration Becomes a Security Vulnerabilitycited by 11
- 2025SoK: Trust-Authorization Mismatch in LLM Agent Interactionscited by 11
- 2025Toward a Safe Internet of Agentscited by 6
- 2026FORGE: Research-Trajectory Hijacking Attacks on Deep Research Agentscited by 1
- 2026On Understanding, Identifying, and Mitigating Vulnerabilities in Agentic Large Language Modelscited by 0
- 2026On Understanding, Identifying, and Mitigating Vulnerabilities in Agentic Large Language Models11 Aug 2026
- 2026FORGE: Research-Trajectory Hijacking Attacks on Deep Research Agents6 Jul 2026
- 2025SoK: Trust-Authorization Mismatch in LLM Agent Interactions7 Dec 2025
- 2025Toward a Safe Internet of Agents29 Nov 2025
- 2025The Trust Paradox in LLM-Based Multi-Agent Systems: When Collaboration Becomes a Security Vulnerability21 Oct 2025
- 2024The Emerged Security and Privacy of LLM Agent: A Survey with Case Studies28 Jul 2024
- 2024When Machine Unlearning Meets Retrieval-Augmented Generation (RAG): Keep Secret or Forget Knowledge?cited by 20
- 2026SoK: Privacy Risks and Mitigations in Retrieval-Augmented Generation Systemscited by 7
- 2026A Case Study on the Impact of Anonymization Along the RAG Pipelinecited by 0
- 2026On the Privacy of LLMs: An Ablation Studycited by 0
- 2026On the Privacy of LLMs: An Ablation Study4 May 2026
- 2026A Case Study on the Impact of Anonymization Along the RAG Pipeline17 Apr 2026
- 2026SoK: Privacy Risks and Mitigations in Retrieval-Augmented Generation Systems7 Jan 2026
- 2024When Machine Unlearning Meets Retrieval-Augmented Generation (RAG): Keep Secret or Forget Knowledge?20 Oct 2024
- 2026Triaging Threats to Specialized Guardrailscited by 1
- 2026AVISE: Framework for Evaluating the Security of AI Systemscited by 0
- 2026Triaging Threats to Specialized Guardrails29 May 2026
- 2026AVISE: Framework for Evaluating the Security of AI Systems22 Apr 2026
- 2024PromptExp: Multi-granularity Prompt Explanation of Large Language Modelscited by 6
- 2026CAPID: Context-Aware PII Detection for Question-Answering Systemscited by 3
- 2026Towards Privacy-Preserving Mental Health Support with Large Language Modelscited by 0
- 2026Where A Small Language Model Helps in Invoice Categorisation, Understood Through Embedding Geometrycited by 0
- 2026Privacy in Personalized AI Is a System Property, Not Just a Model Propertycited by 0
- 2026Privacy in Personalized AI Is a System Property, Not Just a Model Property29 Sep 2026
- 2026Where A Small Language Model Helps in Invoice Categorisation, Understood Through Embedding Geometry18 Aug 2026
- 2026CAPID: Context-Aware PII Detection for Question-Answering Systems10 Feb 2026
- 2026Towards Privacy-Preserving Mental Health Support with Large Language Models5 Jan 2026
- 2024PromptExp: Multi-granularity Prompt Explanation of Large Language Models16 Oct 2024
Similar, not cited
Close in wording, no citation either way
- 2025Security Concerns for Large Language Models: A Survey
- 2024Navigating the Risks: A Survey of Security, Privacy, and Ethics Threats in LLM-Based Agents
- 2023A Survey on Large Language Model (LLM) Security and Privacy: The Good, the Bad, and the Ugly
- 2025SoK: The Privacy Paradox of Large Language Models: Advancements, Privacy Risks, and Mitigation
- 2025A Survey of Attacks on Large Language Models
- 2025Data Security in Large Language Models: Risks, Defense, and Directions
- 2024Large Language Model Safety: A Holistic Survey
- 2024Fortifying Ethical Boundaries in AI: Advanced Strategies for Enhancing Security in Large Language Models