VortexPIA: Indirect Prompt Injection Attack against LLMs for Efficient Extraction of User Privacy
On the map: LLM safety and security → Prompt injection and agent security
Abstract (arXiv)
Large language models (LLMs) have been widely deployed in Conversational AIs (CAIs), while exposing privacy and security threats. Recent research shows that LLM-based CAIs can be manipulated to extract private information from human users, posing serious security threats. However, the methods proposed in that study rely on a white-box setting that adversaries can directly modify the system prompt. This condition is unlikely to hold in real-world deployments. The limitation raises a critical question: can unprivileged attackers still induce such privacy risks in practical LLM-integrated applications? To address this question, we propose textscVortexPIA, a novel indirect prompt injection attack that induces privacy extraction in LLM-integrated applications under black-box settings. By injecting token-efficient data containing false memories, textscVortexPIA misleads LLMs to actively request private information in batches. Unlike prior methods, textscVortexPIA allows attackers to flexibly define multiple categories of sensitive data. We evaluate textscVortexPIA on six LLMs, covering both traditional and reasoning LLMs, across four benchmark datasets. The results show that textscVortexPIA significantly outperforms baselines and achieves state-of-the-art (SOTA) performance. It also demonstrates efficient privacy requests, reduced token consumption, and enhanced robustness against defense mechanisms. We further validate textscVortexPIA on multiple realistic open-source LLM-integrated applications, demonstrating its practical effectiveness.
Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Placed in Prompt injection and agent security, one of 12 directions in LLM safety and security. First posted on arXiv 5 Oct 2025.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2025: 1; 2026: 4.
5 papers.
- 2026The Landscape of Prompt Injection Threats in LLM Agents: From Taxonomy to Analysiscited by 25
- 2025Taxonomy, Evaluation and Exploitation of IPI-Centric LLM Agent Defense Frameworkscited by 7
- 2026MemPrivacy: Privacy-Preserving Personalized Memory Management for Edge-Cloud Agentscited by 7
- 2026AgentRaft: Automated Detection of Data Over-Exposure in LLM Agentscited by 6
- 2026Confuse the Model, Control the Flow: Understanding and Mitigating Privacy Leakage from LLM Agents with Information Flow Controlcited by 0
- 2026Confuse the Model, Control the Flow: Understanding and Mitigating Privacy Leakage from LLM Agents with Information Flow Control12 Sep 2026
- 2026MemPrivacy: Privacy-Preserving Personalized Memory Management for Edge-Cloud Agents10 May 2026
- 2026AgentRaft: Automated Detection of Data Over-Exposure in LLM Agents8 Mar 2026
- 2026The Landscape of Prompt Injection Threats in LLM Agents: From Taxonomy to Analysis11 Feb 2026
- 2025Taxonomy, Evaluation and Exploitation of IPI-Centric LLM Agent Defense Frameworks19 Nov 2025