When Compression Becomes an Attack Surface: Black-Box Attacks on Prompt-Compressed LLM Agents
On the map: LLM agents and tool use → Agent threats, guardrails and governance
also in 2 more
Abstract (arXiv)
Prompt compression is increasingly deployed in LLM agents to reduce latency and cost, but it also determines what the backend LLM ultimately sees. We show that, when trusted and untrusted inputs are compressed under a shared budget, this lossy transformation creates a new attack surface: by perturbing only untrusted inputs before compression, an adversary can cause the compressor to discard task-critical evidence or safety guardrails before inference. Unlike prompt injection, jailbreaks, or RAG poisoning, the attack target is the compressor rather than the backend LLM; the perturbation need not encode a meaningful instruction or survive compression. We formalize this vulnerability as adversarial information loss (AIL), the excess downstream distortion caused by adversarially steering a lossy compressor beyond benign compression alone. To exploit AIL, we present COMA, a transfer-based black-box attack that optimizes pre-compression perturbations using attacker-side surrogate compressors and backend LLMs. Across three tasks and six compressors, COMA achieves 0.71 average ASR, versus 0.21 for the strongest baseline, and transfers to two real-world agent case studies.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Agent threats, guardrails and governance, one of 16 directions in LLM agents and tool use. Builds on 29 of its 55 references that are in the map. First posted on arXiv 27 Oct 2025.
Builds on
29 of 55 references.
Closest ancestors · 2
Same direction, newest first
- 2025WASP: Benchmarking Web Agent Security Against Prompt Injection Attacks22 Apr
- 2025Prompt Flow Integrity to Prevent Privilege Escalation in LLM Agents17 Mar
Other references · 27
- 2025Qwen3 Technical Reportcited by 8,195
- 2016SQuAD: 100,000+ Questions for Machine Comprehension of Textcited by 4,115
- 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,383
- 2023Universal and Transferable Adversarial Attacks on Aligned Language Modelscited by 2,914
- 2023Baseline Defenses for Adversarial Attacks Against Aligned Language Modelscited by 608
- 2023LongLLMLingua: Accelerating and Enhancing LLMs in Long Context Scenarios via Prompt Compressioncited by 443
- 2023Detecting Language Model Attacks with Perplexitycited by 411
- 2024LLMLingua-2: Data Distillation for Efficient and Faithful Task-Agnostic Prompt Compressioncited by 343
- 2024StruQ: Defending Against Prompt Injection with Structured Queriescited by 325
- 2024PoisonedRAG: Knowledge Corruption Attacks to Retrieval-Augmented Generation of Large Language Modelscited by 251
- 2022Demystifying Prompts in Language Models via Perplexity Estimationcited by 215
- 2024SecAlign: Defending Against Prompt Injection with Preference Optimizationcited by 179
15 more
- 2024Optimization-based Prompt Injection Attack to LLM-as-a-Judgecited by 123
- 2024xRAG: Extreme Context Compression for Retrieval-augmented Generation with One Tokencited by 123
- 2024PLeak: Prompt Leaking Attacks against Large Language Model Applicationscited by 113
- 2022Prompt Compression and Contrastive Conditioning for Controllability and Toxicity Reduction in Language Modelscited by 96
- 2023Effective Prompt Extraction from Language Modelscited by 83
- 2023MeetingBank: A Benchmark Dataset for Meeting Summarizationcited by 81
- 2024Learning to Compress Prompt in Natural Language Formatscited by 54
- 2023Discrete Prompt Compression with Reinforcement Learningcited by 42
- 2025LongCodeZip: Compress Long Context for Code Language Modelscited by 38
- 2025A Closer Look at System Prompt Robustnesscited by 31
- 2022Diet Code Is Healthy: Simplifying Programs for Pre-trained Models of Codecited by 24
- 2024LLM Task Interference: An Initial Study on the Impact of Task-Switch in Conversational Historycited by 19
- 2022On the Robustness of Dialogue History Representation in Conversational Question Answering: A Comprehensive Study and a New Prompt-based Methodcited by 12
- 2025SecurityLingua: Efficient Defense of LLM Jailbreak Attacks via Security-Aware Prompt Compressioncited by 12
- 2024Style-Compress: An LLM-Based Prompt Compression Framework Considering Task-Specific Stylescited by 9
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Safe to Check, Unsafe to Use: Relinking at the Compression Boundary of LLM Agents
- 2026Fix the Structural Bottleneck: Context Compression via Explicit Information Transmission
- 2026Still There, No Longer Seen: Exposing Compression-Induced Risk in Large Vision-Language Models
- 2026Assessing Automated Prompt Injection Attacks in Agentic Environments
- 2026SkillBloat: Token Amplification Attacks via Skill Injection in LLM Coding Agents
- 2026Fidelity Is Not Safety: Gently-Compressed LLMs Pass Every Data-Free Quality Guard Yet Invent Procedure Steps in Agentic Execution
- 2026Compression Method Matters: Benchmark-Dependent Output Dynamics in LLM Prompt Compression
- 2026AgentSecBench: Measuring Prompt Injection, Privacy Leakage, and Tool-Use Integrity in LLM Agents