mlsanityData to 7 Oct 2026

OptiLeak: Efficient Prompt Reconstruction via Reinforcement Learning in Multi-tenant LLM Services

arXiv 2602.20595 ↗First posted 24 Feb 2026cs.CR cs.AIcited by 1

On the map: Efficient LLM inference and serving → KV cache optimization

Abstract (arXiv)

Multi-tenant LLM serving frameworks widely adopt shared Key-Value caches to enhance efficiency. However, this creates side-channel vulnerabilities enabling prompt leakage attacks. Prior studies identified these attack surfaces yet focused on expanding attack vectors rather than optimizing attack performance, reporting impractically high attack costs that underestimate the true privacy risk. We propose OptiLeak, a reinforcement learning-enhanced framework that maximizes prompt reconstruction efficiency through two-stage fine-tuning. Our key insight is that domain-specific ``hard tokens'' -- terms difficult to predict yet carrying sensitive information -- can be automatically identified via likelihood ranking and used to construct preference pairs for Direct Preference Optimization, eliminating manual annotation. This enables effective preference alignment while avoiding the overfitting issues of extended supervised fine-tuning. Evaluated on three benchmarks spanning medical and financial domains, OptiLeak achieves up to 12.48× reduction in average requests per token compared to baseline approaches, with consistent improvements across model scales from 3B to 14B parameters. Our findings demonstrate that cache-based prompt leakage poses a more severe threat than previously reported, underscoring the need for robust cache isolation in production deployments.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in KV cache optimization, one of 12 directions in Efficient LLM inference and serving. Builds on 32 of its 49 references that are in the map. First posted on arXiv 24 Feb 2026.

Builds on

32 of 49 references.

Closest ancestors · 6

Same direction, newest first

  1. 2025AdaptCache: KV Cache Native Storage Hierarchy for Low-Delay and High-Quality Language Model Serving28 Aug
  2. 2025Shadow in the Cache: Unveiling and Mitigating Privacy Risks of KV-cache in LLM Inference13 Aug
  3. 2025Selective KV-Cache Sharing to Mitigate Timing Side-Channels in LLM Inference11 Aug
  4. 2024ShadowKV: KV Cache in Shadows for High-Throughput Long-Context LLM Inference28 Oct
  5. 2024InfiniGen: Efficient Generative Inference of Large Language Models with Dynamic KV Cache Management28 Jun
  6. 2023Efficient Memory Management for Large Language Model Serving with PagedAttention12 Sep

Other references · 26

  1. 2017Attention Is All You Needcited by 59,932
  2. 2017Proximal Policy Optimization Algorithmscited by 14,441
  3. 2024The Llama 3 Herd of Modelscited by 14,192
  4. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
  5. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
  6. 2020Extracting Training Data from Large Language Modelscited by 2,144
  7. 2020What Disease does this Patient Have? A Large-scale Open Domain Question Answering Dataset from Medical Examscited by 1,324
  8. 2019PubMedQA: A Dataset for Biomedical Research Question Answeringcited by 1,271
  9. 2022Red Teaming Language Models with Language Modelscited by 983
  10. 2023DecodingTrust: A Comprehensive Assessment of Trustworthiness in GPT Modelscited by 505
  11. 2021Large Language Models Can Be Strong Differentially Private Learnerscited by 405
  12. 2023FinanceBench: A New Benchmark for Financial Question Answeringcited by 261
14 more
  1. 2024AdvPrompter: Fast Adaptive Adversarial Prompting for LLMscited by 146
  2. 2023Explore, Establish, Exploit: Red Teaming Language Models from Scratchcited by 111
  3. 2024The Early Bird Catches the Leak: Unveiling Timing Side Channels in LLM Serving Systemscited by 29
  4. 2024What Was Your Prompt? A Remote Keylogging Attack on AI Assistantscited by 26
  5. 2024RL-JACK: Reinforcement Learning-powered Black-box Jailbreaking Attack against LLMscited by 21
  6. 2020A Tensor Compiler for Unified Machine Learning Prediction Servingcited by 19
  7. 2025Auditing Prompt Caching in Language Model APIscited by 19
  8. 2024InputSnatch: Stealing Input in LLM Services via Timing Side-Channel Attackscited by 16
  9. 2024LeakAgent: RL-based Red-teaming Agent for LLM Privacy Leakagecited by 13
  10. 2024DiveR-CT: Diversity-enhanced Red Teaming Large Language Model Assistants with Relaxing Constraintscited by 10
  11. 2024Time Will Tell: Timing Side Channels via Output Token Count in Large Language Modelscited by 7
  12. 2025CALM: Curiosity-Driven Auditing for Large Language Modelscited by 6
  13. 2025I Know What You Said: Unveiling Hardware Cache Side-Channels in Local Large Language Model Inferencecited by 6
  14. 2025Spill The Beans: Exploiting CPU Cache Side-Channels to Leak Tokens from Large Language Modelscited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2025Are My Optimized Prompts Compromised? Exploring Vulnerabilities of LLM-based Optimizers
  2. 2026Governing the KV Cache: Preventing Timing Side-Channel Leakage in Multi-Tenant LLM Inference
  3. 2025Joint Optimization of Prompt Security and System Performance in Edge-Cloud LLM Systems
  4. 2026Securing LLMs in the Wild: Privacy and Security Challenges at the Edge
  5. 2026Observable Channels, Not Just Storage: Evaluating Privacy Leakage in LLM Agent Pipelines
  6. 2024SecAlign: Defending Against Prompt Injection with Preference Optimization
  7. 2025Rethinking Prompt Optimizers: From Prompt Merits to Optimization
  8. 2026Prompt Control-Flow Integrity: A Priority-Aware Runtime Defense Against Prompt Injection in LLM Systems