mlsanityData to 7 Oct 2026

Bit-Flip Vulnerability of Shared KV-Cache Blocks in LLM Serving Systems

arXiv 2604.17249 ↗First posted 19 Apr 2026cs.CR cs.AR cs.LGcited by 0

On the map: Efficient LLM inference and serving → KV cache optimization

Abstract (arXiv)

Rowhammer on GPU DRAM has enabled adversarial bit flips in model weights; shared KV-cache blocks in LLM serving systems present an analogous but previously unexamined target. In vLLM's Prefix Caching, these blocks exist as a single physical copy without integrity protection. Using software fault injection under ideal bit targeting, we characterize worst-case severity and identify three properties: (1) Silent divergence - 13 of 16 BF16 bit positions produce coherent but altered outputs, indistinguishable from legitimate responses without a clean baseline. (2) Selective propagation - only requests sharing the targeted prefix are affected. (3) Persistent accumulation - no temporal decay occurs, so cumulative damage grows linearly with subsequent requests. Together, these constitute a threat profile distinct from weight corruption: silent divergence and selective propagation enable detection evasion; persistent accumulation then proceeds unchecked, yielding damage amplification bounded only by how long the block remains cached. A checksum-based countermeasure detects any single-bit corruption at scheduling time, bounding cumulative damage to one batch independent of the block's cache lifetime, with negligible overhead. These results argue for integrity protection of prefix blocks before end-to-end exploitation is demonstrated.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in KV cache optimization, one of 12 directions in Efficient LLM inference and serving. Builds on 16 of its 31 references that are in the map. First posted on arXiv 19 Apr 2026.

Builds on

16 of 31 references.

Closest ancestors · 3

Same direction, newest first

  1. 2025Whose Narrative is it Anyway? A KV Cache Manipulation Attack16 Nov
  2. 2025Kelle: Co-design KV Caching and eDRAM for Efficient LLM Serving in Edge Computing16 Oct
  3. 2023Efficient Memory Management for Large Language Model Serving with PagedAttention12 Sep

Other references · 13

  1. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
  2. 2019BERTScore: Evaluating Text Generation with BERTcited by 5,462
  3. 2019A Study of BFLOAT16 for Deep Learning Trainingcited by 227
  4. 2019Bit-Flip Attack: Crushing Neural Network with Progressive Bit Searchcited by 106
  5. 2020DeepHammer: Depleting the Intelligence of Deep Neural Networks through Targeted Chain of Bit Flipscited by 53
  6. 2024The Early Bird Catches the Leak: Unveiling Timing Side Channels in LLM Serving Systemscited by 29
  7. 2025GPUHammer: Rowhammer Attacks on GPU Memories are Practicalcited by 11
  8. 2024GenBFA: An Evolutionary Optimization Approach to Bit-Flip Attacks on LLMscited by 10
  9. 2015Rowhammer.js: A Remote Software-Induced Fault Attack in JavaScriptcited by 9
  10. 2025SBFA: Single Sneaky Bit Flip Attack to Break Large Language Modelscited by 5
  11. 2024PrisonBreak: Jailbreaking Large Language Models with at Most Twenty-Five Targeted Bit-flipscited by 3
  12. 2025Has the Two-Decade-Old Prophecy Come True? Artificial Bad Intelligence Triggered by Merely a Single-Bit Flip in Large Language Modelscited by 2
1 more
  1. 2026TFL: Targeted Bit-Flip Attack on Large Language Modelcited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Characterizing Contention-Induced Reliability Collapse in KV-Cache Timing Side Channels for Multi-Tenant LLM Serving
  2. 2026Governing the KV Cache: Preventing Timing Side-Channel Leakage in Multi-Tenant LLM Inference
  3. 2026From Tensor Buffer to Distributed Memory Hierarchy: A Survey of KV Cache Management for LLM Serving
  4. 2026CacheRoute: Planned Prefix-Affinity Routing for Large-Scale LLM Serving
  5. 2026Continuous Discovery of Vulnerabilities in LLM Serving Systems with Fuzzing
  6. 2026Risk-Controlled KV-Cache Eviction: From Memory Budgets to Risk Targets
  7. 2026PulseInfer: I/O-Centric Sparse KV Cache Offloading for Efficient Long-Context LLM Decoding
  8. 2025TraCT: Disaggregated LLM Serving with CXL Shared Memory KV Cache at Rack-Scale