Low-Latency Edge LLM Handover via Joint KV Cache Transfer and Token Prefill
Not on the map. Why?
Abstract (arXiv)
Edge deployment of large language models (LLMs) can reduce latency for interactive services, but mobility introduces service interruptions when an user equipment (UE) hands over between base stations (BSs). To promptly resume decoding, the target-side edge server must recover the UE context state, which can be provisioned either by token forwarding followed by prefill computation or by direct key-value (KV) cache transmission over backhaul. This paper proposes a unified handover (HO) design that jointly selects the prefill length and schedules backhaul KV cache delivery to minimize the worst-user LLM HO delay for multiple UEs. The resulting scheme admits a tractable step-wise solution with explicit feasibility conditions and a constructive rate-scheduling policy. Simulations show that the proposed method consistently outperforms baselines across a wide range of backhaul capacities, prefill speeds, and context sizes, providing practical guidelines for mobility-aware Edge LLM token streaming.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). First posted on arXiv 30 Mar 2026.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026Beyond tokens: a unified framework for latent communication in LLM-based multi-agent systemscited by 7
- 2026ImpactHO: Importance-Aware KV Cache Transfer for Multi-User Edge LLM Handovercited by 0
- 2026Pallas: A Proactive KV Cache Migration Framework for LLM Inference in AI-RANcited by 0
- 2026From Semantic to Token Communication: The Next Paradigm for Large-Model-Driven 6G Intelligent Connectivitycited by 0
- 2026From Semantic to Token Communication: The Next Paradigm for Large-Model-Driven 6G Intelligent Connectivity9 Sep 2026
- 2026Pallas: A Proactive KV Cache Migration Framework for LLM Inference in AI-RAN17 Aug 2026
- 2026ImpactHO: Importance-Aware KV Cache Transfer for Multi-User Edge LLM Handover11 Aug 2026
- 2026Beyond tokens: a unified framework for latent communication in LLM-based multi-agent systems4 Jun 2026