ST-Lite: Training-Free KV Cache Compression with Spatio-Trajectory Guidance for Long-Horizon GUI Agents
On the map: Efficient LLM inference and serving → Visual token pruning in multimodal models
Abstract (arXiv)
Training-free KV cache compression is essential for deploying vision-language GUI agents under memory and latency constraints, yet existing methods are designed for generic language workloads and ignore the distinctive structure of GUI interaction traces. We characterize three GUI-specific workload properties--high inter-frame visual redundancy, extremely small UI-element spatial footprints, and near-uniform cross-layer attention sparsity--that cause existing schemes to retain as few as 39% of oracle-important KV pairs at the standard 20% budget. To address this, we propose ST-Lite, a training-free compression scheme whose three components each target one property: Trajectory-aware Semantic Gating (TSG) filters redundant historical frames, Component-centric Spatial Saliency (CSS) preserves fine-grained element boundaries, and a flat per-layer budget avoids hierarchical misallocation. Across seven GUI benchmarks and two backbones in the deployment-relevant 10%-40% window, ST-Lite consistently outperforms all existing compression baselines, matching or exceeding Full Cache task accuracy on the primary backbone at the 20% budget while delivering up to 2.35x decoding speedup at fivefold compression. The implementation is available at https://github.com/94wen94/ST-Lite.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in Visual token pruning in multimodal models, one of 12 directions in Efficient LLM inference and serving. Builds on 33 of its 42 references that are in the map. First posted on arXiv 27 Feb 2026.
Builds on
33 of 42 references.
Closest ancestors · 4
Same direction, newest first
- 2026Spatio-Temporal Token Pruning for Efficient High-Resolution GUI Agents26 Feb
- 2025GUI-KV: Efficient GUI Agents via KV Cache with Spatio-Temporal Awareness1 Oct
- 2024PrefixKV: Adaptive Prefix KV Cache is What Vision Instruction-Following Models Need for Efficient Generation4 Dec
- 2024VL-Cache: Sparsity and Modality-Aware KV Cache Compression for Vision-Language Model Inference Acceleration29 Oct
Other references · 29
- 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,234
- 2023Efficient Streaming Language Models with Attention Sinkscited by 2,186
- 2024OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environmentscited by 1,195
- 2024SnapKV: LLM Knows What You are Looking for Before Generationcited by 880
- 2025SFT Memorizes, RL Generalizes: A Comparative Study of Foundation Model Post-trainingcited by 672
- 2024KIVI: A Tuning-Free Asymmetric 2bit Quantization for KV Cachecited by 637
- 2025UI-TARS: Pioneering Automated GUI Interaction with Native Agentscited by 610
- 2024KVQuant: Towards 10 Million Context Length LLM Inference with KV Cache Quantizationcited by 591
- 2024PyramidKV: Dynamic KV Cache Compression based on Pyramidal Information Funnelingcited by 432
- 2023AppAgent: Multimodal Agents as Smartphone Userscited by 415
- 2024OS-ATLAS: A Foundation Action Model for Generalist GUI Agentscited by 378
- 2024WebRL: Training LLM Web Agents via Self-Evolving Online Curriculum Reinforcement Learningcited by 256
17 more
- 2025ScreenSpot-Pro: GUI Grounding for Professional High-Resolution Computer Usecited by 254
- 2024ShowUI: One Vision-Language-Action Model for GUI Visual Agentcited by 232
- 2024Agent Q: Advanced Reasoning and Learning for Autonomous AI Agentscited by 208
- 2024On the Effects of Data Scale on UI Control Agentscited by 194
- 2025Mobile-Agent-v3: Fundamental Agents for GUI Automationcited by 190
- 2023AutoDroid: LLM-powered Task Automation in Androidcited by 184
- 2024Ferret-UI: Grounded Mobile UI Understanding with Multimodal LLMscited by 176
- 2025OpenCUA: Open Foundations for Computer-Use Agentscited by 160
- 2024Web Agents with World Models: Learning and Leveraging Environment Dynamics in Web Navigationcited by 126
- 2024GUI Agents with Foundation Models: A Comprehensive Surveycited by 111
- 2025InfiGUIAgent: A Multimodal Generalist GUI Agent with Native Reasoning and Reflectioncited by 67
- 2025ChunkKV: Semantic-Preserving KV Cache Compression for Efficient Long-Context LLM Inferencecited by 60
- 2024Large Language Models Can Self-Improve At Web Agent Taskscited by 55
- 2025MEDA: Dynamic KV Cache Allocation for Efficient Multimodal Long-Context Inferencecited by 31
- 2023Pangu-Agent: A Fine-Tunable Generalist Agent with Structured Reasoningcited by 30
- 2025Semantic Integrity Matters: Benchmarking and Preserving High-Density Reasoning in KV Cache Compressioncited by 16
- 2025KeepKV: Achieving Periodic Lossless KV Cache Compression for Efficient LLM Inferencecited by 9
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2026Compress to Focus: Efficient Coordinate Compression for Policy Optimization in Multi-Turn GUI Agents
- 2025Auto-scaling Continuous Memory for GUI Agent
- 2026UniCache: Task- and Type-Aware KV Cache Compression for Unified Multimodal Models
- 2026AQuaUI: Visual Token Reduction for GUI Agents with Adaptive Quadtrees
- 2025SSD: Spatial-Semantic Head Decoupling for Efficient Autoregressive Image Generation
- 2025Chain-of-Memory: Enhancing GUI Agents for Cross-Application Navigation
- 2025Less is More: Empowering GUI Agent with Context-Aware Simplification
- 2026VLN-Cache: Enabling Token Caching for VLN Models with Visual/Semantic Dynamics Awareness