Compress to Focus: Efficient Coordinate Compression for Policy Optimization in Multi-Turn GUI Agents
On the map: LLM agents and tool use → GUI and mobile agents
Abstract (arXiv)
Multi-turn GUI agents enable complex task completion through sequential decision-making, but suffer from severe context inflation as interaction history accumulates. Existing strategies either sacrifice long-term context via truncation or compromise spatial structure through token pruning. In this paper, we propose Coordinate Compression Policy Optimization (CCPO), an efficient policy optimization framework that couples visual compression with policy optimization for multi-turn GUI agents. CCPO introduces Coordinate-Aware Spatial Compression (CASC), which aggregates coordinates from multiple rollouts to capture target-relevant regions and progressively narrow historical attention around key visual areas. From interactions across rollouts, CASC adaptively constructs attention boundaries that concentrate computation on the most informative regions of the scene. We further design a Distance-Based Advantage that provides fine-grained learning signals based on distance rather than binary correctness, improving both grounding accuracy and compression quality. Extensive experiments demonstrate that CCPO achieves SOTA performance across four benchmarks with up to 55% token compression and 3.8× training speedup.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Placed in GUI and mobile agents, one of 16 directions in LLM agents and tool use. Builds on 18 of its 31 references that are in the map. First posted on arXiv 14 Jan 2026.
Builds on
18 of 31 references.
Closest ancestors · 9
Same direction, newest first
- 2025UI-TARS-2 Technical Report: Advancing GUI Agent with Multi-Turn Reinforcement Learning2 Sep
- 2025OS Agents: A Survey on MLLM-based Agents for General Computing Devices Use6 Aug
- 2025AgentCPM-GUI: Building Mobile-Use Agents with Reinforcement Fine-Tuning2 Jun
- 2025InfiGUI-R1: Advancing Multimodal GUI Agents from Reactive Actors to Deliberative Reasoners19 Apr
- 2025GUI-R1 : A Generalist R1-Style Vision-Language Action Model For GUI Agents14 Apr
- 2024OS-Genesis: Automating GUI Agent Trajectory Construction via Reverse Task Synthesis27 Dec
- 2024Navigating the Digital World as Humans Do: Universal Visual Grounding for GUI Agents7 Oct
- 2024SeeClick: Harnessing GUI Grounding for Advanced Visual GUI Agents17 Jan
- 2023AppAgent: Multimodal Agents as Smartphone Users21 Dec
Other references · 9
- 2023Mind2Web: Towards a Generalist Agent for the Webcited by 1,242
- 2024GPT-4V(ision) is a Generalist Web Agent, if Groundedcited by 563
- 2025Group-in-Group Policy Optimization for LLM Agent Trainingcited by 497
- 2024Aguvis: Unified Pure Vision Agents for Autonomous GUI Interactioncited by 278
- 2025The Landscape of Agentic Reinforcement Learning for LLMs: A Surveycited by 205
- 2023BLIVA: A Simple Multimodal LLM for Better Handling of Text-Rich Visual Questionscited by 125
- 2025R-VLM: Region-Aware Vision Language Model for Precise GUI Groundingcited by 22
- 2025FALCON: Resolving Visual Redundancy and Fragmentation in High-resolution Multimodal Large Language Models via Visual Registerscited by 20
- 2024Iris: Breaking GUI Complexity with Adaptive Focus and Self-Refiningcited by 7
Built on by
Citing papers per year: 2026: 3.
3 papers.
- 2026Probe to Act: Elevating Browser-Use Agent via Active Visual Probing27 Sep 2026
- 2026Naive Visual Memory is Not Enough: A Failure-Mode Study of GUI Agents12 Jun 2026
- 2026Mem-W: Latent Memory-Native GUI Agents10 May 2026
Similar, not cited
Close in wording, no citation either way
- 2026ST-Lite: Training-Free KV Cache Compression with Spatio-Trajectory Guidance for Long-Horizon GUI Agents
- 2025GUI-KV: Efficient GUI Agents via KV Cache with Spatio-Temporal Awareness
- 2026Scaling GUI Agents with Visual State Transitions
- 2026Spatio-Temporal Token Pruning for Efficient High-Resolution GUI Agents
- 2026STaR-KV: Spatio-Temporal Adaptive Re-weighting for KV Cache Compression in GUI Vision-Language Models
- 2025ARPO:End-to-End Policy Optimization for GUI Agents with Experience Replay
- 2025Less is More: Empowering GUI Agent with Context-Aware Simplification
- 2026AQuaUI: Visual Token Reduction for GUI Agents with Adaptive Quadtrees