ReVision: Scaling Computer-Use Agents via Temporal Visual Redundancy Reduction
On the map: LLM agents and tool use → GUI and mobile agents
Abstract (arXiv)
Computer-use agents (CUAs) rely on visual observations of graphical user interfaces, where each screenshot is encoded into a large number of visual tokens. As interaction trajectories grow, the token cost increases rapidly, limiting the amount of history that can be incorporated under fixed context and compute budgets. This has resulted in no or very limited improvement in the performance when using history unlike other domains. We address this inefficiency by introducing ReVision, which is used to train multimodal language models on trajectories where redundant visual patches are removed using a learned patch selector that compares patch representations across consecutive screenshots while preserving spatial structure required by the model. Across three benchmarks, OSWorld, WebTailBench, and AgentNetBench, when processing trajectories with 5 history screenshots using Qwen2.5-VL-7B, ReVision reduces token usage by 46% on average while improving success rate by 3% over the no drop baseline. This establishes a clear efficiency gain, enabling agents to process longer trajectories with fewer tokens. With this improved efficiency, we revisit the role of history in CUAs and find that performance continues to improve as more past observations are incorporated when redundancy is removed.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in GUI and mobile agents, one of 16 directions in LLM agents and tool use. Builds on 33 of its 38 references that are in the map. First posted on arXiv 11 May 2026.
Builds on
33 of 38 references.
Closest ancestors · 12
Same direction, newest first
- 2025WebSTAR: Scalable Data Synthesis for Computer Use Agents with Step-Level Filtering22 Nov
- 2025ScaleCUA: Scaling Open-Source Computer Use Agents with Cross-Platform Data18 Sep
- 2025UI-TARS-2 Technical Report: Advancing GUI Agent with Multi-Turn Reinforcement Learning2 Sep
- 2025OSWorld-Human: Benchmarking the Efficiency of Computer-Use Agents19 Jun
- 2025Scaling Computer-Use Grounding via User Interface Decomposition and Synthesis19 May
- 2025ScreenSpot-Pro: GUI Grounding for Professional High-Resolution Computer Use4 Apr
- 2025A Comprehensive Survey of Agents for Computer Use: Foundations, Challenges, and Future Directions27 Jan
- 2025UI-TARS: Pioneering Automated GUI Interaction with Native Agents21 Jan
- 2024OS-ATLAS: A Foundation Action Model for Generalist GUI Agents30 Oct
- 2024Windows Agent Arena: Evaluating Multi-Modal OS Agents at Scale12 Sep
- 2024OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environments11 Apr
- 2023CogAgent: A Visual Language Model for GUI Agents14 Dec
Other references · 21
- 2025Qwen3-VL Technical Reportcited by 2,793
- 2022WebShop: Towards Scalable Real-World Web Interaction with Grounded Language Agentscited by 1,251
- 2024GPT-4V(ision) is a Generalist Web Agent, if Groundedcited by 563
- 2024AndroidWorld: A Dynamic Benchmarking Environment for Autonomous Agentscited by 468
- 2024WebVoyager: Building an End-to-End Web Agent with Large Multimodal Modelscited by 438
- 2024Aguvis: Unified Pure Vision Agents for Autonomous GUI Interactioncited by 278
- 2024ShowUI: One Vision-Language-Action Model for GUI Visual Agentcited by 232
- 2024OmniParser for Pure Vision Based GUI Agentcited by 198
- 2019SCSampler: Sampling Salient Clips from Video for Efficient Action Recognitioncited by 134
- 2025TimeChat-Online: 80% Visual Tokens are Naturally Redundant in Streaming Videoscited by 97
- 2024DyCoke: Dynamic Compression of Tokens for Fast Video Large Language Modelscited by 96
- 2025UI-Vision: A Desktop-centric GUI Benchmark for Visual Perception and Interactioncited by 77
9 more
- 2025Mind2Web 2: Evaluating Agentic Search with Agent-as-a-Judgecited by 76
- 2024Don't Look Twice: Faster Video Transformers with Run-Length Tokenizationcited by 43
- 2024vid-TLDR: Training Free Token merging for Light-weight Video Transformercited by 41
- 2025Fara-7B: An Efficient Agentic Model for Computer Usecited by 35
- 2025FocusAgent: Simple Yet Effective Ways of Trimming the Large Context of Web Agentscited by 16
- 2026N"uwa: Mending the Spatial Integrity Torn by VLM Token Pruningcited by 15
- 2026FocusUI: Efficient UI Grounding via Position-Preserving Visual Token Selectioncited by 10
- 2025PPE: Positional Preservation Embedding for Token Compression in Multimodal Large Language Modelscited by 4
- 2026Focus-Scan-Refine: From Human Visual Perception to Efficient Visual Token Pruningcited by 3
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026A History-Aware Visually Grounded Critic for Computer Use Agents
- 2026Covering Human Action Space for Computer Use: Data Synthesis and Benchmark
- 2026Qwen-CUA: Native Computer Use for (almost) Everything
- 2026Adaptive Vision-Language Model Routing for Computer Use Agents
- 2026DeskForge: Dense Supervision from Desktop Environments for Computer-Use Agents
- 2025PAL-UI: Planning with Active Look-back for Vision-Based GUI Agents
- 2026When History Is Multimodal: Rethinking Context Management for Long-Horizon Agents
- 2026VISUALSKILL: Multimodal Skills for Computer-Use Agents