EchoPath: Execution-Level Replayable Memory for GUI Agents
On the map: LLM agents and tool use → GUI and mobile agents
Abstract (arXiv)
Computer-use agents increasingly operate browsers, software, and desktop applications via CLI or API portals, but graphical user interface (GUI) still plays an important role in common industrial production scenarios. GUI agents commonly employ fresh observe-plan-ground-act loops, which is inefficient for enterprise tasks that repeatedly update records, process forms, configure tools, and export reports. We introduce EchoPath, a model-agnostic harness that converts artifact-validated GUI trajectories into standardized, parameter-controlled callable memories, analogous to Model Context Protocol (MCP)-style tool calls rather than unstructured experience records. Each memory stores task-intent keys, application and state preconditions, flexible input parameters, GUI evidence, validation provenance, and lifecycle state, so the host agent invokes a targeted procedure only when it can be deterministically replayed in the current runtime. The core mechanism enabling replay is an image-based target-reaiming algorithm that treats stored coordinates as visual evidence, matches the remembered GUI target against the current screen, and emits corrected operation coordinates before execution. During replay, EchoPath rebinds only declared modifiable inputs and rejects ambiguous or incompatible steps to bounded grounding repair or fresh planning. In experiments with real computer-use tasks, EchoPath reduced median token cost by more than 90% and median execution time by about 60%. These results support a bounded form of enterprise GUI memory: validated execution experience can become a controllable callable asset for recurrent work rather than only context for another reasoning pass.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in GUI and mobile agents, one of 16 directions in LLM agents and tool use. Builds on 39 of its 44 references that are in the map. First posted on arXiv 15 Sep 2026.
Builds on
39 of 44 references.
Closest ancestors · 17
Same direction, newest first
- 2026FocusMem: Factorizing Content, Readout, and Trust in Latent GUI Memory5 Aug
- 2026What Memory Do GUI Agents Really Need? From Passive Records to Active Task-Driving States30 Jun
- 2026OSWorld 2.0: Benchmarking Computer Use Agents on Long-Horizon Real-World Tasks28 Jun
- 2026Naive Visual Memory is Not Enough: A Failure-Mode Study of GUI Agents12 Jun
- 2026MementoGUI: Learning Agentic Multimodal Memory Control for Long-Horizon GUI Agents18 May
- 2026Executable Agentic Memory for GUI Agent12 May
- 2026UI-Mem: Self-Evolving Experience Memory for Online Reinforcement Learning in Mobile GUI Agents5 Feb
- 2026Darwinian Memory: A Training-Free Self-Regulating Memory System for GUI Agent Evolution30 Jan
- 2025EchoTrail-GUI: Building Actionable Memory for GUI Agents via Critic-Guided Self-Exploration22 Dec
- 2025Auto-scaling Continuous Memory for GUI Agent10 Oct
- 2025OSWorld-Human: Benchmarking the Efficiency of Computer-Use Agents19 Jun
- 2024OS-ATLAS: A Foundation Action Model for Generalist GUI Agents30 Oct
5 more
- 2024Agent S: An Open Agentic Framework that Uses Computers Like a Human10 Oct
- 2024Windows Agent Arena: Evaluating Multi-Modal OS Agents at Scale12 Sep
- 2024OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environments11 Apr
- 2024SeeClick: Harnessing GUI Grounding for Advanced Visual GUI Agents17 Jan
- 2023CogAgent: A Visual Language Model for GUI Agents14 Dec
Other references · 22
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
- 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,500
- 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,081
- 2023MemGPT: Towards LLMs as Operating Systemscited by 1,295
- 2025A-MEM: Agentic Memory for LLM Agentscited by 1,000
- 2023ExpeL: LLM Agents Are Experiential Learnerscited by 814
- 2023MemoryBank: Enhancing Large Language Models with Long-Term Memorycited by 539
- 2024AndroidWorld: A Dynamic Benchmarking Environment for Autonomous Agentscited by 450
- 2024Agent Workflow Memorycited by 342
- 2024OmniParser for Pure Vision Based GUI Agentcited by 193
- 2023Synapse: Trajectory-as-Exemplar Prompting with Memory for Computer Controlcited by 180
10 more
- 2025SkillWeaver: Web Agents can Self-Improve by Discovering and Honing Skillscited by 174
- 2024Cradle: Empowering Foundation Agents Towards General Computer Controlcited by 114
- 2025Memp: Exploring Agent Procedural Memorycited by 88
- 2024RAP: Retrieval-Augmented Planning with Contextual Memory for Multimodal LLM Agentscited by 80
- 2025LEGOMem: Modular Procedural Memory for Multi-agent LLM Systems for Workflow Automationcited by 39
- 2026Hybrid Self-evolving Structured Memory for GUI Agentscited by 12
- 2026Managing Procedural Memory in LLM Agents: Control, Adaptation, and Evaluationcited by 8
- 2022WebRobot: Web Robotic Process Automation using Interactive Programming-by-Demonstrationcited by 7
- 2025VerificAgent: Domain-Specific Memory Verification for Scalable Oversight of Aligned Computer-Use Agentscited by 3
- 2026OpenRath: Session-Centered Runtime State for Agent Systemscited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026Efficient GUI Agents: A Systems Survey of Observation, Memory, Action, and Runtime Optimization
- 2026ActionEngine: From Reactive to Programmatic GUI Agents via State Machine Memory
- 2025Chain-of-Memory: Enhancing GUI Agents for Cross-Application Navigation
- 2026Reflect, Revise, Reuse: Training-Free Skill Evolution for GUI Agents
- 2026A Task-State Representation for Long-Horizon Mobile GUI Agents
- 2026GUI-HARVEST: Self-Improving GUI Agents through Evidence-Driven Harness Evolution
- 2026TClone: Low-Latency Forking of Live GUI Environments for Computer-Use Agents
- 2026Mem-W: Latent Memory-Native GUI Agents