Executable Agentic Memory for GUI Agent
On the map: LLM agents and tool use → GUI and mobile agents
Abstract (arXiv)
Modern GUI agents typically rely on a model-centric and step-wise interaction paradigm, where LLMs must re-interpret the UI and re-decide actions at every screen, which is fragile in long-horizon tasks. In this paper, we propose Executable Agentic Memory (EAM), a structured Knowledge Graph (KG) that shifts GUI planning from free-form generation to a robust retrieval-and-execution process. Our approach includes a sample-efficient memory construction pipeline using state-aware DFS and action-group mining to compress multi-step routines. To ensure efficient planning, we introduce a value-guided graph search where a lightweight Q-function model steers Monte Carlo Tree Search (MCTS) over the KG. We theoretically establish bias-consistency for the Q-model and derive sample complexity bounds for path recovery. Empirically, EAM outperforms state-of-the-art baselines like UI-TARS-7B by up to 19.6% on AndroidWorld, while reducing token costs 6× relative to GPT-4o. With a 2.8s average latency, EAM enables reliable, quick, and long-horizon GUI automation.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Placed in GUI and mobile agents, one of 16 directions in LLM agents and tool use. Builds on 34 of its 38 references that are in the map. First posted on arXiv 12 May 2026.
Builds on
34 of 38 references.
Closest ancestors · 17
Same direction, newest first
- 2026MAGNET: Towards Adaptive GUI Agents with Memory-Driven Knowledge Evolution27 Jan
- 2025EchoTrail-GUI: Building Actionable Memory for GUI Agents via Critic-Guided Self-Exploration22 Dec
- 2025MGA: Memory-Driven GUI Agent for Observation-Centric Interaction28 Oct
- 2025KG-RAG: Enhancing GUI Agent Decision-Making via Knowledge Graph-Driven Retrieval-Augmented Generation30 Aug
- 2025GUI-Actor: Coordinate-Free Visual Grounding for GUI Agents3 Jun
- 2025GUI-explorer: Autonomous Exploration and Mining of Transition-aware Knowledge for GUI Agent22 May
- 2025GUI-R1 : A Generalist R1-Style Vision-Language Action Model For GUI Agents14 Apr
- 2025UI-R1: Enhancing Efficient Action Prediction of GUI Agents by Reinforcement Learning27 Mar
- 2025AppAgentX: Evolving GUI Agents as Proficient Smartphone Users4 Mar
- 2025UI-TARS: Pioneering Automated GUI Interaction with Native Agents21 Jan
- 2025Mobile-Agent-E: Self-Evolving Mobile Assistant for Complex Tasks20 Jan
- 2024AutoDroid-V2: Boosting SLM-based GUI Agents via Code Generation24 Dec
5 more
- 2024Navigating the Digital World as Humans Do: Universal Visual Grounding for GUI Agents7 Oct
- 2024MobileExperts: A Dynamic Tool-Enabled Agent Team in Mobile Devices4 Jul
- 2024Mobile-Agent-v2: Mobile Device Operation Assistant with Effective Navigation via Multi-Agent Collaboration3 Jun
- 2024SeeClick: Harnessing GUI Grounding for Advanced Visual GUI Agents17 Jan
- 2023AppAgent: Multimodal Agents as Smartphone Users21 Dec
Other references · 17
- 2021Training Verifiers to Solve Math Word Problemscited by 9,743
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
- 2025Search-R1: Training LLMs to Reason and Leverage Search Engines with Reinforcement Learningcited by 1,371
- 2023Reasoning with Language Model is Planning with World Modelcited by 846
- 2023Language Agent Tree Search Unifies Reasoning Acting and Planning in Language Modelscited by 551
- 2024GPT-4V(ision) is a Generalist Web Agent, if Groundedcited by 547
- 2024AndroidWorld: A Dynamic Benchmarking Environment for Autonomous Agentscited by 450
- 2025Group-in-Group Policy Optimization for LLM Agent Trainingcited by 442
- 2024Agent Workflow Memorycited by 342
- 2024ReST-MCTS*: LLM Self-Training via Process Reward Guided Tree Searchcited by 338
- 2025rStar-Math: Small LLMs Can Master Math Reasoning with Self-Evolved Deep Thinkingcited by 308
- 2024Monte Carlo Tree Search Boosts Reasoning via Iterative Preference Learningcited by 238
5 more
- 2023AutoDroid: LLM-powered Task Automation in Androidcited by 178
- 2022Enabling Conversational Interaction with Mobile UI using Large Language Modelscited by 66
- 2023Bridging RL Theory and Practice with the Effective Horizoncited by 31
- 2025Random Policy Valuation is Enough for LLM Reasoning with Verifiable Rewardscited by 10
- 2025Language Models can Self-Improve at State-Value Estimation for Better Searchcited by 4
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026FocusMem: Factorizing Content, Readout, and Trust in Latent GUI Memorycited by 2
- 2026EchoPath: Execution-Level Replayable Memory for GUI Agentscited by 1
- 2026Relevance Does Not Imply Applicability: Experience Activation for Personal GUI Agentscited by 0
- 2026DeltaReplay: Task-Relative Memory Reuse for Mobile GUI Agentscited by 0
- 2026DeltaReplay: Task-Relative Memory Reuse for Mobile GUI Agents8 Oct 2026
- 2026Relevance Does Not Imply Applicability: Experience Activation for Personal GUI Agents27 Sep 2026
- 2026EchoPath: Execution-Level Replayable Memory for GUI Agents15 Sep 2026
- 2026FocusMem: Factorizing Content, Readout, and Trust in Latent GUI Memory5 Aug 2026
Similar, not cited
Close in wording, no citation either way
- 2026AndroTMem: From Interaction Trajectories to Anchored Memory in Long-Horizon GUI Agents
- 2025Chain-of-Memory: Enhancing GUI Agents for Cross-Application Navigation
- 2026SE-GA: Memory-Augmented Self-Evolution for GUI Agents
- 2026UI-KOBE: Knowledge-Oriented Behavior Exploration for Lightweight Graph-Guided GUI Agents
- 2026ActionEngine: From Reactive to Programmatic GUI Agents via State Machine Memory
- 2026What Memory Do GUI Agents Really Need? From Passive Records to Active Task-Driving States
- 2026Mem-W: Latent Memory-Native GUI Agents
- 2025AgentProg: Empowering Long-Horizon GUI Agents with Program-Guided Context Management