AgentProg: Empowering Long-Horizon GUI Agents with Program-Guided Context Management
On the map: LLM agents and tool use → GUI and mobile agents
Abstract (arXiv)
The rapid development of mobile GUI agents has stimulated growing research interest in long-horizon task automation. However, building agents for these tasks faces a critical bottleneck: the reliance on ever-expanding interaction history incurs substantial context overhead. Existing context management and compression techniques often fail to preserve vital semantic information, leading to degraded task performance. We propose AgentProg, a program-guided approach for agent context management that reframes the interaction history as a program with variables and control flow. By organizing information according to the structure of program, this structure provides a principled mechanism to determine which information should be retained and which can be discarded. We further integrate a global belief state mechanism inspired by Belief MDP framework to handle partial observability and adapt to unexpected environmental changes. Experiments on AndroidWorld and our extended long-horizon task suite demonstrate that AgentProg has achieved the state-of-the-art success rates on these benchmarks. More importantly, it maintains robust performance on long-horizon tasks while baseline methods experience catastrophic degradation. Our system is open-sourced at https://github.com/MobileLLM/AgentProg.
Key facts. Cited by 10 papers in the map (data through 7 Oct 2026). Placed in GUI and mobile agents, one of 16 directions in LLM agents and tool use. Builds on 46 of its 134 references that are in the map. First posted on arXiv 11 Dec 2025.
Builds on
46 of 134 references.
Closest ancestors · 21
Same direction, newest first
- 2025ColorAgent: Building A Robust, Personalized, and Interactive OS Agent22 Oct
- 2025ColorBench: Benchmarking Mobile Agents with Graph-Structured Framework for Complex Long-Horizon Tasks16 Oct
- 2025MobileRL: Online Agentic Reinforcement Learning for Mobile GUI Agents10 Sep
- 2025UI-TARS-2 Technical Report: Advancing GUI Agent with Multi-Turn Reinforcement Learning2 Sep
- 2025Mobile-Agent-v3: Fundamental Agents for GUI Automation21 Aug
- 2025UI-Venus Technical Report: Building High-performance UI Agents with RFT14 Aug
- 2025Chain-of-Memory: Enhancing GUI Agents for Cross-Application Navigation22 Jun
- 2025Agent S2: A Compositional Generalist-Specialist Framework for Computer Use Agents1 Apr
- 2025Advancing Mobile GUI Agents: A Verifier-Driven Approach to Practical Deployment20 Mar
- 2025UI-TARS: Pioneering Automated GUI Interaction with Native Agents21 Jan
- 2024AutoDroid-V2: Boosting SLM-based GUI Agents via Code Generation24 Dec
- 2024GUI Agents: A Survey18 Dec
9 more
- 2024AndroidLab: Training and Systematic Benchmarking of Android Autonomous Agents31 Oct
- 2024OS-ATLAS: A Foundation Action Model for Generalist GUI Agents30 Oct
- 2024Navigating the Digital World as Humans Do: Universal Visual Grounding for GUI Agents7 Oct
- 2024MobileAgentBench: An Efficient and User-Friendly Benchmark for Mobile LLM Agents12 Jun
- 2024OS-Copilot: Towards Generalist Computer Agents with Self-Improvement12 Feb
- 2024Mobile-Agent: Autonomous Multi-Modal Mobile Device Agent with Visual Perception29 Jan
- 2024SeeClick: Harnessing GUI Grounding for Advanced Visual GUI Agents17 Jan
- 2023AppAgent: Multimodal Agents as Smartphone Users21 Dec
- 2023You Only Look at Screens: Multimodal Chain-of-Action Agents20 Sep
Other references · 25
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
- 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,383
- 2022Code as Policies: Language Model Programs for Embodied Controlcited by 1,172
- 2024GPT-4V(ision) is a Generalist Web Agent, if Groundedcited by 547
- 2024Executable Code Actions Elicit Better LLM Agentscited by 537
- 2024AndroidWorld: A Dynamic Benchmarking Environment for Autonomous Agentscited by 450
- 2023A Real-World WebAgent with Planning, Long Context Understanding, and Program Synthesiscited by 350
- 2018Reinforcement Learning on Web Interfaces Using Workflow-Guided Explorationcited by 282
- 2023AdaPlanner: Adaptive Planning from Feedback with Language Modelscited by 193
- 2020Mapping Natural Language Instructions to Mobile UI Action Sequencescited by 180
- 2023AutoDroid: LLM-powered Task Automation in Androidcited by 178
- 2024UFO: A UI-Focused Agent for Windows OS Interactioncited by 147
13 more
- 2023GPT-4V in Wonderland: Large Multimodal Models for Zero-Shot Smartphone GUI Navigationcited by 137
- 2024Cradle: Empowering Foundation Agents Towards General Computer Controlcited by 114
- 2025Inducing Programmatic Skills for Agentic Taskscited by 103
- 2024On-Device Language Models: A Comprehensive Reviewcited by 101
- 2022META-GUI: Towards Multi-modal Conversational Agents on Mobile GUIcited by 81
- 2024Why Does the Effective Context Length of LLMs Fall Short?cited by 60
- 2025WebSailor-V2: Bridging the Chasm to Proprietary Agents via Synthetic Data and Scalable Reinforcement Learningcited by 59
- 2023Explore, Select, Derive, and Recall: Augmenting LLM with Human-like Memory for Mobile Task Automationcited by 57
- 2025Magentic-UI: Towards Human-in-the-loop Agentic Systemscited by 41
- 2024THREAD: Thinking Deeper with Recursive Spawningcited by 24
- 2025RealWebAssist: A Benchmark for Long-Horizon Web Assistance with Real-World Userscited by 21
- 2025AutoIOT: LLM-Driven Automated Natural Language Programming for AIoT Applicationscited by 17
- 2025VeriWeb: Verifiable Long-Chain Web Benchmark for Agentic Information-Seekingcited by 10
Built on by
Citing papers per year: 2026: 10.
10 papers.
- 2026OS-Symphony: A Holistic Framework for Robust and Generalist Computer-Using Agentcited by 19
- 2026MementoGUI: Learning Agentic Multimodal Memory Control for Long-Horizon GUI Agentscited by 9
- 2026What Memory Do GUI Agents Really Need? From Passive Records to Active Task-Driving Statescited by 5
- 2026KLong: Training LLM Agent for Extremely Long-horizon Taskscited by 4
- 2026GUI Agents with Reinforcement Learning: Toward Digital Inhabitantscited by 3
- 2026MacAgentBench: Benchmarking AI Agents on Real-World macOS Desktopcited by 2
- 2026Software Engineering for and with GUI Agentcited by 1
- 2026Web Agents Should Use Typed Actions Instead of Click-Based Browsingcited by 0
- 2026LocalLSTC: A Long Short-Term Control Architecture for Locally Deployed GUI Agentscited by 0
- 2026PastForward: Faster On-Device GUI Agents via Computational Experience Reusecited by 0
- 2026PastForward: Faster On-Device GUI Agents via Computational Experience Reuse26 Sep 2026
- 2026LocalLSTC: A Long Short-Term Control Architecture for Locally Deployed GUI Agents26 Aug 2026
- 2026Software Engineering for and with GUI Agent10 Aug 2026
- 2026What Memory Do GUI Agents Really Need? From Passive Records to Active Task-Driving States30 Jun 2026
- 2026MacAgentBench: Benchmarking AI Agents on Real-World macOS Desktop21 Jun 2026
- 2026MementoGUI: Learning Agentic Multimodal Memory Control for Long-Horizon GUI Agents18 May 2026
- 2026GUI Agents with Reinforcement Learning: Toward Digital Inhabitants30 Apr 2026
- 2026KLong: Training LLM Agent for Extremely Long-horizon Tasks19 Feb 2026
- 2026Web Agents Should Use Typed Actions Instead of Click-Based Browsing19 Feb 2026
- 2026OS-Symphony: A Holistic Framework for Robust and Generalist Computer-Using Agent12 Jan 2026
Similar, not cited
Close in wording, no citation either way
- 2026A Task-State Representation for Long-Horizon Mobile GUI Agents
- 2026MAGNET: Towards Adaptive GUI Agents with Memory-Driven Knowledge Evolution
- 2026MemGUI-Agent: An End-to-End Long-Horizon Mobile GUI Agent with Proactive Context Management
- 2026APPSim-Bench: Bridging Real-world Apps and Reproducible Evaluation for Mobile GUI Agents
- 2025Context as a Tool: Context Management for Long-Horizon SWE-Agents
- 2025ReInAgent: A Context-Aware GUI Agent Enabling Human-in-the-Loop Mobile Task Navigation
- 2026GUI-CC: Benchmarking Contextual Consistency of GUI World Models as Agent Environments
- 2025AppAgentX: Evolving GUI Agents as Proficient Smartphone Users