A Task-State Representation for Long-Horizon Mobile GUI Agents
On the map: LLM agents and tool use → GUI and mobile agents
Abstract (arXiv)
While long-horizon mobile GUI agents typically rely on thought-action-observation loops, they struggle to separate persistent task states from transient screen observations. As execution histories grow, this entanglement imposes a severe context burden, causing agents to forget initial requirements, hallucinate progress, or repeatedly interact with stale interfaces. To address this, we introduce Task-State Representation (TSR), a training-free framework that explicitly decouples task state from sensory input. Acting as a lightweight external wrapper, TSR maintains three structured components: a global instruction summary, a dynamic progress tracker for subgoals, and a transition-aware action verifier. By continuously updating through pre- and post-action visual comparisons, TSR effectively guides the agent's reasoning without requiring architectural modifications. Experiments across four mobile GUI benchmarks validate TSR's effectiveness, yielding up to a 12 absolute point increase in success rate on complex cross-application and memory-intensive tasks.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in GUI and mobile agents, one of 16 directions in LLM agents and tool use. Builds on 11 of its 19 references that are in the map. First posted on arXiv 1 Jul 2026.
Builds on
11 of 19 references.
Closest ancestors · 5
Same direction, newest first
- 2026UI-Copilot: Advancing Long-Horizon GUI Automation via Tool-Integrated Policy Optimization15 Apr
- 2026Where and How to Prune: An Empirical Study of Visual Token Pruning for GUI Agent Navigation27 Mar
- 2026VenusBench-Mobile: A Challenging and User-Centric Benchmark for Mobile GUI Agents with Capability Diagnostics6 Feb
- 2025MobileWorld: Benchmarking Autonomous Mobile Agents in Agent-User Interactive and MCP-Augmented Environments22 Dec
- 2025PAL-UI: Planning with Active Look-back for Vision-Based GUI Agents1 Oct
Other references · 6
- 2025Qwen3 Technical Reportcited by 8,820
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
- 2026Kimi K2.5: Visual Agentic Intelligencecited by 501
- 2025Scaling LLM Multi-turn RL with End-to-end Summarization-based Context Managementcited by 51
- 2025IterResearch: Rethinking Long-Horizon Agents with Interaction Scalingcited by 23
- 2026MemGUI-Bench: Benchmarking Memory of Mobile GUI Agents in Dynamic Environmentscited by 18
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2025AgentProg: Empowering Long-Horizon GUI Agents with Program-Guided Context Management
- 2026MAGNET: Towards Adaptive GUI Agents with Memory-Driven Knowledge Evolution
- 2026What Memory Do GUI Agents Really Need? From Passive Records to Active Task-Driving States
- 2026DeltaReplay: Task-Relative Memory Reuse for Mobile GUI Agents
- 2026GUI-CC: Benchmarking Contextual Consistency of GUI World Models as Agent Environments
- 2026Learn from Move: the Next Step for GUI Agents
- 2025Chain-of-Memory: Enhancing GUI Agents for Cross-Application Navigation
- 2026UI-KOBE: Knowledge-Oriented Behavior Exploration for Lightweight Graph-Guided GUI Agents