HiconAgent: History Context-aware Policy Optimization for GUI Agents
On the map: LLM agents and tool use → GUI and mobile agents
Abstract (arXiv)
Graphical User Interface (GUI) agents require effective use of historical context to perform sequential navigation tasks. While incorporating past actions and observations can improve decision making, naive use of full history leads to excessive computational overhead and distraction from irrelevant information. To address this, we introduce HiconAgent, a GUI agent trained with History Context-aware Policy Optimization (HCPO) for efficient and effective utilization of historical information. HCPO optimizes history usage in both sampling and policy updates through two complementary components: (1) Dynamic Context Sampling (DCS) presents the agent with variable length histories during sampling, enabling adaptive use of the most relevant context; (2) Anchor-guided History Compression (AHC) refines the policy update phase with a dual branch strategy where the compressed branch removes history observations while keeping history actions as information flow anchors. The compressed and uncompressed branches are coupled through a history-enhanced alignment loss to enforce consistent history usage while maintaining efficiency. Experiments on mainstream GUI navigation benchmarks demonstrate strong performance. Despite being smaller, HiconAgent-3B outperforms GUI-R1-7B by +8.46 percent grounding accuracy and +11.32 percent step success rate on GUI-Odyssey, while achieving comparable results on AndroidControl and AITW with up to 2.47x computational speedup and 60 percent FLOPs reduction.
Key facts. Cited by 13 papers in the map (data through 14 Oct 2026). Placed in GUI and mobile agents, one of 16 directions in LLM agents and tool use. Builds on 40 of its 53 references that are in the map. First posted on arXiv 1 Dec 2025.
Builds on
40 of 53 references.
Closest ancestors · 13
Same direction, newest first
- 2025UI-AGILE: Advancing GUI Agents with Effective Reinforcement Learning and Precise Inference-Time Grounding29 Jul
- 2025Mirage-1: Augmenting and Updating GUI Agent with Hierarchical Multimodal Skills12 Jun
- 2025ProgRM: Build Better GUI Agents with Progress Rewards23 May
- 2025GUI-explorer: Autonomous Exploration and Mining of Transition-aware Knowledge for GUI Agent22 May
- 2025InfiGUI-R1: Advancing Multimodal GUI Agents from Reactive Actors to Deliberative Reasoners19 Apr
- 2025GUI-R1 : A Generalist R1-Style Vision-Language Action Model For GUI Agents14 Apr
- 2024OS-ATLAS: A Foundation Action Model for Generalist GUI Agents30 Oct
- 2024SPA-Bench: A Comprehensive Benchmark for SmartPhone Agent Evaluation19 Oct
- 2024Navigating the Digital World as Humans Do: Universal Visual Grounding for GUI Agents7 Oct
- 2024AMEX: Android Multi-annotation Expo Dataset for Mobile GUI Agents3 Jul
- 2024On the Effects of Data Scale on UI Control Agents6 Jun
- 2024Mobile-Agent: Autonomous Multi-Modal Mobile Device Agent with Visual Perception29 Jan
Other references · 27
- 2023GPT-4 Technical Reportcited by 18,396
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2024GPT-4o System Cardcited by 4,588
- 2024An Image is Worth 1/2 Tokens After Layer 2: Plug-and-Play Inference Acceleration for Large Vision-Language Modelscited by 642
- 2025Visual-RFT: Visual Reinforcement Fine-Tuningcited by 513
- 2023Android in the Wild: A Large-Scale Dataset for Android Device Controlcited by 319
- 2024Aguvis: Unified Pure Vision Agents for Autonomous GUI Interactioncited by 278
- 2024ReFT: Reasoning with Reinforced Fine-Tuningcited by 239
- 2024GUIOdyssey: A Comprehensive Dataset for Cross-App GUI Navigation on Mobile Devicescited by 194
- 2023Detecting and Grounding Multi-Modal Media Manipulationcited by 99
- 2024Optimus-1: Hybrid Multimodal Memory Empowered Agents Excel in Long-Horizon Taskscited by 84
- 2023LION : Empowering Multimodal Large Language Model with Dual-Level Visual Knowledgecited by 81
15 more
- 2025CogVLA: Cognition-Aligned Vision-Language-Action Model via Instruction-Driven Routing & Sparsificationcited by 74
- 2024Cross-modal Information Flow in Multimodal Large Language Modelscited by 67
- 2025LION-FS: Fast & Slow Video-Language Thinker as Online Video Assistantcited by 58
- 2023Detecting and Grounding Multi-Modal Media Manipulation and Beyondcited by 56
- 2024MoME: Mixture of Multimodal Experts for Generalist Multimodal Large Language Modelscited by 46
- 2024Enhancing Emotional Generation Capability of Large Language Models via Emotional Chain-of-Thoughtcited by 34
- 2025Optimus-2: Multimodal Minecraft Agent with Goal-Observation-Action Conditioned Policycited by 25
- 2025SemanticVLA: Semantic-Aligned Sparsification and Enhancement for Efficient Robotic Manipulationcited by 21
- 2025FALCON: Resolving Visual Redundancy and Fragmentation in High-resolution Multimodal Large Language Models via Visual Registerscited by 20
- 2019Scene Recognition with Prototype-agnostic Scene Layoutcited by 17
- 2025H-GAR: A Hierarchical Interaction Framework via Goal-Driven Observation-Action Refinement for Robotic Manipulationcited by 17
- 2025PUMA: Layer-Pruned Language Model for Efficient Unified Multimodal Retrieval with Modality-Adaptive Learningcited by 11
- 2025DiVE: Efficient Multi-View Driving Scenes Generation Based on Video Diffusion Transformercited by 10
- 2025NaviMaster: Learning a Unified Policy for GUI and Embodied Navigation Taskscited by 10
- 2025Enhancing Diffusion-based Dataset Distillation via Adversary-Guided Curriculum Samplingcited by 2
Built on by
Citing papers per year: 2026: 13.
13 papers.
Sort:
By area:
- 2026Global Prior Meets Local Consistency: Dual-Memory Augmented Vision-Language-Action Model for Efficient Robotic Manipulationcited by 20
- 2026PersonalAlign: Hierarchical Implicit Intent Alignment for Personalized GUI Agent with Long-Term User-Centric Recordscited by 16
- 2026DeltaVLA: Prior-Guided Vision-Language-Action Models via World Knowledge Variationcited by 10
- 2026HATS: Hardness-Aware Trajectory Synthesis for GUI Agentscited by 9
- 2026ConsisVLA-4D: Advancing Spatiotemporal Consistency in Efficient 3D-Perception and 4D-Reasoning for Robotic Manipulationcited by 6
- 2026From Abstraction to Instantiation: Learning Behavioral Representation for Vision-Language-Action Modelcited by 6
- 2026UI-Copilot: Advancing Long-Horizon GUI Automation via Tool-Integrated Policy Optimizationcited by 4
- 2026Software Engineering for and with GUI Agentcited by 1
- 2026UniMPA: A Unified Memory-Prediction-Action Model via Action-Grounded Transition Modelingcited by 1
- 2026LookAgain: Closed-Loop GUI Grounding with Visually Grounded Reflectioncited by 0
- 2026Benchmarking General Mobile Assistants in Challenging Real-World Scenarioscited by 0
- 2026Efficient GUI Agents: A Systems Survey of Observation, Memory, Action, and Runtime Optimizationcited by 0
- 2026UniMPA: A Unified Memory-Prediction-Action Model via Action-Grounded Transition Modeling10 Sep 2026
- 2026Learning to Use Imagination: Progress-Conditioned Future Utilization for World Action Models6 Sep 2026
- 2026Efficient GUI Agents: A Systems Survey of Observation, Memory, Action, and Runtime Optimization2 Sep 2026
- 2026Benchmarking General Mobile Assistants in Challenging Real-World Scenarios21 Aug 2026
- 2026LookAgain: Closed-Loop GUI Grounding with Visually Grounded Reflection10 Aug 2026
- 2026Software Engineering for and with GUI Agent10 Aug 2026
- 2026From Abstraction to Instantiation: Learning Behavioral Representation for Vision-Language-Action Model21 May 2026
- 2026ConsisVLA-4D: Advancing Spatiotemporal Consistency in Efficient 3D-Perception and 4D-Reasoning for Robotic Manipulation6 May 2026
- 2026UI-Copilot: Advancing Long-Horizon GUI Automation via Tool-Integrated Policy Optimization15 Apr 2026
- 2026HATS: Hardness-Aware Trajectory Synthesis for GUI Agents12 Mar 2026
- 2026DeltaVLA: Prior-Guided Vision-Language-Action Models via World Knowledge Variation9 Mar 2026
- 2026Global Prior Meets Local Consistency: Dual-Memory Augmented Vision-Language-Action Model for Efficient Robotic Manipulation22 Feb 2026
- 2026PersonalAlign: Hierarchical Implicit Intent Alignment for Personalized GUI Agent with Long-Term User-Centric Recordscited by 16
- 2026UI-Copilot: Advancing Long-Horizon GUI Automation via Tool-Integrated Policy Optimizationcited by 4
- 2026Software Engineering for and with GUI Agentcited by 1
- 2026Efficient GUI Agents: A Systems Survey of Observation, Memory, Action, and Runtime Optimizationcited by 0
- 2026Efficient GUI Agents: A Systems Survey of Observation, Memory, Action, and Runtime Optimization2 Sep 2026
- 2026Software Engineering for and with GUI Agent10 Aug 2026
- 2026UI-Copilot: Advancing Long-Horizon GUI Automation via Tool-Integrated Policy Optimization15 Apr 2026
- 2026PersonalAlign: Hierarchical Implicit Intent Alignment for Personalized GUI Agent with Long-Term User-Centric Records14 Jan 2026
- 2026Global Prior Meets Local Consistency: Dual-Memory Augmented Vision-Language-Action Model for Efficient Robotic Manipulationcited by 20
- 2026DeltaVLA: Prior-Guided Vision-Language-Action Models via World Knowledge Variationcited by 10
- 2026From Abstraction to Instantiation: Learning Behavioral Representation for Vision-Language-Action Modelcited by 6
- 2026UniMPA: A Unified Memory-Prediction-Action Model via Action-Grounded Transition Modelingcited by 1
- 2026UniMPA: A Unified Memory-Prediction-Action Model via Action-Grounded Transition Modeling10 Sep 2026
- 2026From Abstraction to Instantiation: Learning Behavioral Representation for Vision-Language-Action Model21 May 2026
- 2026DeltaVLA: Prior-Guided Vision-Language-Action Models via World Knowledge Variation9 Mar 2026
- 2026Global Prior Meets Local Consistency: Dual-Memory Augmented Vision-Language-Action Model for Efficient Robotic Manipulation22 Feb 2026
- 2026HATS: Hardness-Aware Trajectory Synthesis for GUI Agentscited by 9
- 2026HATS: Hardness-Aware Trajectory Synthesis for GUI Agents12 Mar 2026
Similar, not cited
Close in wording, no citation either way
- 2025Less is More: Empowering GUI Agent with Context-Aware Simplification
- 2025History-Aware Reasoning for GUI Agents
- 2025GUI-Rise: Structured Reasoning and History Summarization for GUI Navigation
- 2025PAL-UI: Planning with Active Look-back for Vision-Based GUI Agents
- 2026Compress to Focus: Efficient Coordinate Compression for Policy Optimization in Multi-Turn GUI Agents
- 2026A History-Aware Visually Grounded Critic for Computer Use Agents
- 2025Chain-of-Memory: Enhancing GUI Agents for Cross-Application Navigation
- 2026What Memory Do GUI Agents Really Need? From Passive Records to Active Task-Driving States