mlsanityData to 14 Oct 2026

HiconAgent: History Context-aware Policy Optimization for GUI Agents

arXiv 2512.01763 ↗First posted 1 Dec 2025cs.CVcited by 13

On the map: LLM agents and tool use → GUI and mobile agents

Abstract (arXiv)

Graphical User Interface (GUI) agents require effective use of historical context to perform sequential navigation tasks. While incorporating past actions and observations can improve decision making, naive use of full history leads to excessive computational overhead and distraction from irrelevant information. To address this, we introduce HiconAgent, a GUI agent trained with History Context-aware Policy Optimization (HCPO) for efficient and effective utilization of historical information. HCPO optimizes history usage in both sampling and policy updates through two complementary components: (1) Dynamic Context Sampling (DCS) presents the agent with variable length histories during sampling, enabling adaptive use of the most relevant context; (2) Anchor-guided History Compression (AHC) refines the policy update phase with a dual branch strategy where the compressed branch removes history observations while keeping history actions as information flow anchors. The compressed and uncompressed branches are coupled through a history-enhanced alignment loss to enforce consistent history usage while maintaining efficiency. Experiments on mainstream GUI navigation benchmarks demonstrate strong performance. Despite being smaller, HiconAgent-3B outperforms GUI-R1-7B by +8.46 percent grounding accuracy and +11.32 percent step success rate on GUI-Odyssey, while achieving comparable results on AndroidControl and AITW with up to 2.47x computational speedup and 60 percent FLOPs reduction.

Key facts. Cited by 13 papers in the map (data through 14 Oct 2026). Placed in GUI and mobile agents, one of 16 directions in LLM agents and tool use. Builds on 40 of its 53 references that are in the map. First posted on arXiv 1 Dec 2025.

Builds on

40 of 53 references.

Closest ancestors · 13

Same direction, newest first

  1. 2025UI-AGILE: Advancing GUI Agents with Effective Reinforcement Learning and Precise Inference-Time Grounding29 Jul
  2. 2025Mirage-1: Augmenting and Updating GUI Agent with Hierarchical Multimodal Skills12 Jun
  3. 2025ProgRM: Build Better GUI Agents with Progress Rewards23 May
  4. 2025GUI-explorer: Autonomous Exploration and Mining of Transition-aware Knowledge for GUI Agent22 May
  5. 2025InfiGUI-R1: Advancing Multimodal GUI Agents from Reactive Actors to Deliberative Reasoners19 Apr
  6. 2025GUI-R1 : A Generalist R1-Style Vision-Language Action Model For GUI Agents14 Apr
  7. 2024OS-ATLAS: A Foundation Action Model for Generalist GUI Agents30 Oct
  8. 2024SPA-Bench: A Comprehensive Benchmark for SmartPhone Agent Evaluation19 Oct
  9. 2024Navigating the Digital World as Humans Do: Universal Visual Grounding for GUI Agents7 Oct
  10. 2024AMEX: Android Multi-annotation Expo Dataset for Mobile GUI Agents3 Jul
  11. 2024On the Effects of Data Scale on UI Control Agents6 Jun
  12. 2024Mobile-Agent: Autonomous Multi-Modal Mobile Device Agent with Visual Perception29 Jan
1 more
  1. 2024SeeClick: Harnessing GUI Grounding for Advanced Visual GUI Agents17 Jan

Other references · 27

  1. 2023GPT-4 Technical Reportcited by 18,396
  2. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  3. 2024GPT-4o System Cardcited by 4,588
  4. 2024An Image is Worth 1/2 Tokens After Layer 2: Plug-and-Play Inference Acceleration for Large Vision-Language Modelscited by 642
  5. 2025Visual-RFT: Visual Reinforcement Fine-Tuningcited by 513
  6. 2023Android in the Wild: A Large-Scale Dataset for Android Device Controlcited by 319
  7. 2024Aguvis: Unified Pure Vision Agents for Autonomous GUI Interactioncited by 278
  8. 2024ReFT: Reasoning with Reinforced Fine-Tuningcited by 239
  9. 2024GUIOdyssey: A Comprehensive Dataset for Cross-App GUI Navigation on Mobile Devicescited by 194
  10. 2023Detecting and Grounding Multi-Modal Media Manipulationcited by 99
  11. 2024Optimus-1: Hybrid Multimodal Memory Empowered Agents Excel in Long-Horizon Taskscited by 84
  12. 2023LION : Empowering Multimodal Large Language Model with Dual-Level Visual Knowledgecited by 81
15 more
  1. 2025CogVLA: Cognition-Aligned Vision-Language-Action Model via Instruction-Driven Routing & Sparsificationcited by 74
  2. 2024Cross-modal Information Flow in Multimodal Large Language Modelscited by 67
  3. 2025LION-FS: Fast & Slow Video-Language Thinker as Online Video Assistantcited by 58
  4. 2023Detecting and Grounding Multi-Modal Media Manipulation and Beyondcited by 56
  5. 2024MoME: Mixture of Multimodal Experts for Generalist Multimodal Large Language Modelscited by 46
  6. 2024Enhancing Emotional Generation Capability of Large Language Models via Emotional Chain-of-Thoughtcited by 34
  7. 2025Optimus-2: Multimodal Minecraft Agent with Goal-Observation-Action Conditioned Policycited by 25
  8. 2025SemanticVLA: Semantic-Aligned Sparsification and Enhancement for Efficient Robotic Manipulationcited by 21
  9. 2025FALCON: Resolving Visual Redundancy and Fragmentation in High-resolution Multimodal Large Language Models via Visual Registerscited by 20
  10. 2019Scene Recognition with Prototype-agnostic Scene Layoutcited by 17
  11. 2025H-GAR: A Hierarchical Interaction Framework via Goal-Driven Observation-Action Refinement for Robotic Manipulationcited by 17
  12. 2025PUMA: Layer-Pruned Language Model for Efficient Unified Multimodal Retrieval with Modality-Adaptive Learningcited by 11
  13. 2025DiVE: Efficient Multi-View Driving Scenes Generation Based on Video Diffusion Transformercited by 10
  14. 2025NaviMaster: Learning a Unified Policy for GUI and Embodied Navigation Taskscited by 10
  15. 2025Enhancing Diffusion-based Dataset Distillation via Adversary-Guided Curriculum Samplingcited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 13.

13 papers.

Sort:

By area:

Similar, not cited

Close in wording, no citation either way

  1. 2025Less is More: Empowering GUI Agent with Context-Aware Simplification
  2. 2025History-Aware Reasoning for GUI Agents
  3. 2025GUI-Rise: Structured Reasoning and History Summarization for GUI Navigation
  4. 2025PAL-UI: Planning with Active Look-back for Vision-Based GUI Agents
  5. 2026Compress to Focus: Efficient Coordinate Compression for Policy Optimization in Multi-Turn GUI Agents
  6. 2026A History-Aware Visually Grounded Critic for Computer Use Agents
  7. 2025Chain-of-Memory: Enhancing GUI Agents for Cross-Application Navigation
  8. 2026What Memory Do GUI Agents Really Need? From Passive Records to Active Task-Driving States