mlsanityData to 7 Oct 2026

Faithful Mobile GUI Agents with Guided Advantage Estimator

arXiv 2605.01208 ↗First posted 2 May 2026cs.AIcited by 1

On the map: LLM agents and tool use → GUI and mobile agents

Abstract (arXiv)

Vision-language model based graphical user interface (GUI) agents have shown strong interaction capabilities. However, they often behave unfaithfully, relying on memorized shortcuts rather than grounding actions in displayed screen evidence or user instructions. To address this, we propose Faithful-Agent, a faithfulness-first framework that reformulates GUI interaction to prioritize evidence groundedness and internal consistency. Faithful-Agent employs a two-stage pipeline: (i) a faithfulness-oriented SFT stage to instill abstainment behaviors under evidence perturbations; (ii) an RFT stage that further amplifies faithfulness by introducing the guided advantage estimator (GuAE), an anchor-based and variance-adaptive advantage tempering mechanism built upon GRPO. GuAE prevents advantage collapse in low-variance rollout groups under sparse GUI rewards, and with a thought-action consistency reward, Faithful-Agent (Stage II) elevates the Trap SR from 13.88% to 80.21% relative to the baseline, while preserving robust general instruction-following performance.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in GUI and mobile agents, one of 16 directions in LLM agents and tool use. Builds on 44 of its 50 references that are in the map. First posted on arXiv 2 May 2026.

Builds on

44 of 50 references.

Closest ancestors · 18

Same direction, newest first

  1. 2025UI-TARS-2 Technical Report: Advancing GUI Agent with Multi-Turn Reinforcement Learning2 Sep
  2. 2025Mobile-Agent-v3: Fundamental Agents for GUI Automation21 Aug
  3. 2025AgentCPM-GUI: Building Mobile-Use Agents with Reinforcement Fine-Tuning2 Jun
  4. 2025ARPO:End-to-End Policy Optimization for GUI Agents with Experience Replay22 May
  5. 2025Enhancing Visual Grounding for GUI Agents via Self-Evolutionary Reinforcement Learning18 May
  6. 2025GUI-R1 : A Generalist R1-Style Vision-Language Action Model For GUI Agents14 Apr
  7. 2025UI-R1: Enhancing Efficient Action Prediction of GUI Agents by Reinforcement Learning27 Mar
  8. 2025Does Chain-of-Thought Reasoning Help Mobile GUI Agent? An Empirical Study21 Mar
  9. 2024GUI Agents: A Survey18 Dec
  10. 2024GUI Agents with Foundation Models: A Comprehensive Survey7 Nov
  11. 2024OS-ATLAS: A Foundation Action Model for Generalist GUI Agents30 Oct
  12. 2024Navigating the Digital World as Humans Do: Universal Visual Grounding for GUI Agents7 Oct
6 more
  1. 2024Caution for the Environment: Multimodal LLM Agents are Susceptible to Environmental Distractions5 Aug
  2. 2024On the Effects of Data Scale on UI Control Agents6 Jun
  3. 2024LlamaTouch: A Faithful and Scalable Testbed for Mobile UI Task Automation12 Apr
  4. 2024Android in the Zoo: Chain-of-Action-Thought for GUI Agents5 Mar
  5. 2024SeeClick: Harnessing GUI Grounding for Advanced Visual GUI Agents17 Jan
  6. 2023CogAgent: A Visual Language Model for GUI Agents14 Dec

Other references · 26

  1. 2025Qwen2.5-VL Technical Reportcited by 5,418
  2. 2025DAPO: An Open-Source LLM Reinforcement Learning System at Scalecited by 2,678
  3. 2025Qwen3-VL Technical Reportcited by 2,534
  4. 2024LlamaFactory: Unified Efficient Fine-Tuning of 100+ Language Modelscited by 1,442
  5. 2025Group Sequence Policy Optimizationcited by 788
  6. 2023Aligning Large Multimodal Models with Factually Augmented RLHFcited by 703
  7. 2025SWE-RL: Advancing LLM Reasoning via Reinforcement Learning on Open Software Evolutioncited by 246
  8. 2024ShowUI: One Vision-Language-Action Model for GUI Visual Agentcited by 226
  9. 2024Multi-Modal Hallucination Control by Visual Information Groundingcited by 196
  10. 2024Don't Hallucinate, Abstain: Identifying LLM Knowledge Gaps via Multi-LLM Collaborationcited by 176
  11. 2024Ferret-UI: Grounded Mobile UI Understanding with Multimodal LLMscited by 173
  12. 2024Attacking Vision-Language Computer Agents via Pop-upscited by 112
14 more
  1. 2025GUI-G2: Gaussian Reward Modeling for GUI Groundingcited by 60
  2. 2025IHEval: Evaluating Language Models on Following the Instruction Hierarchycited by 48
  3. 2024PhD: A ChatGPT-Prompted Visual hallucination Evaluation Datasetcited by 44
  4. 2025Cognitive Foundations for Reasoning and Their Manifestation in LLMscited by 26
  5. 2025The Illusion of Progress: Re-evaluating Hallucination Detection in LLMscited by 22
  6. 2025Evaluating the Robustness of Multimodal Agents Against Active Environmental Injection Attackscited by 21
  7. 2025AutoGUI: Scaling GUI Grounding with Automatic Functionality Annotations from LLMscited by 18
  8. 2025WebCoT: Enhancing Web Agent Reasoning by Reconstructing Chain-of-Thought in Reflection, Branching, and Rollbackcited by 14
  9. 2025TACO: Think-Answer Consistency for Optimized Long-Chain Reasoning and Efficient Data Learning via Reinforcement Learning in LVLMscited by 9
  10. 2025Large Language Models Often Say One Thing and Do Anothercited by 8
  11. 2025MuSLR: Multimodal Symbolic Logical Reasoningcited by 7
  12. 2025Say One Thing, Do Another? Diagnosing Reasoning-Execution Gaps in VLM-Powered Mobile-Use Agentscited by 4
  13. 2025Agent-ScanKit: Unraveling Memory and Reasoning of Multimodal Agents via Sensitivity Perturbationscited by 3
  14. 2025TaskSense: Cognitive Chain Modeling and Difficulty Estimation for GUI Taskscited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2025Towards Trustworthy GUI Agents: A Survey
  2. 2026AmbiBench: Benchmarking Mobile GUI Agents Beyond One-Shot Instructions in the Wild
  3. 2026Alignment Is Local: A Paired Diagnostic for GUI Agents under User-Side Persuasion
  4. 2026Can Agents Work for Everyone? Cross-User Reliability for Mobile GUI Agents in Personalized User Interfaces
  5. 2026Learning Reliable GUI Agents under Imperfect Priors
  6. 2025OS-Kairos: Adaptive Interaction for MLLM-Powered GUI Agents
  7. 2025AppAgentX: Evolving GUI Agents as Proficient Smartphone Users
  8. 2025GUI-Robust: A Comprehensive Dataset for Testing GUI Agent Robustness in Real-World Anomalies