Mobile-Agent-RAG: Driving Smart Multi-Agent Coordination with Contextual Knowledge Empowerment for Long-Horizon Mobile Automation
On the map: LLM agents and tool use → GUI and mobile agents
Abstract (arXiv)
Mobile agents show immense potential, yet current state-of-the-art (SoTA) agents exhibit inadequate success rates on real-world, long-horizon, cross-application tasks. We attribute this bottleneck to the agents' excessive reliance on static, internal knowledge within MLLMs, which leads to two critical failure points: 1) strategic hallucinations in high-level planning and 2) operational errors during low-level execution on user interfaces (UI). The core insight of this paper is that high-level planning and low-level UI operations require fundamentally distinct types of knowledge. Planning demands high-level, strategy-oriented experiences, whereas operations necessitate low-level, precise instructions closely tied to specific app UIs. Motivated by these insights, we propose Mobile-Agent-RAG, a novel hierarchical multi-agent framework that innovatively integrates dual-level retrieval augmentation. At the planning stage, we introduce Manager-RAG to reduce strategic hallucinations by retrieving human-validated comprehensive task plans that provide high-level guidance. At the execution stage, we develop Operator-RAG to improve execution accuracy by retrieving the most precise low-level guidance for accurate atomic actions, aligned with the current app and subtask. To accurately deliver these knowledge types, we construct two specialized retrieval-oriented knowledge bases. Furthermore, we introduce Mobile-Eval-RAG, a challenging benchmark for evaluating such agents on realistic multi-app, long-horizon tasks. Extensive experiments demonstrate that Mobile-Agent-RAG significantly outperforms SoTA baselines, improving task completion rate by 11.0% and step efficiency by 10.2%, establishing a robust paradigm for context-aware, reliable multi-agent mobile automation.
Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Placed in GUI and mobile agents, one of 16 directions in LLM agents and tool use. Builds on 25 of its 35 references that are in the map. First posted on arXiv 15 Nov 2025.
Builds on
25 of 35 references.
Closest ancestors · 7
Same direction, newest first
- 2025GUI-explorer: Autonomous Exploration and Mining of Transition-aware Knowledge for GUI Agent22 May
- 2025A Survey on (M)LLM-Based GUI Agents27 Mar
- 2025AppAgentX: Evolving GUI Agents as Proficient Smartphone Users4 Mar
- 2025Mobile-Agent-E: Self-Evolving Mobile Assistant for Complex Tasks20 Jan
- 2024AppAgent v2: Advanced Agent for Flexible Mobile Interactions5 Aug
- 2024Mobile-Agent: Autonomous Multi-Modal Mobile Device Agent with Visual Perception29 Jan
- 2023AppAgent: Multimodal Agents as Smartphone Users21 Dec
Other references · 18
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
- 2024Gemini 1.5: Unlocking multimodal understanding across millions of tokens of contextcited by 3,224
- 2021WebGPT: Browser-assisted question-answering with human feedbackcited by 1,745
- 2023MemGPT: Towards LLMs as Operating Systemscited by 1,389
- 2021Unsupervised Dense Information Retrieval with Contrastive Learningcited by 1,216
- 2024AndroidWorld: A Dynamic Benchmarking Environment for Autonomous Agentscited by 468
- 2023AutoDroid: LLM-powered Task Automation in Androidcited by 184
- 2024Ferret-UI: Grounded Mobile UI Understanding with Multimodal LLMscited by 176
- 2024Towards Long-Horizon Vision-Language Navigation: Platform, Benchmark and Methodcited by 67
- 2023Explore, Select, Derive, and Recall: Augmenting LLM with Human-like Memory for Mobile Task Automationcited by 58
- 2023DroidBot-GPT: GPT-powered UI Automation for Androidcited by 47
6 more
- 2024Thinking Before Looking: Improving Multimodal LLM Reasoning via Mitigating Visual Hallucinationcited by 29
- 2023VisionTasker: Mobile Task Automation Using Vision Based UI Understanding and LLM Task Planningcited by 28
- 2025Cross-Modal Attention Calibration for LVLM Hallucination Mitigationcited by 23
- 2024Testing and Understanding Erroneous Planning in LLM Agents through Synthesized User Inputscited by 22
- 2024Revealing the Barriers of Language Agents in Planningcited by 20
- 2024CoAct: A Global-Local Hierarchy for Autonomous Agent Collaborationcited by 12
Built on by
Citing papers per year: 2026: 5.
5 papers.
- 2026EvoAgent: An Evolvable Agent Framework with Skill Learning and Multi-Agent Delegationcited by 3
- 2026Jev-Mobile: Jev as an Executor for Mobile GUI Agentscited by 3
- 2026GraMRAG: Orchestrating Multi-Agent Multi-Step Reasoning via Graph Memory with Reinforcement Learningcited by 0
- 2026AgBench: Agentic AI Benchmarks for Personal AI Devicescited by 0
- 2026Learning Reliable GUI Agents under Imperfect Priorscited by 0
- 2026Learning Reliable GUI Agents under Imperfect Priors30 Sep 2026
- 2026AgBench: Agentic AI Benchmarks for Personal AI Devices29 Sep 2026
- 2026Jev-Mobile: Jev as an Executor for Mobile GUI Agents24 Sep 2026
- 2026GraMRAG: Orchestrating Multi-Agent Multi-Step Reasoning via Graph Memory with Reinforcement Learning12 Sep 2026
- 2026EvoAgent: An Evolvable Agent Framework with Skill Learning and Multi-Agent Delegation22 Apr 2026
Similar, not cited
Close in wording, no citation either way
- 2025Mobile-Agent-V: A Video-Guided Approach for Effortless and Efficient Operational Knowledge Injection in Mobile Automation
- 2025Mobile-Agent-V: A Video-Guided Approach for Effortless and Efficient Operational Knowledge Injection in Mobile Automation
- 2025MapAgent: Trajectory-Constructed Memory-Augmented Planning for Mobile Task Automation
- 2024MobileExperts: A Dynamic Tool-Enabled Agent Team in Mobile Devices
- 2024Mobile-Agent-v2: Mobile Device Operation Assistant with Effective Navigation via Multi-Agent Collaboration
- 2026PalmClaw: A Native On-Device Agent Framework for Mobile Phones
- 2026Curiosity Driven Knowledge Retrieval for Mobile Agents
- 2025ReInAgent: A Context-Aware GUI Agent Enabling Human-in-the-Loop Mobile Task Navigation