mlsanityData to 14 Oct 2026

D-Artemis: A Deliberative Cognitive Framework for Mobile GUI Multi-Agents

arXiv 2509.21799 ↗First posted 26 Sep 2025cs.AIcited by 1

On the map: LLM agents and tool use → GUI and mobile agents

Abstract (arXiv)

Graphical User Interface (GUI) agents aim to automate a wide spectrum of human tasks by emulating user interaction. Despite rapid advancements, current approaches are hindered by several critical challenges: data bottleneck in end-to-end training, high cost of delayed error detection, and risk of contradictory guidance. Inspired by the human cognitive loop of Thinking, Alignment, and Reflection, we present D-Artemis -- a novel deliberative framework in this paper. D-Artemis leverages a fine-grained, app-specific tip retrieval mechanism to inform its decision-making process. It also employs a proactive Pre-execution Alignment stage, where Thought-Action Consistency (TAC) Check module and Action Correction Agent (ACA) work in concert to mitigate the risk of execution failures. A post-execution Status Reflection Agent (SRA) completes the cognitive loop, enabling strategic learning from experience. Crucially, D-Artemis enhances the capabilities of general-purpose Multimodal large language models (MLLMs) for GUI tasks without the need for training on complex trajectory datasets, demonstrating strong generalization. D-Artemis establishes new state-of-the-art (SOTA) results across both major benchmarks, achieving a 75.8% success rate on AndroidWorld and 96.8% on ScreenSpot-V2. Extensive ablation studies further demonstrate the significant contribution of each component to the framework.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in GUI and mobile agents, one of 16 directions in LLM agents and tool use. Builds on 32 of its 44 references that are in the map. First posted on arXiv 26 Sep 2025.

Builds on

32 of 44 references.

Closest ancestors · 18

Same direction, newest first

  1. 2025Mobile-Agent-v3: Fundamental Agents for GUI Automation21 Aug
  2. 2025UI-Venus Technical Report: Building High-performance UI Agents with RFT14 Aug
  3. 2025Phi-Ground Tech Report: Advancing Perception in GUI Grounding31 Jul
  4. 2025LPO: Towards Accurate GUI Agent Interaction via Location Preference Optimization11 Jun
  5. 2025GUI-Actor: Coordinate-Free Visual Grounding for GUI Agents3 Jun
  6. 2025GUI-explorer: Autonomous Exploration and Mining of Transition-aware Knowledge for GUI Agent22 May
  7. 2025AndroidGen: Building an Android Language Agent under Data Scarcity27 Apr
  8. 2025Agent S2: A Compositional Generalist-Specialist Framework for Computer Use Agents1 Apr
  9. 2025UI-R1: Enhancing Efficient Action Prediction of GUI Agents by Reinforcement Learning27 Mar
  10. 2025Advancing Mobile GUI Agents: A Verifier-Driven Approach to Practical Deployment20 Mar
  11. 2025UI-TARS: Pioneering Automated GUI Interaction with Native Agents21 Jan
  12. 2024OS-ATLAS: A Foundation Action Model for Generalist GUI Agents30 Oct
6 more
  1. 2024AutoGLM: Autonomous Foundation Agents for GUIs28 Oct
  2. 2024Agent S: An Open Agentic Framework that Uses Computers Like a Human10 Oct
  3. 2024Navigating the Digital World as Humans Do: Universal Visual Grounding for GUI Agents7 Oct
  4. 2024Mobile-Agent: Autonomous Multi-Modal Mobile Device Agent with Visual Perception29 Jan
  5. 2024SeeClick: Harnessing GUI Grounding for Advanced Visual GUI Agents17 Jan
  6. 2023CogAgent: A Visual Language Model for GUI Agents14 Dec

Other references · 14

  1. 2023GPT-4 Technical Reportcited by 18,396
  2. 2025Qwen2.5-VL Technical Reportcited by 5,587
  3. 2024Gemini 1.5: Unlocking multimodal understanding across millions of tokens of contextcited by 3,224
  4. 2023Ferret: Refer and Ground Anything Anywhere at Any Granularitycited by 509
  5. 2024AndroidWorld: A Dynamic Benchmarking Environment for Autonomous Agentscited by 468
  6. 2024A Survey on RAG Meeting LLMs: Towards Retrieval-Augmented Large Language Modelscited by 452
  7. 2025Seed1.5-VL Technical Reportcited by 373
  8. 2024Aguvis: Unified Pure Vision Agents for Autonomous GUI Interactioncited by 278
  9. 2024OmniParser for Pure Vision Based GUI Agentcited by 198
  10. 2024Aria-UI: Visual Grounding for GUI Instructionscited by 140
  11. 2025GTA1: GUI Test-time Scaling Agentcited by 106
  12. 2024RAP: Retrieval-Augmented Planning with Contextual Memory for Multimodal LLM Agentscited by 80
2 more
  1. 2024AutoGuide: Automated Generation and Selection of Context-Aware Guidelines for Large Language Model Agentscited by 74
  2. 2025Look Before You Leap: A GUI-Critic-R1 Model for Pre-Operative Error Diagnosis in GUI Automationcited by 27

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2024Dynamic Planning for LLM-based Graphical User Interface Automation
  2. 2025Learning, Reasoning, Refinement: A Framework for Kahneman's Dual-System Intelligence in GUI Agents
  3. 2025A Survey on (M)LLM-Based GUI Agents
  4. 2025Breaking the Data Barrier -- Building GUI Agents Through Task Generalization
  5. 2025MagicGUI: A Foundational Mobile GUI Agent with Scalable Data Pipeline and Reinforcement Fine-tuning
  6. 2026MAGA: Multi-Platform Self-Fusion of GUI Agents via Structured Action Distillation
  7. 2026OmegaUse: Building a General-Purpose GUI Agent for Autonomous Task Execution
  8. 2026UI-Venus-2 Technical Report