UI-MOPD: Multi-Platform On-Policy Distillation for Unified GUI Agents
On the map: LLM agents and tool use → GUI and mobile agents
Abstract (arXiv)
Recent advances in multimodal foundation models and agent systems have driven GUI agents from single-platform task execution toward cross-platform interaction. However, unified multi-platform GUI learning remains challenging: high-quality cross-platform trajectories remain scarce, while platforms share transferable capabilities but differ in action semantics and interaction conventions. Naively mixing supervision or merging specialized models can blur native behaviors and produce imbalanced performance. To address these challenges, we construct Uni-GUI, a high-quality dataset containing nearly 10K executable cross-platform interaction trajectories collected through a unified desktop-mobile harness. Building on Uni-GUI, we propose UI-MOPD, the first framework to introduce multi-teacher on-policy distillation (MOPD) into unified multi-platform GUI agent training. UI-MOPD trains a shared student on its own rollouts and dynamically routes each rollout to the corresponding platform-specialized teacher. At student-visited states, teacher guidance serves as a platform-conditioned behavioral anchor, enabling the integration of complementary desktop and mobile expertise without averaging their distinct interaction conventions. On OSWorld and MobileWorld, UI-MOPD achieves task success rates of 38.2% and 12.0%, respectively, outperforming parameter-matched integration strategies while preserving general GUI grounding. These results demonstrate that multi-teacher on-policy distillation provides an effective approach to building unified cross-platform GUI agents. Project page: https://elispectre.github.io/UI-MOPD/.
Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). Placed in GUI and mobile agents, one of 16 directions in LLM agents and tool use. Builds on 46 of its 52 references that are in the map. First posted on arXiv 5 Jul 2026.
Builds on
46 of 52 references.
Closest ancestors · 20
Same direction, newest first
- 2026OpenMobile: Building Open Mobile Agents with Task and Trajectory Synthesis16 Apr
- 2026ClawGUI: A Unified Framework for Training, Evaluating, and Deploying GUI Agents13 Apr
- 2026KnowU-Bench: Towards Interactive, Proactive, and Personalized Mobile Agent Evaluation9 Apr
- 2026Mobile-Agent-v3.5: Multi-platform Fundamental GUI Agents15 Feb
- 2026UI-Venus-1.5 Technical Report9 Feb
- 2025MobileWorld: Benchmarking Autonomous Mobile Agents in Agent-User Interactive and MCP-Augmented Environments22 Dec
- 2025Step-GUI Technical Report17 Dec
- 2025UI-TARS-2 Technical Report: Advancing GUI Agent with Multi-Turn Reinforcement Learning2 Sep
- 2025Mobile-Agent-v3: Fundamental Agents for GUI Automation21 Aug
- 2025ComputerRL: Scaling End-to-End Online Reinforcement Learning for Computer Use Agents19 Aug
- 2025OpenCUA: Open Foundations for Computer-Use Agents12 Aug
- 2025macOSWorld: A Multilingual Interactive Benchmark for GUI Agents4 Jun
8 more
- 2025Scaling Computer-Use Grounding via User Interface Decomposition and Synthesis19 May
- 2025ScreenSpot-Pro: GUI Grounding for Professional High-Resolution Computer Use4 Apr
- 2025UI-R1: Enhancing Efficient Action Prediction of GUI Agents by Reinforcement Learning27 Mar
- 2025UI-TARS: Pioneering Automated GUI Interaction with Native Agents21 Jan
- 2024OS-ATLAS: A Foundation Action Model for Generalist GUI Agents30 Oct
- 2024Windows Agent Arena: Evaluating Multi-Modal OS Agents at Scale12 Sep
- 2024On the Effects of Data Scale on UI Control Agents6 Jun
- 2024OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environments11 Apr
Other references · 26
- 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,767
- 2025Qwen3-VL Technical Reportcited by 2,534
- 2024HybridFlow: A Flexible and Efficient RLHF Frameworkcited by 1,980
- 2023WebArena: A Realistic Web Environment for Building Autonomous Agentscited by 1,908
- 2019Megatron-LM: Training Multi-Billion Parameter Language Models Using Model Parallelismcited by 1,829
- 2022Model soups: averaging weights of multiple fine-tuned models improves accuracy without increasing inference timecited by 1,366
- 2023SGLang: Efficient Execution of Structured Language Model Programscited by 1,107
- 2026DeepSeek-V4: Towards Highly Efficient Million-Token Context Intelligencecited by 877
- 2023TIES-Merging: Resolving Interference When Merging Modelscited by 795
- 2026GLM-5: from Vibe Coding to Agentic Engineeringcited by 502
- 2024AndroidWorld: A Dynamic Benchmarking Environment for Autonomous Agentscited by 450
- 2026Self-Distilled Reasoner: On-Policy Self-Distillation for Large Language Modelscited by 386
14 more
- 2025Seed1.5-VL Technical Reportcited by 367
- 2026Self-Distillation Enables Continual Learningcited by 212
- 2026MiMo-V2-Flash Technical Reportcited by 163
- 2026On-Policy Context Distillation for Language Modelscited by 161
- 2026Learning beyond Teacher: Generalized On-Policy Distillation with Reward Extrapolationcited by 157
- 2026Nemotron-Cascade 2: Post-Training LLMs with Cascade RL and Multi-Domain On-Policy Distillationcited by 53
- 2026EvoCUA: Evolving Computer Use Agents via Learning from Scalable Synthetic Experiencecited by 51
- 2025Scaling Laws for Optimal Data Mixturescited by 49
- 2026Self-Distilled Agentic Reinforcement Learningcited by 49
- 2026Seed2.0 Model Card: Towards Intelligence Frontier for Real-World Complexitycited by 48
- 2026Uni-OPD: Unifying On-Policy Distillation with a Dual-Perspective Recipecited by 43
- 2026From Verbatim to Gist: Distilling Pyramidal Multimodal Memory via Semantic Information Bottleneck for Long-Horizon Video Agentscited by 14
- 2026Milestone-Guided Policy Learning for Long-Horizon Language Agentscited by 12
- 2026Audio-Oscar: A Multi-Agent System for Complex Audio Scene Generation, Orchestration, and Refinementcited by 4
Built on by
Citing papers per year: 2026: 7.
7 papers.
- 2026Qwen-UI-Agent Technical Report: Toward Next-Generation Real-World Centric Foundation GUI Agentscited by 8
- 2026MAGA: Multi-Platform Self-Fusion of GUI Agents via Structured Action Distillationcited by 3
- 2026Agent-G2: Gaussian Guidance for Agentic Reinforcement Learningcited by 0
- 2026Train4Merge: A Controlled Single-Teacher Study of RL vs. SFT Teachers for OPD-Based Model Mergingcited by 0
- 2026Beyond Teacher Assignment: Domain-Normalized Multi-Teacher On-Policy Distillationcited by 0
- 2026HybridCUA: Learning to Orchestrate GUI and CLI for Computer-Use Agentscited by 0
- 2026Composing What Each Teacher Learned: Multi-Teacher On-Policy Distillation through Teacher-Relative Shiftscited by 0
- 2026Composing What Each Teacher Learned: Multi-Teacher On-Policy Distillation through Teacher-Relative Shifts7 Oct 2026
- 2026HybridCUA: Learning to Orchestrate GUI and CLI for Computer-Use Agents29 Sep 2026
- 2026Beyond Teacher Assignment: Domain-Normalized Multi-Teacher On-Policy Distillation28 Sep 2026
- 2026Train4Merge: A Controlled Single-Teacher Study of RL vs. SFT Teachers for OPD-Based Model Merging26 Sep 2026
- 2026Agent-G2: Gaussian Guidance for Agentic Reinforcement Learning24 Aug 2026
- 2026MAGA: Multi-Platform Self-Fusion of GUI Agents via Structured Action Distillation31 Jul 2026
- 2026Qwen-UI-Agent Technical Report: Toward Next-Generation Real-World Centric Foundation GUI Agents30 Jul 2026
Similar, not cited
Close in wording, no citation either way
- 2026Learn How to Act from Your Own Interactions: On-Policy Self-Distillation for GUI Agents
- 2026LiteGUI: Distilling Compact GUI Agents with Reinforcement Learning
- 2025CRAFT-GUI: Curriculum-Reinforced Agent For GUI Tasks
- 2026UI-Venus-2 Technical Report
- 2026JarvisGUI: Towards Cross-Device GUI Agents with Dynamic Task Composition
- 2025OS-Oracle: A Comprehensive Framework for Cross-Platform GUI Critic Models
- 2026MobileForge: Annotation-Free Adaptation for Mobile GUI Agents with Hierarchical Feedback-Guided Policy Optimization
- 2025MagicGUI: A Foundational Mobile GUI Agent with Scalable Data Pipeline and Reinforcement Fine-tuning