Perceive Before Reasoning: A Pre-Reasoning Perception Framework for Efficient and Reliable Proactive Mobile Agents
On the map: LLM reasoning → Multimodal reasoning
also in 2 more
Abstract (arXiv)
Multimodal large language models (MLLMs) have substantially advanced mobile agents, yet proactive mobile assistance remains challenging because agents must decide when to intervene before determining how to assist. Existing systems often implement these two decisions within a unified MLLM-based pipeline, leading to goal misalignment between conservative intervention filtering and comprehensive assistance generation, as well as redundant inference when the agent should remain silent. To address these limitations, we propose the Pre-Reasoning Perception Framework (PRPF), a two-stage framework built on perceiving before reasoning. PRPF introduces a lightweight Multimodal Proactive Perceptor (MPP) for intervention gating and context compression, and activates the Proactive Agent Reasoner (PAR) only when intervention is warranted. Experiments on the ProactiveMobile benchmark show that PRPF substantially reduces false trigger rates (FTR) while improving success rates (SR) and inference efficiency over the ProactiveMobile baseline.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 18 of its 41 references that are in the map. First posted on arXiv 2 Jun 2026.
Builds on
18 of 41 references.
Closest ancestors · 1
Same direction, newest first
Other references · 17
- 2024GPT-4o System Cardcited by 4,588
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
- 2024RouteLLM: Learning to Route LLMs with Preference Datacited by 682
- 2025UI-TARS: Pioneering Automated GUI Interaction with Native Agentscited by 610
- 2026Kimi K2.5: Visual Agentic Intelligencecited by 501
- 2024Mobile-Agent: Autonomous Multi-Modal Mobile Device Agent with Visual Perceptioncited by 293
- 2025Think Twice, Click Once: Enhancing GUI Grounding via Fast and Slow Systemscited by 23
- 2026ProAgentBench: Evaluating LLM Agents for Proactive Assistance with Real-World Datacited by 16
- 2026Proactive Agent Research Environment: Simulating Active Users to Evaluate Proactive Assistantscited by 15
- 2025Smoothing Grounding and Reasoning for MLLM-Powered GUI Agents with Query-Oriented Pivot Taskscited by 11
- 2025ProAgent: Harnessing On-Demand Sensory Contexts for Proactive LLM Agent Systems in the Wildcited by 10
- 2026PASK: Toward Intent-Aware Proactive Agents with Long-Term Memorycited by 9
5 more
- 2026PIRA-Bench: A Transition from Reactive GUI Agents to GUI-based Proactive Intent Recommendation Agentscited by 7
- 2026DRS-GUI: Dynamic Region Search for Training-Free GUI Groundingcited by 5
- 2026PRISM: Festina Lente Proactivity -- Risk-Sensitive, Uncertainty-Aware Deliberation for Proactive Agentscited by 3
- 2025iSHIFT: Lightweight Slow-Fast GUI Agent with Adaptive Perceptioncited by 2
- 2026Help Without Being Asked: A Deployed Proactive Agent System for On-Call Support with Continuous Self-Improvementcited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026ProactiveMobile: A Comprehensive Benchmark for Boosting Proactive Intelligence on Mobile Devices
- 2025PerPilot: Personalizing VLM-based Mobile Agents via Memory and Exploration
- 2026ProAct: A Benchmark and Multimodal Framework for Structure-Aware Proactive Response
- 2025Does Chain-of-Thought Reasoning Help Mobile GUI Agent? An Empirical Study
- 2026Agents in the Large: Perception-Centered Architecture for Persistent Agents
- 2026GLM-5V-Turbo: Toward a Native Foundation Model for Multimodal Agents
- 2026MIRAGE: Mobile Agents with Implicit Reasoning and Generative World Models
- 2026Mobile-Aptus: Confidence-Driven Proactive and Robust Interaction in MLLM-based Mobile-Using Agents