Proactive Agent Research Environment: Simulating Active Users to Evaluate Proactive Assistants
Not on the map. Why?
Abstract (arXiv)
Proactive agents that anticipate user needs and autonomously execute tasks hold great promise as digital assistants, yet the lack of realistic user simulation frameworks hinders their development. Existing approaches model apps as flat tool-calling APIs, failing to capture the stateful and sequential nature of user interaction in digital environments and making realistic user simulation infeasible. We introduce Proactive Agent Research Environment (Pare), a framework for building and evaluating proactive agents in digital environments. Pare models applications as finite state machines with stateful navigation and state-dependent action space for the user simulator, enabling active user simulation. Building on this foundation, we present Pare-Bench, a benchmark of 143 diverse tasks spanning communication, productivity, scheduling, and lifestyle apps, designed to test context observation, goal inference, intervention timing, and multi-app orchestration.
Key facts. Cited by 14 papers in the map (data through 7 Oct 2026). Builds on 15 of its 25 references that are in the map. First posted on arXiv 1 Apr 2026.
Builds on
15 of 25 references.
References · 15
- 2022Training language models to follow instructions with human feedbackcited by 15,712
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
- 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,500
- 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversationcited by 1,906
- 2024SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineeringcited by 1,628
- 2024A Survey on LLM-as-a-Judgecited by 1,384
- 2024τ-bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domainscited by 1,280
- 2024OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environmentscited by 1,134
- 2025τ2-Bench: Evaluating Conversational Agents in a Dual-Control Environmentcited by 558
- 2024AppWorld: A Controllable World of Apps and People for Benchmarking Interactive Coding Agentscited by 359
- 2024ToolSandbox: A Stateful, Conversational, Interactive Evaluation Benchmark for LLM Tool Use Capabilitiescited by 272
- 2023TaskBench: Benchmarking Large Language Models for Task Automationcited by 138
Built on by
Citing papers per year: 2026: 14.
14 papers.
Sort:
By area:
- 2026KnowU-Bench: Towards Interactive, Proactive, and Personalized Mobile Agent Evaluationcited by 19
- 2026π-Bench: Evaluating Proactive Personal Assistant Agents in Long-Horizon Workflowscited by 5
- 2026ProactBench: Beyond What The User Asked Forcited by 4
- 2026Audio Interaction Modelcited by 3
- 2026SentinelBench: A Benchmark for Long-Running Monitoring Agentscited by 3
- 2026Agentic Coding Needs Proactivity, Not Just Autonomycited by 2
- 2026Ask Now, Use Later: Benchmarking the Proactivity Gap in Long-Lived LLM Agentscited by 2
- 2026Towards Better Agents for Multi-Turn User Interaction: The Next User Turn Is More Than Contextcited by 1
- 2026Perceive Before Reasoning: A Pre-Reasoning Perception Framework for Efficient and Reliable Proactive Mobile Agentscited by 0
- 2026Searching for Synergy in Shared Workspace Human-AI Collaborationcited by 0
- 2026Disclosure-Gated User Simulation for Companion-Agent Evaluationcited by 0
- 2026Relevance Does Not Imply Applicability: Experience Activation for Personal GUI Agentscited by 0
- 2026Foundations of Proactive Agents: Principles, Technical Layers, and Proactivity-Gym29 Sep 2026
- 2026Asking for What Was Never Requested: Horizontal and Vertical Proactivity in Agents29 Sep 2026
- 2026Relevance Does Not Imply Applicability: Experience Activation for Personal GUI Agents27 Sep 2026
- 2026Disclosure-Gated User Simulation for Companion-Agent Evaluation1 Sep 2026
- 2026Towards Better Agents for Multi-Turn User Interaction: The Next User Turn Is More Than Context18 Aug 2026
- 2026Searching for Synergy in Shared Workspace Human-AI Collaboration16 Jun 2026
- 2026SentinelBench: A Benchmark for Long-Running Monitoring Agents3 Jun 2026
- 2026Audio Interaction Model3 Jun 2026
- 2026Perceive Before Reasoning: A Pre-Reasoning Perception Framework for Efficient and Reliable Proactive Mobile Agents2 Jun 2026
- 2026Ask Now, Use Later: Benchmarking the Proactivity Gap in Long-Lived LLM Agents27 May 2026
- 2026π-Bench: Evaluating Proactive Personal Assistant Agents in Long-Horizon Workflows14 May 2026
- 2026ProactBench: Beyond What The User Asked For9 May 2026
2 more
- 2026KnowU-Bench: Towards Interactive, Proactive, and Personalized Mobile Agent Evaluationcited by 19
- 2026π-Bench: Evaluating Proactive Personal Assistant Agents in Long-Horizon Workflowscited by 5
- 2026Agentic Coding Needs Proactivity, Not Just Autonomycited by 2
- 2026Ask Now, Use Later: Benchmarking the Proactivity Gap in Long-Lived LLM Agentscited by 2
- 2026Disclosure-Gated User Simulation for Companion-Agent Evaluationcited by 0
- 2026Relevance Does Not Imply Applicability: Experience Activation for Personal GUI Agentscited by 0
- 2026Foundations of Proactive Agents: Principles, Technical Layers, and Proactivity-Gymcited by 0
- 2026Foundations of Proactive Agents: Principles, Technical Layers, and Proactivity-Gym29 Sep 2026
- 2026Relevance Does Not Imply Applicability: Experience Activation for Personal GUI Agents27 Sep 2026
- 2026Disclosure-Gated User Simulation for Companion-Agent Evaluation1 Sep 2026
- 2026Ask Now, Use Later: Benchmarking the Proactivity Gap in Long-Lived LLM Agents27 May 2026
- 2026π-Bench: Evaluating Proactive Personal Assistant Agents in Long-Horizon Workflows14 May 2026
- 2026Agentic Coding Needs Proactivity, Not Just Autonomy7 May 2026
- 2026KnowU-Bench: Towards Interactive, Proactive, and Personalized Mobile Agent Evaluation9 Apr 2026
- 2026ProactBench: Beyond What The User Asked Forcited by 4
- 2026Audio Interaction Modelcited by 3
- 2026SentinelBench: A Benchmark for Long-Running Monitoring Agentscited by 3
- 2026Towards Better Agents for Multi-Turn User Interaction: The Next User Turn Is More Than Contextcited by 1
- 2026Searching for Synergy in Shared Workspace Human-AI Collaborationcited by 0
- 2026Asking for What Was Never Requested: Horizontal and Vertical Proactivity in Agentscited by 0
- 2026Asking for What Was Never Requested: Horizontal and Vertical Proactivity in Agents29 Sep 2026
- 2026Towards Better Agents for Multi-Turn User Interaction: The Next User Turn Is More Than Context18 Aug 2026
- 2026Searching for Synergy in Shared Workspace Human-AI Collaboration16 Jun 2026
- 2026SentinelBench: A Benchmark for Long-Running Monitoring Agents3 Jun 2026
- 2026Audio Interaction Model3 Jun 2026
- 2026ProactBench: Beyond What The User Asked For9 May 2026
Similar, not cited
Close in wording, no citation either way
- 2026ProactiveMobile: A Comprehensive Benchmark for Boosting Proactive Intelligence on Mobile Devices
- 2026Act2Intention: A Benchmark For Developing Active Mobile Agents Through Inferring User Intention from GUI Actions
- 2026Claw-Anything: Benchmarking Always-On Personal Assistants with Broader Access to User's Digital World
- 2024SPA-Bench: A Comprehensive Benchmark for SmartPhone Agent Evaluation
- 2026VitaBench 2.0: Evaluating Personalized and Proactive Agents in Long-Term User Interactions
- 2026AppWorld-UL: Benchmarking Diverse Agent-User Interactions for Tool-Use
- 2026ProEvent: An Event-centric Benchmark for Proactive Agents
- 2025Agentic Persona Control and Task State Tracking for Realistic User Simulation in Interactive Scenarios