mlsanityData to 7 Oct 2026

Proactive Agent Research Environment: Simulating Active Users to Evaluate Proactive Assistants

arXiv 2604.00842 ↗First posted 1 Apr 2026cs.AI cs.LG cs.MAcited by 14

Not on the map. Why?

Abstract (arXiv)

Proactive agents that anticipate user needs and autonomously execute tasks hold great promise as digital assistants, yet the lack of realistic user simulation frameworks hinders their development. Existing approaches model apps as flat tool-calling APIs, failing to capture the stateful and sequential nature of user interaction in digital environments and making realistic user simulation infeasible. We introduce Proactive Agent Research Environment (Pare), a framework for building and evaluating proactive agents in digital environments. Pare models applications as finite state machines with stateful navigation and state-dependent action space for the user simulator, enabling active user simulation. Building on this foundation, we present Pare-Bench, a benchmark of 143 diverse tasks spanning communication, productivity, scheduling, and lifestyle apps, designed to test context observation, goal inference, intervention timing, and multi-app orchestration.

Key facts. Cited by 14 papers in the map (data through 7 Oct 2026). Builds on 15 of its 25 references that are in the map. First posted on arXiv 1 Apr 2026.

Builds on

15 of 25 references.

References · 15

  1. 2022Training language models to follow instructions with human feedbackcited by 15,712
  2. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
  3. 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,500
  4. 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversationcited by 1,906
  5. 2024SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineeringcited by 1,628
  6. 2024A Survey on LLM-as-a-Judgecited by 1,384
  7. 2024τ-bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domainscited by 1,280
  8. 2024OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environmentscited by 1,134
  9. 2025τ2-Bench: Evaluating Conversational Agents in a Dual-Control Environmentcited by 558
  10. 2024AppWorld: A Controllable World of Apps and People for Benchmarking Interactive Coding Agentscited by 359
  11. 2024ToolSandbox: A Stateful, Conversational, Interactive Evaluation Benchmark for LLM Tool Use Capabilitiescited by 272
  12. 2023TaskBench: Benchmarking Large Language Models for Task Automationcited by 138
3 more
  1. 2024Proactive Agent: Shifting LLM Agents from Reactive Responses to Active Assistancecited by 84
  2. 2025ContextAgent: Context-Aware Proactive LLM Agents with Open-World Sensory Perceptionscited by 44
  3. 2025AgentSynth: Scalable Task Generation for Generalist Computer-Use Agentscited by 41

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 14.

14 papers.

Sort:

By area:

Similar, not cited

Close in wording, no citation either way

  1. 2026ProactiveMobile: A Comprehensive Benchmark for Boosting Proactive Intelligence on Mobile Devices
  2. 2026Act2Intention: A Benchmark For Developing Active Mobile Agents Through Inferring User Intention from GUI Actions
  3. 2026Claw-Anything: Benchmarking Always-On Personal Assistants with Broader Access to User's Digital World
  4. 2024SPA-Bench: A Comprehensive Benchmark for SmartPhone Agent Evaluation
  5. 2026VitaBench 2.0: Evaluating Personalized and Proactive Agents in Long-Term User Interactions
  6. 2026AppWorld-UL: Benchmarking Diverse Agent-User Interactions for Tool-Use
  7. 2026ProEvent: An Event-centric Benchmark for Proactive Agents
  8. 2025Agentic Persona Control and Task State Tracking for Realistic User Simulation in Interactive Scenarios