mlsanityData to 14 Oct 2026

DRFLOW: A Deep Research Benchmark for Personalized Workflow Prediction

arXiv 2606.18191 ↗First posted 16 Jun 2026cs.AI cs.MAcited by 0

Not on the map. Why?

Abstract (arXiv)

Deep research (DR) systems are increasingly used for complex information-seeking tasks, but existing works mainly focus on generating reports and summaries. In contrast, many enterprise tasks instead require an agent to identify concrete workflows which is a sequence of action-steps. For example, rather than summarizing budgeting policies, an agent should be able to determine the steps needed to answer a question such as: "How do I request new headcount given a fixed budget?". Therefore, we introduce DRFLOW, a benchmark for evaluating personalized workflows predicted by agents from heterogeneous sources. Each task requires the agent to identify relevant evidence from scattered sources, then use that evidence to predict the correct action-step sequence for the user's task. DRFLOW contains 100 tasks across five domains, with 1,246 reference workflow steps grounded in more than 3,900 sources. We define seven diagnostic metrics covering factual grounding, step recovery, structural ordering, condition resolution, and personalization. We further present DRFLOW-Agent (DRFA), a workflow-oriented reference agent to predict personalized workflow. We show that although DRFA improves over strong baseline agents (upto 10.02% average F1 score), there is substantial room for improvement remains across these workflow metrics, indicating that predicting complete and correct personalized workflows remains a challenging frontier for deep research.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 7 of its 44 references that are in the map. First posted on arXiv 16 Jun 2026.

Builds on

7 of 44 references.

References · 7

  1. 2025gpt-oss-120b & gpt-oss-20b Model Cardcited by 1,386
  2. 2024WebLINX: Real-World Website Navigation with Multi-Turn Dialoguecited by 180
  3. 2024WorkArena++: Towards Compositional Planning and Reasoning-based Common Knowledge Work Taskscited by 90
  4. 2024AutoFlow: Automated Workflow Generation for Large Language Model Agentscited by 83
  5. 2024OfficeBench: Benchmarking Language Agents across Multiple Applications for Office Automationcited by 70
  6. 2026DRACO: a Cross-Domain Benchmark for Deep Research Accuracy, Completeness, and Objectivitycited by 14
  7. 2026Chat2Workflow: A Benchmark for Generating Executable Visual Workflows with Natural Languagecited by 3

Built on by

Not cited yet.