mlsanityData to 7 Oct 2026

LongWoF-Bench: Evaluating EvoMap Genes for Verifiable Long-Workflow Tasks

arXiv 2608.23200 ↗First posted 24 Aug 2026cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

Large language models are increasingly expected to execute complex workflows whose success depends on maintaining interdependent constraints and producing artifacts that satisfy strict end-to-end verification. Yet successful execution experience is typically lost after a single run, forcing subsequent models to rediscover strategies and failure modes from scratch. We study whether such experience can instead be externalized and reused through EvoMap, where verifier-confirmed execution trajectories are consolidated into structured Gene. To evaluate this setting, we introduce the Long-Workflow Benchmark (LongWoF-Bench), comprising 778 machine-verifiable tasks across code generation, agent-environment synthesis, mathematical reasoning, and rule following. On the 252 tasks with verifier-confirmed Opus trajectories, evolved EvoMap Gene outperform Skill across all seven evaluated models by 8.7-15.5 percentage points, with the gains extending to consumer models from different model families. In contrast, reference-distilled Gene do not exhibit the same advantage, indicating that compact representation alone is insufficient and that Gene utility is closely associated with verified experience provenance. For Claude Opus, Gene reuse also completes 39 more tasks than Skill while reducing solve-time token consumption by 9.9%. Together, these results show that verified execution experience can be retained and shared as a reusable external resource, enabling models to improve long-workflow completion without repeatedly paying the full cost of experience discovery.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 16 of its 20 references that are in the map. First posted on arXiv 24 Aug 2026.

Builds on

16 of 20 references.

References · 16

  1. 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,203
  2. 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,193
  3. 2023A Survey on Large Language Model based Autonomous Agentscited by 2,203
  4. 2023WebArena: A Realistic Web Environment for Building Autonomous Agentscited by 1,908
  5. 2023The Rise and Potential of Large Language Model Based Agents: A Surveycited by 1,422
  6. 2024τ-bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domainscited by 1,280
  7. 2024OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environmentscited by 1,134
  8. 2023ExpeL: LLM Agents Are Experiential Learnerscited by 814
  9. 2024WorkArena: How Capable Are Web Agents at Solving Common Knowledge Work Tasks?cited by 348
  10. 2026SkillsBench: Benchmarking How Well Agent Skills Work Across Diverse Taskscited by 289
  11. 2024WorkArena++: Towards Compositional Planning and Reasoning-based Common Knowledge Work Taskscited by 81
  12. 2026How Well Do Agentic Skills Work in the Wild: Benchmarking LLM Skill Usage in Realistic Settingscited by 62
4 more
  1. 2026MiniMax Sparse Attentioncited by 34
  2. 2024Beyond Instruction Following: Evaluating Inferential Rule Following of Large Language Modelscited by 23
  3. 2026From Procedural Skills to Strategy Genes: Towards Experience-Driven Test-Time Evolutioncited by 9
  4. 2026Managing Procedural Memory in LLM Agents: Control, Adaptation, and Evaluationcited by 8

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026It Takes Workflows to Evolve Better Workflows
  2. 2026Evoflux: Inference-Time Evolution of Executable Tool Workflows for Compact Agents
  3. 2026LHAW: Controllable Underspecification for Long-Horizon Tasks
  4. 2026FlowEvo: Self-Evolving Agents through the Co-Evolution of Workflows and Executable Skills
  5. 2026Learning to Compose for Cross-domain Agentic Workflow Generation
  6. 2026Complete Cyclic Subtask Graphs for Tool-Using LLM Agents: Flexibility, Cost, and Bottlenecks in Long-Horizon Workflows
  7. 2026FlowMind: Execute-Summarize for Structured Workflow Generation from LLM Reasoning
  8. 2026LongCLI-Bench: A Preliminary Benchmark and Study for Long-horizon Agentic Programming in Command-Line Interfaces