mlsanityData to 14 Oct 2026

GraphForge: Training Working Agents with Graph-Anchored Workspace Synthesis

arXiv 2609.38923 ↗First posted 30 Sep 2026cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

Working agents need to read diverse files, coordinate tools, and produce deliverables. Training such agents requires tasks built on many real files with verifiable results, but few pipelines exist to synthesize this kind of data. Existing pipelines either generate files with models, which lack realism and diversity, or build tasks on real files without task-specific verifiers, leaving result quality unchecked. We introduce GraphForge, an evidence-graph based framework that grounds both the task and its verification in real files. Starting from occupation-grounded seeds for controlled diversity, GraphForge assembles a workspace of real files for each seed and builds an evidence graph over their relations. Since the task statement and rubrics are both derived from this graph, task requirements are backed by the workspace files and each criterion is anchored to the files needed to verify it. An initial rollout further tests executability, and a revision agent repairs the task and rubrics against the original files before trajectories are collected. Fine-tuning Qwen3.6-27B on 2,169 GraphForge trajectories brings GDPVal to 1445.7 (+65.7) under OpenHands, and Workspace-Bench-Lite and SpreadsheetBench II to 63.7 (+7.7) and 24.0 (+13.7) under Claude Code. Rejection fine-tuning on the SFT model's own rollouts, with candidates selected by the evidence-anchored rubrics, yields further improvements on all three benchmarks, suggesting that the rubrics provide a useful selection signal.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 17 of its 25 references that are in the map. First posted on arXiv 30 Sep 2026.

Builds on

17 of 25 references.

References · 17

  1. 2024Chatbot Arena: An Open Platform for Evaluating LLMs by Human Preferencecited by 1,184
  2. 2025R2E-Gym: Procedural Environments and Hybrid Verifiers for Scaling Open-Weights SWE Agentscited by 158
  3. 2025GDPval: Evaluating AI Model Performance on Real-World Economically Valuable Taskscited by 158
  4. 2026Agent World Model: Infinity Synthetic Environments for Agentic Reinforcement Learningcited by 66
  5. 2026Claw-Eval: Towards Trustworthy Evaluation of Autonomous Agentscited by 64
  6. 2023Elo Uncovered: Robustness and Best Practices in Language Model Evaluationcited by 61
  7. 2026Agent-World: Scaling Real-World Environment Synthesis for Evolving General Agent Intelligencecited by 54
  8. 2025AgentSynth: Scalable Task Generation for Generalist Computer-Use Agentscited by 46
  9. 2026Large-Scale Terminal Agentic Trajectory Generation from Dockerized Environmentscited by 33
  10. 2026Workspace-Bench 1.0: Benchmarking AI Agents on Workspace Tasks with Large-Scale File Dependenciescited by 29
  11. 2026Toward Scalable Terminal Task Synthesis via Skill Graphscited by 22
  12. 2026SpreadsheetBench 2: Evaluating Agents on End-to-End Business Spreadsheet Workflowscited by 11
5 more
  1. 2026How Well Does Agent Development Reflect Real-World Work?cited by 10
  2. 2026FACET: Preserving Source Intent and Executable State in Terminal Task Synthesiscited by 9
  3. 2026NexForge: Scaling Agent Capabilities through Requirement-Driven Task Synthesis for LLMscited by 7
  4. 2026AGORA: An Archive-Grounded Benchmark for Agentic Workplace Document Reasoningcited by 4
  5. 2026EnvCraft: Synthesizing Executable Environments in Agentic RL for Claw-like Agentcited by 1

Built on by

Not cited yet.