mlsanityData to 14 Oct 2026

State-Grounded Multi-Agent Synthetic Data Generation for Tool-Augmented LLMs

arXiv 2606.16307 ↗First posted 15 Jun 2026cs.AI cs.CLcited by 4

On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks

also in 1 more
Abstract (arXiv)

Training tool-augmented LLM agents requires large corpora of multi-turn, tool-grounded conversational data that is expensive to annotate, privacy-constrained in production settings, and largely absent from public datasets. We present StateGen, a synthetic data generation platform that produces scored, reasoning-trace-rich training conversations by orchestrating a four-role LLM loop: a persona-conditioned user simulator, an agent under test, a state-grounded tool simulator, and a multi-axis LLM judge. The key architectural contribution is an authoritative state manager that maintains a structured world-state object across turns, enforcing a backend-is-truth invariant that eliminates the dominant class of tool-call hallucinations by construction. StateGen extends naturally to hierarchical multi-agent settings by declaring sub-agents as tools, all sharing a single state object. We report results on 64,698 evaluated conversations across three production corpora: tool-call hallucination scores reach 9.66/10, the system supports persona-driven variation via a 23-dimensional trait vector, and a cleanly separated train and golden evaluation set split confirms the data is not memorization bait (per-criterion gap analysis). Comparison with eight external systems shows that no single publicly available platform combines multi-turn generation, state-grounded tool simulation, hierarchical multi-agent support, and built-in judge scoring.

Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 8 of its 12 references that are in the map. First posted on arXiv 15 Jun 2026.

Builds on

8 of 12 references.

Closest ancestors · 2

Same direction, newest first

  1. 2024τ-bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domains17 Jun
  2. 2023AgentBench: Evaluating LLMs as Agents7 Aug

Other references · 6

  1. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
  2. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
  3. 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,182
  4. 2022Self-Instruct: Aligning Language Models with Self-Generated Instructionscited by 2,724
  5. 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversationcited by 1,988
  6. 2023Textbooks Are All You Needcited by 569

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 4.

4 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026ToolWeave: Structured Synthesis of Complex Multi-Turn Tool-Calling Dialogues
  2. 2024Automated test generation to evaluate tool-augmented LLMs as conversational AI agents
  3. 2025FABRIC: Framework for Agent-Based Realistic Intelligence Creation
  4. 2025ToolMind Technical Report: A Large-Scale, Reasoning-Enhanced Tool-Use Dataset
  5. 2025MetaSynth: Meta-Prompting-Driven Agentic Scaffolds for Diverse Synthetic Data Generation
  6. 2025Modeling User-System Behavior for Training-free Building of Private Domain Conversational Agents
  7. 2026ToolRACER: A Robust Agentic Conversation Emulation Resource for Agent Training and Evaluation
  8. 2026Agent Seer: Synthesizing Scenarios from Specification Understanding