State-Grounded Multi-Agent Synthetic Data Generation for Tool-Augmented LLMs
On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks
Abstract (arXiv)
Training tool-augmented LLM agents requires large corpora of multi-turn, tool-grounded conversational data that is expensive to annotate, privacy-constrained in production settings, and largely absent from public datasets. We present StateGen, a synthetic data generation platform that produces scored, reasoning-trace-rich training conversations by orchestrating a four-role LLM loop: a persona-conditioned user simulator, an agent under test, a state-grounded tool simulator, and a multi-axis LLM judge. The key architectural contribution is an authoritative state manager that maintains a structured world-state object across turns, enforcing a backend-is-truth invariant that eliminates the dominant class of tool-call hallucinations by construction. StateGen extends naturally to hierarchical multi-agent settings by declaring sub-agents as tools, all sharing a single state object. We report results on 64,698 evaluated conversations across three production corpora: tool-call hallucination scores reach 9.66/10, the system supports persona-driven variation via a 23-dimensional trait vector, and a cleanly separated train and golden evaluation set split confirms the data is not memorization bait (per-criterion gap analysis). Comparison with eight external systems shows that no single publicly available platform combines multi-turn generation, state-grounded tool simulation, hierarchical multi-agent support, and built-in judge scoring.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 8 of its 12 references that are in the map. First posted on arXiv 15 Jun 2026.
Builds on
8 of 12 references.
Closest ancestors · 2
Same direction, newest first
- 2024τ-bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domains17 Jun
- 2023AgentBench: Evaluating LLMs as Agents7 Aug
Other references · 6
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
- 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,182
- 2022Self-Instruct: Aligning Language Models with Self-Generated Instructionscited by 2,724
- 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversationcited by 1,988
- 2023Textbooks Are All You Needcited by 569
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026Rehearsed Multi-Agent Live Product Demonstrations with Real-Time Voice Question Answeringcited by 0
- 2026SenWorld: A Digital-Twin Simulation for Generating Context-Rich Evaluation Datacited by 0
- 2026FiMI Banking: A Sovereign Model for Indian Retail Bankingcited by 0
- 2026A Three-Tier Persona Vector for Controllable User Simulation in Agentic Evaluationcited by 0
- 2026A Three-Tier Persona Vector for Controllable User Simulation in Agentic Evaluation8 Sep 2026
- 2026FiMI Banking: A Sovereign Model for Indian Retail Banking3 Sep 2026
- 2026SenWorld: A Digital-Twin Simulation for Generating Context-Rich Evaluation Data22 Jul 2026
- 2026Rehearsed Multi-Agent Live Product Demonstrations with Real-Time Voice Question Answering29 Jun 2026
Similar, not cited
Close in wording, no citation either way
- 2026ToolWeave: Structured Synthesis of Complex Multi-Turn Tool-Calling Dialogues
- 2024Automated test generation to evaluate tool-augmented LLMs as conversational AI agents
- 2025FABRIC: Framework for Agent-Based Realistic Intelligence Creation
- 2025ToolMind Technical Report: A Large-Scale, Reasoning-Enhanced Tool-Use Dataset
- 2025MetaSynth: Meta-Prompting-Driven Agentic Scaffolds for Diverse Synthetic Data Generation
- 2025Modeling User-System Behavior for Training-free Building of Private Domain Conversational Agents
- 2026ToolRACER: A Robust Agentic Conversation Emulation Resource for Agent Training and Evaluation
- 2026Agent Seer: Synthesizing Scenarios from Specification Understanding