Know What You Don't Know: Agentic Data Synthesis by Evolving Generation Space for Closed-Loop Learning
On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks also fits: Reinforcement learning for LLM agents
also in 1 more
Abstract (arXiv)
The continued improvement of large language models increasingly depends on synthetic experience, yet effective data synthesis for interactive agents requires not only executable and verifiable trajectories, but also interactions that provide learning value for the current task agent. Existing methods increasingly incorporate environment feedback, data validation, or learner failures, but still face a feedback-to-decision gap: observed weaknesses do not directly specify how future synthesis should change, or whether they can be represented by the current synthesis space. To address this gap, we propose EvoSyn, a learning-feedback-driven multi-agent framework that organizes synthesis around a revisable state specifying what interaction factors can be deliberately generated and where synthesis effort should be allocated. A role-specialized multi-agent system translates learner feedback into synthesis revisions, while a Designer allocates synthesis directions and a Planner grounds them into executable experience. This process enables within-space adaptation toward weak or under-covered regions and synthesis-space expansion that promotes newly discovered factors into explicit generation controls. Experiments on τ2-Bench and CAR-Bench show that EvoSyn improves average task success by 13.3 points over the strongest synthesis baseline, while producing higher-quality and structurally broader synthetic experience and discovering controllable factors missed without learner feedback.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 40 of its 44 references that are in the map. First posted on arXiv 8 Oct 2026.
Builds on
40 of 44 references.
Closest ancestors · 12
Same direction, newest first
- 2026Agent-World: Scaling Real-World Environment Synthesis for Evolving General Agent Intelligence20 Apr
- 2026AgentSkiller: Scaling Generalist Agent Intelligence through Semantically Integrated Cross-Domain Data Synthesis10 Feb
- 2026SEAD: Self-Evolving Agent for Multi-Turn Service Dialogue3 Feb
- 2026EvoFSM: Controllable Self-Evolution for Deep Research with Finite State Machines14 Jan
- 2025Agent0: Unleashing Self-Evolving Agents from Zero Data via Tool-Integrated Reasoning20 Nov
- 2025AgentEvolver: Towards Efficient Self-Evolving Agent System13 Nov
- 2025EvolveR: Self-Evolving LLM Agents through an Experience-Driven Lifecycle17 Oct
- 2025Scaling Synthetic Task Generation for Agents via Exploration29 Sep
- 2025Socratic-Zero : Bootstrapping Reasoning via Data-Free Agent Co-evolution29 Sep
- 2025Evolving in Tasks: Empowering the Multi-modality Large Language Model as the Computer Use Agent6 Aug
- 2025APIGen-MT: Agentic Pipeline for Multi-Turn Data Generation via Simulated Agent-Human Interplay4 Apr
- 2024Synthesizing Post-Training Data for LLMs through Multi-Agent Simulation18 Oct
Other references · 28
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2022Self-Instruct: Aligning Language Models with Self-Generated Instructionscited by 2,724
- 2023WizardLM: Empowering large pre-trained language models to follow complex instructionscited by 1,125
- 2022STaR: Bootstrapping Reasoning With Reasoningcited by 940
- 2023MetaMath: Bootstrap Your Own Mathematical Questions for Large Language Modelscited by 735
- 2023WizardMath: Empowering Mathematical Reasoning for Large Language Models via Reinforced Evol-Instructcited by 625
- 2023MAmmoTH: Building Math Generalist Models through Hybrid Instruction Tuningcited by 487
- 2023ToRA: A Tool-Integrated Reasoning Agent for Mathematical Problem Solvingcited by 282
- 2025R-Zero: Self-Evolving Reasoning LLM from Zero Datacited by 228
- 2024OS-Genesis: Automating GUI Agent Trajectory Construction via Reverse Task Synthesiscited by 163
- 2023Self-Alignment with Instruction Backtranslationcited by 151
- 2025Explorer: Scaling Exploration-driven Web Trajectory Synthesis for Multimodal Web Agentscited by 72
16 more
- 2026EnvScaler: Scaling Tool-Interactive Environments for LLM Agent via Programmatic Synthesiscited by 63
- 2025Scaling Agent Learning via Experience Synthesiscited by 44
- 2026Dr. Zero: Self-Evolving Search Agents without Training Datacited by 44
- 2025SwS: Self-aware Weakness-driven Problem Synthesis in Reinforcement Learning for LLM Reasoningcited by 42
- 2025ToolMind Technical Report: A Large-Scale, Reasoning-Enhanced Tool-Use Datasetcited by 30
- 2026CoEvolve: Training LLM Agents via Agent-Data Mutual Evolutioncited by 23
- 2026From Self-Evolving Synthetic Data to Verifiable-Reward RL: Post-Training Multi-turn Interactive Tool-Using Agentscited by 21
- 2025Condor: Enhance LLM Alignment with Knowledge-Driven Data Synthesis and Refinementcited by 18
- 2026Trajectory2Task: Training Robust Tool-Calling Agents with Synthesized Yet Verifiable Data for Complex User Intentscited by 14
- 2025WebAggregator: Enhancing Compositional Reasoning Capabilities of Deep Research Agent Foundation Modelscited by 10
- 2025Klear-AgentForge: Forging Agentic Intelligence through Posttraining Scalingcited by 9
- 2026SCOPE: Self-Play via Co-Evolving Policies for Open-Ended Taskscited by 7
- 2026EigenData: A Self-Evolving Multi-Agent Platform for Function-Calling Data Synthesis, Auditing, and Repaircited by 6
- 2024ResoFilter: Fine-grained Synthetic Data Filtering for Large Language Models through Data-Parameter Resonance Analysiscited by 4
- 2026AgenticQwen: Training Small Agentic Language Models with Dual Data Flywheels for Industrial-Scale Tool Usecited by 3
- 2026WRIT: Write-Read Intensive Trajectory Synthesis for Multi-Turn User-Facing Agentscited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026What Makes Good Agentic Data? An ACE Lens on Data Generation for LLM Agents
- 2026SynCo: Data Synthesis Co-Training for Self-Evolving LLMs via Multi-Agent Reinforcement Learning
- 2026SkillEvo: Self-Renewing Evolution Gradients from Multi-Turn Interaction Feedback
- 2024Multi-Agent Sampling: Scaling Inference Compute for Data Synthesis with Tree Search-Based Agentic Collaboration
- 2026Meta-Task: Turning Terminal Task Synthesis into a Terminal Task for Scalable Agent Training
- 2026SkillComposer: Learning to Evolve Agent Skills for Specification and Generalization
- 2026Experience Funnel: A State-Policy Alternating Loop for Self-Evolving Agents
- 2026VISA: Agentic Self-Evolving Data Synthesis for Multimodal Instruction Following