mlsanityData to 14 Oct 2026

Know What You Don't Know: Agentic Data Synthesis by Evolving Generation Space for Closed-Loop Learning

arXiv 2610.12593 ↗First posted 8 Oct 2026cs.AI cs.MAcited by 0

On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks also fits: Reinforcement learning for LLM agents

also in 1 more
Abstract (arXiv)

The continued improvement of large language models increasingly depends on synthetic experience, yet effective data synthesis for interactive agents requires not only executable and verifiable trajectories, but also interactions that provide learning value for the current task agent. Existing methods increasingly incorporate environment feedback, data validation, or learner failures, but still face a feedback-to-decision gap: observed weaknesses do not directly specify how future synthesis should change, or whether they can be represented by the current synthesis space. To address this gap, we propose EvoSyn, a learning-feedback-driven multi-agent framework that organizes synthesis around a revisable state specifying what interaction factors can be deliberately generated and where synthesis effort should be allocated. A role-specialized multi-agent system translates learner feedback into synthesis revisions, while a Designer allocates synthesis directions and a Planner grounds them into executable experience. This process enables within-space adaptation toward weak or under-covered regions and synthesis-space expansion that promotes newly discovered factors into explicit generation controls. Experiments on τ2-Bench and CAR-Bench show that EvoSyn improves average task success by 13.3 points over the strongest synthesis baseline, while producing higher-quality and structurally broader synthetic experience and discovering controllable factors missed without learner feedback.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 40 of its 44 references that are in the map. First posted on arXiv 8 Oct 2026.

Builds on

40 of 44 references.

Closest ancestors · 12

Same direction, newest first

  1. 2026Agent-World: Scaling Real-World Environment Synthesis for Evolving General Agent Intelligence20 Apr
  2. 2026AgentSkiller: Scaling Generalist Agent Intelligence through Semantically Integrated Cross-Domain Data Synthesis10 Feb
  3. 2026SEAD: Self-Evolving Agent for Multi-Turn Service Dialogue3 Feb
  4. 2026EvoFSM: Controllable Self-Evolution for Deep Research with Finite State Machines14 Jan
  5. 2025Agent0: Unleashing Self-Evolving Agents from Zero Data via Tool-Integrated Reasoning20 Nov
  6. 2025AgentEvolver: Towards Efficient Self-Evolving Agent System13 Nov
  7. 2025EvolveR: Self-Evolving LLM Agents through an Experience-Driven Lifecycle17 Oct
  8. 2025Scaling Synthetic Task Generation for Agents via Exploration29 Sep
  9. 2025Socratic-Zero : Bootstrapping Reasoning via Data-Free Agent Co-evolution29 Sep
  10. 2025Evolving in Tasks: Empowering the Multi-modality Large Language Model as the Computer Use Agent6 Aug
  11. 2025APIGen-MT: Agentic Pipeline for Multi-Turn Data Generation via Simulated Agent-Human Interplay4 Apr
  12. 2024Synthesizing Post-Training Data for LLMs through Multi-Agent Simulation18 Oct

Other references · 28

  1. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  2. 2022Self-Instruct: Aligning Language Models with Self-Generated Instructionscited by 2,724
  3. 2023WizardLM: Empowering large pre-trained language models to follow complex instructionscited by 1,125
  4. 2022STaR: Bootstrapping Reasoning With Reasoningcited by 940
  5. 2023MetaMath: Bootstrap Your Own Mathematical Questions for Large Language Modelscited by 735
  6. 2023WizardMath: Empowering Mathematical Reasoning for Large Language Models via Reinforced Evol-Instructcited by 625
  7. 2023MAmmoTH: Building Math Generalist Models through Hybrid Instruction Tuningcited by 487
  8. 2023ToRA: A Tool-Integrated Reasoning Agent for Mathematical Problem Solvingcited by 282
  9. 2025R-Zero: Self-Evolving Reasoning LLM from Zero Datacited by 228
  10. 2024OS-Genesis: Automating GUI Agent Trajectory Construction via Reverse Task Synthesiscited by 163
  11. 2023Self-Alignment with Instruction Backtranslationcited by 151
  12. 2025Explorer: Scaling Exploration-driven Web Trajectory Synthesis for Multimodal Web Agentscited by 72
16 more
  1. 2026EnvScaler: Scaling Tool-Interactive Environments for LLM Agent via Programmatic Synthesiscited by 63
  2. 2025Scaling Agent Learning via Experience Synthesiscited by 44
  3. 2026Dr. Zero: Self-Evolving Search Agents without Training Datacited by 44
  4. 2025SwS: Self-aware Weakness-driven Problem Synthesis in Reinforcement Learning for LLM Reasoningcited by 42
  5. 2025ToolMind Technical Report: A Large-Scale, Reasoning-Enhanced Tool-Use Datasetcited by 30
  6. 2026CoEvolve: Training LLM Agents via Agent-Data Mutual Evolutioncited by 23
  7. 2026From Self-Evolving Synthetic Data to Verifiable-Reward RL: Post-Training Multi-turn Interactive Tool-Using Agentscited by 21
  8. 2025Condor: Enhance LLM Alignment with Knowledge-Driven Data Synthesis and Refinementcited by 18
  9. 2026Trajectory2Task: Training Robust Tool-Calling Agents with Synthesized Yet Verifiable Data for Complex User Intentscited by 14
  10. 2025WebAggregator: Enhancing Compositional Reasoning Capabilities of Deep Research Agent Foundation Modelscited by 10
  11. 2025Klear-AgentForge: Forging Agentic Intelligence through Posttraining Scalingcited by 9
  12. 2026SCOPE: Self-Play via Co-Evolving Policies for Open-Ended Taskscited by 7
  13. 2026EigenData: A Self-Evolving Multi-Agent Platform for Function-Calling Data Synthesis, Auditing, and Repaircited by 6
  14. 2024ResoFilter: Fine-grained Synthetic Data Filtering for Large Language Models through Data-Parameter Resonance Analysiscited by 4
  15. 2026AgenticQwen: Training Small Agentic Language Models with Dual Data Flywheels for Industrial-Scale Tool Usecited by 3
  16. 2026WRIT: Write-Read Intensive Trajectory Synthesis for Multi-Turn User-Facing Agentscited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026What Makes Good Agentic Data? An ACE Lens on Data Generation for LLM Agents
  2. 2026SynCo: Data Synthesis Co-Training for Self-Evolving LLMs via Multi-Agent Reinforcement Learning
  3. 2026SkillEvo: Self-Renewing Evolution Gradients from Multi-Turn Interaction Feedback
  4. 2024Multi-Agent Sampling: Scaling Inference Compute for Data Synthesis with Tree Search-Based Agentic Collaboration
  5. 2026Meta-Task: Turning Terminal Task Synthesis into a Terminal Task for Scalable Agent Training
  6. 2026SkillComposer: Learning to Evolve Agent Skills for Specification and Generalization
  7. 2026Experience Funnel: A State-Policy Alternating Loop for Self-Evolving Agents
  8. 2026VISA: Agentic Self-Evolving Data Synthesis for Multimodal Instruction Following