mlsanityData to 14 Oct 2026

CurateEvo: Data-Curation Evolving for Agentic Post-Training

arXiv 2607.06140 ↗First posted 7 Jul 2026cs.CLcited by 1

On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks

Abstract (arXiv)

Large language model (LLM) agents require post-training methods that can improve long-horizon decision making from environment feedback. However, existing agentic post-training pipelines often treat data curation as a fixed preprocessing step, focusing mainly on data augmentation while neglecting filtering, refinement, and adaptation to downstream failures. We propose CurateEvo, a failure-driven dynamic evolution framework for agentic post-training data curation. CurateEvo represents the curation strategy as executable code and iteratively rewrites it using failed trajectories from a held-out development set. At each epoch, the evolved strategy transforms a fixed raw corpus into supervised fine-tuning data, reinforcement learning data, and an inference-time memory bank. The evolution process first improves effectiveness by diagnosing recurring failure modes and augmenting, filtering, or refining data accordingly, and then improves efficiency by pruning redundant or low-utility training turns under a cost-aware objective. Experiments on ACEBench-Agent, BFCL-V4, and τ2-Bench under both labeled and wild-data settings show that CurateEvo consistently outperforms prior curation methods, improving average scores by 3.2 and 2.7 points, respectively. Further analyses demonstrate that CurateEvo is compatible with different post-training recipes and substantially reduces curation overhead.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 31 of its 41 references that are in the map. First posted on arXiv 7 Jul 2026.

Builds on

31 of 41 references.

Closest ancestors · 9

Same direction, newest first

  1. 2026Agent World Model: Infinity Synthetic Environments for Agentic Reinforcement Learning10 Feb
  2. 2025Agent Data Protocol: Unifying Datasets for Diverse, Effective Fine-tuning of LLM Agents28 Oct
  3. 2025Exploring Expert Failures Improves LLM Agent Tuning17 Apr
  4. 2025ATLaS: Agent Tuning via Learning Critical Steps4 Mar
  5. 2024AgentBank: Towards Generalized LLM Agents via Fine-Tuning on 50000+ Interaction Trajectories10 Oct
  6. 2024Agent-FLAN: Designing Data and Methods of Effective Agent Tuning for Large Language Models19 Mar
  7. 2024Learning From Failure: Integrating Negative Examples when Fine-tuning Large Language Models as Agents18 Feb
  8. 2023Agent Lumos: Unified and Modular Training for Open-Source Language Agents9 Nov
  9. 2023AgentTuning: Enabling Generalized Agent Abilities for LLMs19 Oct

Other references · 22

  1. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  2. 2023ToolLLM: Facilitating Large Language Models to Master 16000+ Real-world APIscited by 1,947
  3. 2024SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineeringcited by 1,737
  4. 2025Search-R1: Training LLMs to Reason and Leverage Search Engines with Reinforcement Learningcited by 1,444
  5. 2022WebShop: Towards Scalable Real-World Web Interaction with Grounded Language Agentscited by 1,251
  6. 2023Mind2Web: Towards a Generalist Agent for the Webcited by 1,242
  7. 2025τ2-Bench: Evaluating Conversational Agents in a Dual-Control Environmentcited by 627
  8. 2024LESS: Selecting Influential Data for Targeted Instruction Tuningcited by 532
  9. 2025RAGEN: Understanding Self-Evolution in LLM Agents via Multi-Turn Reinforcement Learningcited by 386
  10. 2024WebRL: Training LLM Web Agents via Self-Evolving Online Curriculum Reinforcement Learningcited by 256
  11. 2024Trial and Error: Exploration-Based Trajectory Optimization for LLM Agentscited by 197
  12. 2025WebAgent-R1: Training Web Agents via End-to-End Multi-Turn Reinforcement Learningcited by 165
10 more
  1. 2024AutoWebGLM: A Large Language Model-based Web Navigating Agentcited by 130
  2. 2025AgentRewardBench: Evaluating Automatic Evaluations of Web Agent Trajectoriescited by 108
  3. 2026EnvScaler: Scaling Tool-Interactive Environments for LLM Agent via Programmatic Synthesiscited by 63
  4. 2024EnvGen: Generating and Adapting Environments via LLMs for Training Embodied Agentscited by 46
  5. 2026SWE-chat: Coding Agent Interactions From Real Users in the Wildcited by 43
  6. 2025Efficient Multi-turn RL for GUI Agents via Decoupled Training and Adaptive Data Curationcited by 26
  7. 2024DataEnvGym: Data Generation Agents in Teacher Environments with Student Feedbackcited by 25
  8. 2025WebCoT: Enhancing Web Agent Reasoning by Reconstructing Chain-of-Thought in Reflection, Branching, and Rollbackcited by 17
  9. 2025FunReason-MT Technical Report: Advanced Data Synthesis Solution for Real-world Multi-Turn Tool-usecited by 9
  10. 2026RODS: Reward-Driven Online Data Synthesis for Multi-Turn Tool-Use Agentscited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026ADE: Agentic Data Evolution Framework for Human-Centered Objectives
  2. 2025The Path of Self-Evolving Large Language Models: Achieving Data-Efficient Learning via Intrinsic Feedback
  3. 2026Position: Agentic Evolution is the Path to Evolving LLMs
  4. 2026Can Generalist Agents Automate Data Curation?
  5. 2025Adaptation of Agentic AI: A Survey of Post-Training, Memory, and Skills
  6. 2026A Survey of Reinforcement Learning for Large Language Models under Data Scarcity: Challenges and Solutions
  7. 2026EvoArena: Tracking Memory Evolution for Robust LLM Agents in Dynamic Environments
  8. 2026Exploring Autonomous Agentic Data Engineering for Model Specialization