TopoCurate:Modeling Interaction Topology for Tool-Use Agent Training
Not on the map. Why?
Abstract (arXiv)
Training tool-use agents typically relies on outcome-based filtering: Supervised Fine-Tuning (SFT) on successful trajectories and Reinforcement Learning (RL) on pass-rate-selected tasks. However, this paradigm ignores interaction dynamics: successful trajectories may lack error recovery or exhibit redundancy, while pass rates fail to distinguish structurally informative tasks from trivial ones. We propose TopoCurate, an interaction-aware framework that projects multi-trial rollouts from the same task into a unified semantic quotient topology. By merging equivalent action-observation states, this projection transforms scattered linear trajectories into a structured manifold that explicitly captures how tool invocations and environmental responses drive the divergence between effective strategies and failure modes. Leveraging this representation, we introduce a dual-selection mechanism: for SFT, we prioritize trajectories demonstrating reflective recovery, semantic efficiency, and strategic diversity to mitigate covariate shift and mode collapse; for RL, we select tasks with high error branch ratios and strategic heterogeneity, maximizing gradient Signal-to-Noise Ratio to address vanishing signals in sparse-reward settings. Evaluations on BFCLv3 and Tau2 Bench show that TopoCurate achieves consistent gains of 4.2% (SFT) and 6.9% (RL) over state-of-the-art baselines. We will release the code and data soon for further investigations.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 40 of its 47 references that are in the map. First posted on arXiv 2 Mar 2026.
Builds on
40 of 47 references.
References · 40
- 2025Qwen3 Technical Reportcited by 8,195
- 2024τ-bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domainscited by 1,280
- 2025DeepSeek-V3.2: Pushing the Frontier of Open Large Language Modelscited by 755
- 2025τ2-Bench: Evaluating Conversational Agents in a Dual-Control Environmentcited by 558
- 2025Kimi K2: Open Agentic Intelligencecited by 523
- 2025GLM-4.5: Agentic, Reasoning, and Coding (ARC) Foundation Modelscited by 446
- 2025APIGen-MT: Agentic Pipeline for Multi-Turn Data Generation via Simulated Agent-Human Interplaycited by 158
- 2025Where LLM Agents Fail and How They can Learn From Failurescited by 118
- 2023Jina Embeddings 2: 8192-Token General-Purpose Text Embeddings for Long Documentscited by 103
- 2025Agent Learning via Early Experiencecited by 79
- 2025Tree Search for LLM Agent Reinforcement Learningcited by 73
- 2025MiroThinker: Pushing the Performance Boundaries of Open-Source Research Agents via Model, Context, and Interactive Scalingcited by 72
28 more
- 2025ACEBench: Who Wins the Match Point in Tool Usage?cited by 66
- 2025TreePO: Bridging the Gap of Policy Optimization and Efficacy and Inference Efficiency with Heuristic Tree-based Modelingcited by 60
- 2025Simulating Environments with Reasoning Models for Agent Trainingcited by 52
- 2025Towards General Agentic Intelligence via Environment Scalingcited by 51
- 2021Partially Observable Markov Decision Processes (POMDPs) and Roboticscited by 49
- 2026LongCat-Flash-Thinking-2601 Technical Reportcited by 32
- 2025MUA-RL: Multi-turn User-interacting Agent Reinforcement Learning for agentic tool usecited by 30
- 2025Exploiting Tree Structure for Credit Assignment in RL Training of LLMscited by 27
- 2025ToolMind Technical Report: A Large-Scale, Reasoning-Enhanced Tool-Use Datasetcited by 27
- 2024Synthesizing Post-Training Data for LLMs through Multi-Agent Simulationcited by 22
- 2025Procedural Environment Generation for Tool-Use Agentscited by 21
- 2026PACEvolve: Enabling Progress-Aware Consistent Evolutioncited by 21
- 2025AutoForge: Automated Environment Synthesis for Agentic Reinforcement Learningcited by 14
- 2026ToolPRMBench: Evaluating and Advancing Process Reward Models for Tool-using Agentscited by 13
- 2025Pass@k Metric for RLVR: A Diagnostic Tool of Exploration, But Not an Objectivecited by 11
- 2025WebOperator: Action-Aware Tree Search for Autonomous Agents in Web Environmentcited by 10
- 2026Robust Tool Use via Fission-GRPO: Learning to Recover from Execution Errorscited by 10
- 2025FunReason-MT Technical Report: Advanced Data Synthesis Solution for Real-world Multi-Turn Tool-usecited by 9
- 2025Exploring Expert Failures Improves LLM Agent Tuningcited by 7
- 2025Reinforcement Learning for Tool-Integrated Interleaved Thinking towards Cross-Domain Generalizationcited by 7
- 2025Interaction Dynamics as a Reward Signal for LLMscited by 5
- 2025PORTool: Importance-Aware Policy Optimization with Rewarded Tree for Multi-Tool-Integrated Reasoningcited by 4
- 2026Pushing the Boundaries of Natural Reasoning: Interleaved Bonus from Formal-Logic Verificationcited by 4
- 2025Rethinking LLM Training through Information Geometry and Quantum Metricscited by 3
- 2026SIGHT: Reinforcement Learning with Self-Evidence and Information-Gain Diverse Branching for Search Agentcited by 3
- 2025ToolPRM: Fine-Grained Inference Scaling of Structured Outputs for Function Callingcited by 2
- 2025Interaction as Intelligence Part II: Asynchronous Human-Agent Rollout for Long-Horizon Task Trainingcited by 1
- 2025Scaling and Transferability of Annealing Strategies in Large Language Model Trainingcited by 1
Built on by
Citing papers per year: 2026: 3.
3 papers.
- 2026Agentic Environment Engineering for Large Language Models: A Survey of Environment Modeling, Synthesis, Evaluation, and Applicationcited by 8
- 2026Hybrid Inspection and Task-Based Access Control in Zero-Trust Agentic AIcited by 0
- 2026Behavior Quotient Learning for Low-Rank Adaptation of LLM Agentscited by 0
- 2026Behavior Quotient Learning for Low-Rank Adaptation of LLM Agents11 Sep 2026
- 2026Agentic Environment Engineering for Large Language Models: A Survey of Environment Modeling, Synthesis, Evaluation, and Application10 Jun 2026
- 2026Hybrid Inspection and Task-Based Access Control in Zero-Trust Agentic AI4 May 2026