mlsanityData to 7 Oct 2026

TopoCurate:Modeling Interaction Topology for Tool-Use Agent Training

arXiv 2603.01714 ↗First posted 2 Mar 2026cs.LG cs.CLcited by 3

Not on the map. Why?

Abstract (arXiv)

Training tool-use agents typically relies on outcome-based filtering: Supervised Fine-Tuning (SFT) on successful trajectories and Reinforcement Learning (RL) on pass-rate-selected tasks. However, this paradigm ignores interaction dynamics: successful trajectories may lack error recovery or exhibit redundancy, while pass rates fail to distinguish structurally informative tasks from trivial ones. We propose TopoCurate, an interaction-aware framework that projects multi-trial rollouts from the same task into a unified semantic quotient topology. By merging equivalent action-observation states, this projection transforms scattered linear trajectories into a structured manifold that explicitly captures how tool invocations and environmental responses drive the divergence between effective strategies and failure modes. Leveraging this representation, we introduce a dual-selection mechanism: for SFT, we prioritize trajectories demonstrating reflective recovery, semantic efficiency, and strategic diversity to mitigate covariate shift and mode collapse; for RL, we select tasks with high error branch ratios and strategic heterogeneity, maximizing gradient Signal-to-Noise Ratio to address vanishing signals in sparse-reward settings. Evaluations on BFCLv3 and Tau2 Bench show that TopoCurate achieves consistent gains of 4.2% (SFT) and 6.9% (RL) over state-of-the-art baselines. We will release the code and data soon for further investigations.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 40 of its 47 references that are in the map. First posted on arXiv 2 Mar 2026.

Builds on

40 of 47 references.

References · 40

  1. 2025Qwen3 Technical Reportcited by 8,195
  2. 2024τ-bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domainscited by 1,280
  3. 2025DeepSeek-V3.2: Pushing the Frontier of Open Large Language Modelscited by 755
  4. 2025τ2-Bench: Evaluating Conversational Agents in a Dual-Control Environmentcited by 558
  5. 2025Kimi K2: Open Agentic Intelligencecited by 523
  6. 2025GLM-4.5: Agentic, Reasoning, and Coding (ARC) Foundation Modelscited by 446
  7. 2025APIGen-MT: Agentic Pipeline for Multi-Turn Data Generation via Simulated Agent-Human Interplaycited by 158
  8. 2025Where LLM Agents Fail and How They can Learn From Failurescited by 118
  9. 2023Jina Embeddings 2: 8192-Token General-Purpose Text Embeddings for Long Documentscited by 103
  10. 2025Agent Learning via Early Experiencecited by 79
  11. 2025Tree Search for LLM Agent Reinforcement Learningcited by 73
  12. 2025MiroThinker: Pushing the Performance Boundaries of Open-Source Research Agents via Model, Context, and Interactive Scalingcited by 72
28 more
  1. 2025ACEBench: Who Wins the Match Point in Tool Usage?cited by 66
  2. 2025TreePO: Bridging the Gap of Policy Optimization and Efficacy and Inference Efficiency with Heuristic Tree-based Modelingcited by 60
  3. 2025Simulating Environments with Reasoning Models for Agent Trainingcited by 52
  4. 2025Towards General Agentic Intelligence via Environment Scalingcited by 51
  5. 2021Partially Observable Markov Decision Processes (POMDPs) and Roboticscited by 49
  6. 2026LongCat-Flash-Thinking-2601 Technical Reportcited by 32
  7. 2025MUA-RL: Multi-turn User-interacting Agent Reinforcement Learning for agentic tool usecited by 30
  8. 2025Exploiting Tree Structure for Credit Assignment in RL Training of LLMscited by 27
  9. 2025ToolMind Technical Report: A Large-Scale, Reasoning-Enhanced Tool-Use Datasetcited by 27
  10. 2024Synthesizing Post-Training Data for LLMs through Multi-Agent Simulationcited by 22
  11. 2025Procedural Environment Generation for Tool-Use Agentscited by 21
  12. 2026PACEvolve: Enabling Progress-Aware Consistent Evolutioncited by 21
  13. 2025AutoForge: Automated Environment Synthesis for Agentic Reinforcement Learningcited by 14
  14. 2026ToolPRMBench: Evaluating and Advancing Process Reward Models for Tool-using Agentscited by 13
  15. 2025Pass@k Metric for RLVR: A Diagnostic Tool of Exploration, But Not an Objectivecited by 11
  16. 2025WebOperator: Action-Aware Tree Search for Autonomous Agents in Web Environmentcited by 10
  17. 2026Robust Tool Use via Fission-GRPO: Learning to Recover from Execution Errorscited by 10
  18. 2025FunReason-MT Technical Report: Advanced Data Synthesis Solution for Real-world Multi-Turn Tool-usecited by 9
  19. 2025Exploring Expert Failures Improves LLM Agent Tuningcited by 7
  20. 2025Reinforcement Learning for Tool-Integrated Interleaved Thinking towards Cross-Domain Generalizationcited by 7
  21. 2025Interaction Dynamics as a Reward Signal for LLMscited by 5
  22. 2025PORTool: Importance-Aware Policy Optimization with Rewarded Tree for Multi-Tool-Integrated Reasoningcited by 4
  23. 2026Pushing the Boundaries of Natural Reasoning: Interleaved Bonus from Formal-Logic Verificationcited by 4
  24. 2025Rethinking LLM Training through Information Geometry and Quantum Metricscited by 3
  25. 2026SIGHT: Reinforcement Learning with Self-Evidence and Information-Gain Diverse Branching for Search Agentcited by 3
  26. 2025ToolPRM: Fine-Grained Inference Scaling of Structured Outputs for Function Callingcited by 2
  27. 2025Interaction as Intelligence Part II: Asynchronous Human-Agent Rollout for Long-Horizon Task Trainingcited by 1
  28. 2025Scaling and Transferability of Annealing Strategies in Large Language Model Trainingcited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 3.

3 papers.