OpenThoughts-Agent: Data Recipes for Agentic Models
On the map: LLM reasoning → Reasoning for agents, planning and code
also in 1 more
Abstract (arXiv)
Agentic language models dramatically expand the applications of AI yet little is publicly known about how to curate training data for broadly capable agents. Existing open efforts such as SWE-Smith, SERA, and Nemotron-Terminal typically target a single benchmark, leaving open the question of how to train models that generalize across diverse agentic tasks. The OpenThoughts-Agent (OT-Agent) project addresses this gap with a fully open data curation pipeline for training agentic models. We conduct more than 100 controlled ablation experiments to systematically investigate each stage of the pipeline, yielding insights on the importance of task sources and diversity. We then assemble a training set of 100K examples from our pipeline and fine-tune Qwen3-32B on this dataset, which yields an average accuracy of 44.8% across seven agentic benchmarks and a 3.9 percentage point improvement over the strongest existing open data agentic model (Nemotron-Terminal-32B, 40.9%). Moreover, our training data exhibits strong scaling properties, outperforming alternative open datasets at every training set size in compute-controlled comparisons. We publicly release our training sets, data pipeline, experimental data, and models at openthoughts.ai to support future open research on agentic model training.
Key facts. Cited by 11 papers in the map (data through 14 Oct 2026). Placed in Reasoning for agents, planning and code, one of 17 directions in LLM reasoning. Builds on 0 of its 50 references that are in the map. First posted on arXiv 23 Jun 2026.
Builds on
0 of 50 references.
No references here yet.
Built on by
Citing papers per year: 2026: 11.
11 papers.
- 2026NexForge: Scaling Agent Capabilities through Requirement-Driven Task Synthesis for LLMscited by 7
- 2026MindForge: Teaching Small Language Models Whole-Life-Cycle Software Engineering via Source-Free Program Synthesiscited by 2
- 2026Learning Generalizable Behaviors for Terminal Agentscited by 2
- 2026Mid-Harness: Scaling Actions Between Model and Harness for Terminal Agentscited by 1
- 2026Self-Supervised Scaling of Terminal Environments for Scientific Domainscited by 1
- 2026Mint-Agent: Introducing Finance-Native Agentic Foundation Modelscited by 0
- 2026Rethinking Heterogeneous System Disaggregation for Subquadratic Attentioncited by 0
- 2026SkillGym: Internalizing Human Skills into LLMs for Real-World Problem Solvingcited by 0
- 2026DataSense-Bench: The First Step Toward an AI Scientistcited by 0
- 2026Scaling Agentic Data for Long-Horizon Terminal Intelligencecited by 0
- 2026ReTerm: Recovery Training for Self-Improving Terminal Agentscited by 0
- 2026ReTerm: Recovery Training for Self-Improving Terminal Agents13 Oct 2026
- 2026Scaling Agentic Data for Long-Horizon Terminal Intelligence9 Oct 2026
- 2026DataSense-Bench: The First Step Toward an AI Scientist8 Oct 2026
- 2026Self-Supervised Scaling of Terminal Environments for Scientific Domains2 Oct 2026
- 2026Mid-Harness: Scaling Actions Between Model and Harness for Terminal Agents30 Sep 2026
- 2026SkillGym: Internalizing Human Skills into LLMs for Real-World Problem Solving23 Sep 2026
- 2026Rethinking Heterogeneous System Disaggregation for Subquadratic Attention11 Sep 2026
- 2026Learning Generalizable Behaviors for Terminal Agents23 Aug 2026
- 2026Mint-Agent: Introducing Finance-Native Agentic Foundation Models17 Aug 2026
- 2026MindForge: Teaching Small Language Models Whole-Life-Cycle Software Engineering via Source-Free Program Synthesis29 Jul 2026
- 2026NexForge: Scaling Agent Capabilities through Requirement-Driven Task Synthesis for LLMs15 Jul 2026
Similar, not cited
Close in wording, no citation either way
- 2026SPT: Skills as Pre-Training Data for Agentic Language Models
- 2024AgentOhana: Design Unified Data and Training Pipeline for Effective Agent Learning
- 2025Agent Data Protocol: Unifying Datasets for Diverse, Effective Fine-tuning of LLM Agents
- 2026ResearchGym: Evaluating Language Model Agents on Real-World AI Research
- 2026AgentGym2: Benchmarking Large Language Model Agents in De-Idealized Real-World Environments
- 2025Agent-R: Training Language Model Agents to Reflect via Iterative Self-Training
- 2026O-Researcher: An Open Ended Deep Research Model via Multi-Agent Distillation and Agentic RL
- 2026Vision: Data-Centric Anchoring for Robust and Interpretable Agentic AI