Scaling Generalist Data-Analytic Agents
On the map: LLM agents and tool use → Web, search, and research agents
Abstract (arXiv)
Data-analytic agents are emerging as a key catalyst for automated scientific discovery and for the vision of Innovating AI. Current approaches, however, rely heavily on prompt engineering over proprietary models, while open-source models struggle to face diverse-format, large-scale data files and long-horizon, multi-step reasoning that real-world analytics demands. This paper introduces DataMind, a scalable data synthesis and agent training recipe designed to build generalist data-analytic agents. DataMind tackles three key challenges in building open-source data-analytic agents, including insufficient data resources, improper training strategy, and unstable code-based multi-turn rollout. Concretely, DataMind applies 1) a fine-grained task taxonomy and a recursive easy-to-hard task composition mechanism to increase the diversity and difficulty of synthesized queries; 2) a knowledge-augmented trajectory sampling strategy followed by model-based and rule-based filtering; 3) a dynamically adjustable training objective combining both SFT and RL losses; 4) a memory-frugal and stable code-based multi-turn rollout framework. Built on DataMind, we curate DataMind-12K, a high-quality trajectory set spanning diverse domains, task categories, and data file formats for data-analytic tasks. Trained on DataMind-12K, our DataMind-14B achieves state-of-the-art with an average score of 71.16% on multiple data analysis benchmarks, outperforming the strongest proprietary baselines DeepSeek-V3.1 and GPT-5. Our DataMind-7B also performs best among all open-source models with a score of 68.10%. We also incorporate some empirical insights gained from our exploratory trials into the analysis experiments, aiming to provide actionable insights about agentic training for the community. We will release DataMind-12K and DataMind-7B,14B for the community's future research.
Key facts. Cited by 11 papers in the map (data through 14 Oct 2026). Placed in Web, search, and research agents, one of 16 directions in LLM agents and tool use. Builds on 61 of its 72 references that are in the map. First posted on arXiv 29 Sep 2025.
Builds on
61 of 72 references.
Closest ancestors · 11
Same direction, newest first
- 2025AgenticData: An Agentic Data Analytics System for Heterogeneous Data7 Aug
- 2025WebSailor: Navigating Super-human Reasoning for Web Agent3 Jul
- 2025DatawiseAgent: A Notebook-Centric LLM Agent Framework for Adaptive and Robust Data Science Automation10 Mar
- 2025DataSciBench: An LLM Agent Benchmark for Data Science19 Feb
- 2025Agent Laboratory: Using LLM Agents as Research Assistants8 Jan
- 2024DSBench: How Far Are Data Science Agents from Becoming Data Science Experts?12 Sep
- 2024DiscoveryBench: Towards Data-Driven Discovery with Large Language Models1 Jul
- 2024Data Interpreter: An LLM Agent For Data Science28 Feb
- 2024DS-Agent: Automated Data Science by Empowering Large Language Models with Case-Based Reasoning27 Feb
- 2024InfiAgent-DABench: Evaluating Agents on Data Analysis Tasks10 Jan
- 2024AutoAct: Automatic Agent Learning from Scratch for QA via Self-Planning10 Jan
Other references · 50
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2025Qwen3 Technical Reportcited by 8,820
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
- 2023A Survey on Large Language Model based Autonomous Agentscited by 2,242
- 2024Qwen2 Technical Reportcited by 2,120
- 2024HybridFlow: A Flexible and Efficient RLHF Frameworkcited by 2,057
- 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Frameworkcited by 1,808
- 2024LlamaFactory: Unified Efficient Fine-Tuning of 100+ Language Modelscited by 1,464
- 2025Search-R1: Training LLMs to Reason and Leverage Search Engines with Reinforcement Learningcited by 1,444
- 2023The Rise and Potential of Large Language Model Based Agents: A Surveycited by 1,439
- 2023CAMEL: Communicative Agents for "Mind" Exploration of Large Language Model Societycited by 1,395
38 more
- 2024Qwen2.5-Coder Technical Reportcited by 1,203
- 2023GAIA: a benchmark for General AI Assistantscited by 1,128
- 2024The AI Scientist: Towards Fully Automated Open-Ended Scientific Discoverycited by 1,071
- 2025Does Reinforcement Learning Really Incentivize Reasoning Capacity in LLMs Beyond the Base Model?cited by 982
- 2023Can LLM Already Serve as A Database Interface? A BIg Bench for Large-Scale Database Grounded Text-to-SQLscited by 688
- 2025SFT Memorizes, RL Generalizes: A Comparative Study of Foundation Model Post-trainingcited by 672
- 2025BrowseComp: A Simple Yet Challenging Benchmark for Browsing Agentscited by 647
- 2025ReTool: Reinforcement Learning for Strategic Tool Use in LLMscited by 392
- 2025Towards Reasoning Era: A Survey of Long Chain-of-Thought for Reasoning Large Language Modelscited by 384
- 2025Cognitive Behaviors that Enable Self-Improving Reasoners, or, Four Habits of Highly Effective STaRscited by 377
- 2023AgentTuning: Enabling Generalized Agent Abilities for LLMscited by 338
- 2025R1-Searcher: Incentivizing the Search Capability in LLMs via Reinforcement Learningcited by 336
- 2025WebThinker: Empowering Large Reasoning Models with Deep Research Capabilitycited by 335
- 2025PaperBench: Evaluating AI's Ability to Replicate AI Researchcited by 321
- 2025OpenThoughts: Data Recipes for Reasoning Modelscited by 304
- 2023FireAct: Toward Language Agent Fine-tuningcited by 256
- 2022Reasoning with Language Model Prompting: A Surveycited by 252
- 2024Spider 2.0: Evaluating Language Models on Real-World Enterprise Text-to-SQL Workflowscited by 232
- 2025SimpleTIR: End-to-End Reinforcement Learning for Multi-Turn Tool-Integrated Reasoningcited by 146
- 2024TableBench: A Comprehensive and Complex Benchmark for Table Question Answeringcited by 128
- 2023Agents: An Open-source Framework for Autonomous Language Agentscited by 116
- 2025OctoThinker: Mid-training Incentivizes Reinforcement Learning Scalingcited by 113
- 2024Agent-FLAN: Designing Data and Methods of Effective Agent Tuning for Large Language Modelscited by 100
- 2025OmniSQL: Synthesizing High-quality Text-to-SQL Data at Scalecited by 91
- 2025On-Policy RL Meets Off-Policy Experts: Harmonizing Supervised Fine-Tuning and Reinforcement Learning via Dynamic Weightingcited by 91
- 2025Kevin: Multi-Turn RL for Generating CUDA Kernelscited by 78
- 2025AceReason-Nemotron 1.1: Advancing Math and Code Reasoning through SFT and RL Synergycited by 77
- 2023Data-Copilot: Bridging Billions of Data and Humans with Autonomous Workflowcited by 76
- 2025SPA-RL: Reinforcing LLM Agents via Stepwise Progress Attributioncited by 73
- 2024TableGPT2: A Large Multimodal Model with Tabular Data Integrationcited by 72
- 2024AutoKaggle: A Multi-Agent Framework for Autonomous Data Science Competitionscited by 70
- 2025SQL-R1: Training Natural Language to SQL Reasoning Model By Reinforcement Learningcited by 68
- 2024Are LLMs Capable of Data-based Statistical and Causal Reasoning? Benchmarking Advanced Quantitative Reasoning with Datacited by 63
- 2025Agent RL Scaling Law: Agent RL with Spontaneous Code Execution for Mathematical Problem Solvingcited by 62
- 2025AI4Research: A Survey of Artificial Intelligence for Scientific Researchcited by 60
- 2025SciMaster: Towards General-Purpose Scientific AI Agents, Part I. X-Master as Foundation: Can We Lead on Humanity's Last Exam?cited by 47
- 2025Table-R1: Region-based Reinforcement Learning for Table Understandingcited by 37
- 2025RL Is Neither a Panacea Nor a Mirage: Understanding Supervised vs. Reinforcement Learning Fine-Tuning for LLMscited by 17
Built on by
Citing papers per year: 2026: 11.
11 papers.
- 2026SkillX: Automatically Constructing Skill Knowledge Bases for Agentscited by 76
- 2026Terminal-World: Scaling Terminal-Agent Environments via Agent Skillscited by 20
- 2026DSGym: A Holistic Framework for Evaluating and Training Data Science Agentscited by 15
- 2026InnoEval: On Research Idea Evaluation as a Knowledge-Grounded, Multi-Perspective Reasoning Problemcited by 8
- 2026Hunt Instead of Wait: Evaluating Deep Data Research on Large Language Modelscited by 5
- 2026Rewarding the Scientific Process: Process-Level Reward Modeling for Agentic Data Analysiscited by 5
- 2026Unsupervised Skill Discovery for Agentic Data Analysiscited by 2
- 2026EnvCraft: Synthesizing Executable Environments in Agentic RL for Claw-like Agentcited by 1
- 2026VeriGraph: Towards Verifiable Data-Analytic Agentscited by 0
- 2026Fail Loudly: An Auditable Runtime for Agentic Data Analysiscited by 0
- 2026USA: Update-aware SAM for Cross-domain On-Policy Disitllation of Language Agentscited by 0
- 2026USA: Update-aware SAM for Cross-domain On-Policy Disitllation of Language Agents28 Sep 2026
- 2026Fail Loudly: An Auditable Runtime for Agentic Data Analysis26 Sep 2026
- 2026EnvCraft: Synthesizing Executable Environments in Agentic RL for Claw-like Agent4 Sep 2026
- 2026VeriGraph: Towards Verifiable Data-Analytic Agents15 Jun 2026
- 2026Unsupervised Skill Discovery for Agentic Data Analysis4 Jun 2026
- 2026Terminal-World: Scaling Terminal-Agent Environments via Agent Skills20 May 2026
- 2026Rewarding the Scientific Process: Process-Level Reward Modeling for Agentic Data Analysis27 Apr 2026
- 2026SkillX: Automatically Constructing Skill Knowledge Bases for Agents6 Apr 2026
- 2026InnoEval: On Research Idea Evaluation as a Knowledge-Grounded, Multi-Perspective Reasoning Problem16 Feb 2026
- 2026Hunt Instead of Wait: Evaluating Deep Data Research on Large Language Models2 Feb 2026
- 2026DSGym: A Holistic Framework for Evaluating and Training Data Science Agents22 Jan 2026
Similar, not cited
Close in wording, no citation either way
- 2025AutoMind: Adaptive Knowledgeable Agent for Automated Data Science
- 2025FDABench: A Benchmark for Data Agents on Analytical Queries over Heterogeneous Data
- 2026Can Generalist Agents Automate Data Curation?
- 2026Demonstrating TOFFEE: A Learned System for Synthesizing Data Agent Trajectories at Scale
- 2025DeepAnalyze: Agentic Large Language Models for Autonomous Data Science
- 2025AgentAda: Skill-Adaptive Data Analytics for Tailored Insight Discovery
- 2025DatasetResearch: Benchmarking Agent Systems for Demand-Driven Dataset Discovery
- 2026AgenticDataBench: A Comprehensive Benchmark for Data Agents