mlsanityData to 14 Oct 2026

Scaling Generalist Data-Analytic Agents

arXiv 2509.25084 ↗First posted 29 Sep 2025cs.CL cs.AI cs.IRcited by 11

On the map: LLM agents and tool use → Web, search, and research agents

Abstract (arXiv)

Data-analytic agents are emerging as a key catalyst for automated scientific discovery and for the vision of Innovating AI. Current approaches, however, rely heavily on prompt engineering over proprietary models, while open-source models struggle to face diverse-format, large-scale data files and long-horizon, multi-step reasoning that real-world analytics demands. This paper introduces DataMind, a scalable data synthesis and agent training recipe designed to build generalist data-analytic agents. DataMind tackles three key challenges in building open-source data-analytic agents, including insufficient data resources, improper training strategy, and unstable code-based multi-turn rollout. Concretely, DataMind applies 1) a fine-grained task taxonomy and a recursive easy-to-hard task composition mechanism to increase the diversity and difficulty of synthesized queries; 2) a knowledge-augmented trajectory sampling strategy followed by model-based and rule-based filtering; 3) a dynamically adjustable training objective combining both SFT and RL losses; 4) a memory-frugal and stable code-based multi-turn rollout framework. Built on DataMind, we curate DataMind-12K, a high-quality trajectory set spanning diverse domains, task categories, and data file formats for data-analytic tasks. Trained on DataMind-12K, our DataMind-14B achieves state-of-the-art with an average score of 71.16% on multiple data analysis benchmarks, outperforming the strongest proprietary baselines DeepSeek-V3.1 and GPT-5. Our DataMind-7B also performs best among all open-source models with a score of 68.10%. We also incorporate some empirical insights gained from our exploratory trials into the analysis experiments, aiming to provide actionable insights about agentic training for the community. We will release DataMind-12K and DataMind-7B,14B for the community's future research.

Key facts. Cited by 11 papers in the map (data through 14 Oct 2026). Placed in Web, search, and research agents, one of 16 directions in LLM agents and tool use. Builds on 61 of its 72 references that are in the map. First posted on arXiv 29 Sep 2025.

Builds on

61 of 72 references.

Closest ancestors · 11

Same direction, newest first

  1. 2025AgenticData: An Agentic Data Analytics System for Heterogeneous Data7 Aug
  2. 2025WebSailor: Navigating Super-human Reasoning for Web Agent3 Jul
  3. 2025DatawiseAgent: A Notebook-Centric LLM Agent Framework for Adaptive and Robust Data Science Automation10 Mar
  4. 2025DataSciBench: An LLM Agent Benchmark for Data Science19 Feb
  5. 2025Agent Laboratory: Using LLM Agents as Research Assistants8 Jan
  6. 2024DSBench: How Far Are Data Science Agents from Becoming Data Science Experts?12 Sep
  7. 2024DiscoveryBench: Towards Data-Driven Discovery with Large Language Models1 Jul
  8. 2024Data Interpreter: An LLM Agent For Data Science28 Feb
  9. 2024DS-Agent: Automated Data Science by Empowering Large Language Models with Case-Based Reasoning27 Feb
  10. 2024InfiAgent-DABench: Evaluating Agents on Data Analysis Tasks10 Jan
  11. 2024AutoAct: Automatic Agent Learning from Scratch for QA via Self-Planning10 Jan

Other references · 50

  1. 2024The Llama 3 Herd of Modelscited by 14,715
  2. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  3. 2025Qwen3 Technical Reportcited by 8,820
  4. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
  5. 2023A Survey on Large Language Model based Autonomous Agentscited by 2,242
  6. 2024Qwen2 Technical Reportcited by 2,120
  7. 2024HybridFlow: A Flexible and Efficient RLHF Frameworkcited by 2,057
  8. 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Frameworkcited by 1,808
  9. 2024LlamaFactory: Unified Efficient Fine-Tuning of 100+ Language Modelscited by 1,464
  10. 2025Search-R1: Training LLMs to Reason and Leverage Search Engines with Reinforcement Learningcited by 1,444
  11. 2023The Rise and Potential of Large Language Model Based Agents: A Surveycited by 1,439
  12. 2023CAMEL: Communicative Agents for "Mind" Exploration of Large Language Model Societycited by 1,395
38 more
  1. 2024Qwen2.5-Coder Technical Reportcited by 1,203
  2. 2023GAIA: a benchmark for General AI Assistantscited by 1,128
  3. 2024The AI Scientist: Towards Fully Automated Open-Ended Scientific Discoverycited by 1,071
  4. 2025Does Reinforcement Learning Really Incentivize Reasoning Capacity in LLMs Beyond the Base Model?cited by 982
  5. 2023Can LLM Already Serve as A Database Interface? A BIg Bench for Large-Scale Database Grounded Text-to-SQLscited by 688
  6. 2025SFT Memorizes, RL Generalizes: A Comparative Study of Foundation Model Post-trainingcited by 672
  7. 2025BrowseComp: A Simple Yet Challenging Benchmark for Browsing Agentscited by 647
  8. 2025ReTool: Reinforcement Learning for Strategic Tool Use in LLMscited by 392
  9. 2025Towards Reasoning Era: A Survey of Long Chain-of-Thought for Reasoning Large Language Modelscited by 384
  10. 2025Cognitive Behaviors that Enable Self-Improving Reasoners, or, Four Habits of Highly Effective STaRscited by 377
  11. 2023AgentTuning: Enabling Generalized Agent Abilities for LLMscited by 338
  12. 2025R1-Searcher: Incentivizing the Search Capability in LLMs via Reinforcement Learningcited by 336
  13. 2025WebThinker: Empowering Large Reasoning Models with Deep Research Capabilitycited by 335
  14. 2025PaperBench: Evaluating AI's Ability to Replicate AI Researchcited by 321
  15. 2025OpenThoughts: Data Recipes for Reasoning Modelscited by 304
  16. 2023FireAct: Toward Language Agent Fine-tuningcited by 256
  17. 2022Reasoning with Language Model Prompting: A Surveycited by 252
  18. 2024Spider 2.0: Evaluating Language Models on Real-World Enterprise Text-to-SQL Workflowscited by 232
  19. 2025SimpleTIR: End-to-End Reinforcement Learning for Multi-Turn Tool-Integrated Reasoningcited by 146
  20. 2024TableBench: A Comprehensive and Complex Benchmark for Table Question Answeringcited by 128
  21. 2023Agents: An Open-source Framework for Autonomous Language Agentscited by 116
  22. 2025OctoThinker: Mid-training Incentivizes Reinforcement Learning Scalingcited by 113
  23. 2024Agent-FLAN: Designing Data and Methods of Effective Agent Tuning for Large Language Modelscited by 100
  24. 2025OmniSQL: Synthesizing High-quality Text-to-SQL Data at Scalecited by 91
  25. 2025On-Policy RL Meets Off-Policy Experts: Harmonizing Supervised Fine-Tuning and Reinforcement Learning via Dynamic Weightingcited by 91
  26. 2025Kevin: Multi-Turn RL for Generating CUDA Kernelscited by 78
  27. 2025AceReason-Nemotron 1.1: Advancing Math and Code Reasoning through SFT and RL Synergycited by 77
  28. 2023Data-Copilot: Bridging Billions of Data and Humans with Autonomous Workflowcited by 76
  29. 2025SPA-RL: Reinforcing LLM Agents via Stepwise Progress Attributioncited by 73
  30. 2024TableGPT2: A Large Multimodal Model with Tabular Data Integrationcited by 72
  31. 2024AutoKaggle: A Multi-Agent Framework for Autonomous Data Science Competitionscited by 70
  32. 2025SQL-R1: Training Natural Language to SQL Reasoning Model By Reinforcement Learningcited by 68
  33. 2024Are LLMs Capable of Data-based Statistical and Causal Reasoning? Benchmarking Advanced Quantitative Reasoning with Datacited by 63
  34. 2025Agent RL Scaling Law: Agent RL with Spontaneous Code Execution for Mathematical Problem Solvingcited by 62
  35. 2025AI4Research: A Survey of Artificial Intelligence for Scientific Researchcited by 60
  36. 2025SciMaster: Towards General-Purpose Scientific AI Agents, Part I. X-Master as Foundation: Can We Lead on Humanity's Last Exam?cited by 47
  37. 2025Table-R1: Region-based Reinforcement Learning for Table Understandingcited by 37
  38. 2025RL Is Neither a Panacea Nor a Mirage: Understanding Supervised vs. Reinforcement Learning Fine-Tuning for LLMscited by 17

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 11.

11 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025AutoMind: Adaptive Knowledgeable Agent for Automated Data Science
  2. 2025FDABench: A Benchmark for Data Agents on Analytical Queries over Heterogeneous Data
  3. 2026Can Generalist Agents Automate Data Curation?
  4. 2026Demonstrating TOFFEE: A Learned System for Synthesizing Data Agent Trajectories at Scale
  5. 2025DeepAnalyze: Agentic Large Language Models for Autonomous Data Science
  6. 2025AgentAda: Skill-Adaptive Data Analytics for Tailored Insight Discovery
  7. 2025DatasetResearch: Benchmarking Agent Systems for Demand-Driven Dataset Discovery
  8. 2026AgenticDataBench: A Comprehensive Benchmark for Data Agents