mlsanityData to 7 Oct 2026

InfiAgent-DABench: Evaluating Agents on Data Analysis Tasks

arXiv 2401.05507 ↗First posted 10 Jan 2024cs.CL cs.AIcited by 134

On the map: LLM agents and tool use → Web, search, and research agents

Abstract (arXiv)

In this paper, we introduce InfiAgent-DABench, the first benchmark specifically designed to evaluate LLM-based agents on data analysis tasks. These tasks require agents to end-to-end solving complex tasks by interacting with an execution environment. This benchmark contains DAEval, a dataset consisting of 257 data analysis questions derived from 52 CSV files, and an agent framework which incorporates LLMs to serve as data analysis agents for both serving and evaluation. Since data analysis questions are often open-ended and hard to evaluate without human supervision, we adopt a format-prompting technique to convert each question into a closed-form format so that they can be automatically evaluated. Our extensive benchmarking of 34 LLMs uncovers the current challenges encountered in data analysis tasks. In addition, building on top of our agent framework, we develop a specialized agent, DAAgent, which surpasses GPT-3.5 by 3.9% on DABench. Evaluation datasets and toolkits for InfiAgent-DABench are released at https://github.com/InfiAgent/InfiAgent .

Key facts. Cited by 134 papers in the map (data through 7 Oct 2026). Placed in Web, search, and research agents, one of 16 directions in LLM agents and tool use. Builds on 39 of its 85 references that are in the map. First posted on arXiv 10 Jan 2024.

Builds on

39 of 85 references.

Closest ancestors · 2

Same direction, newest first

  1. 2023TaskWeaver: A Code-First Agent Framework29 Nov
  2. 2022WebShop: Towards Scalable Real-World Web Interaction with Grounded Language Agents4 Jul

Other references · 37

  1. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  2. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
  3. 2021Evaluating Large Language Models Trained on Codecited by 8,053
  4. 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,767
  5. 2022Large Language Models are Zero-Shot Reasonerscited by 4,323
  6. 2021Program Synthesis with Large Language Modelscited by 3,509
  7. 2023Qwen Technical Reportcited by 3,273
  8. 2016Making the V in VQA Matter: Elevating the Role of Image Understanding in Visual Question Answeringcited by 2,498
  9. 2023A Survey on Large Language Model based Autonomous Agentscited by 2,203
  10. 2023ToolLLM: Facilitating Large Language Models to Master 16000+ Real-world APIscited by 1,880
  11. 2022Competition-Level Code Generation with AlphaCodecited by 1,427
  12. 2023The Rise and Potential of Large Language Model Based Agents: A Surveycited by 1,422
25 more
  1. 2023Gorilla: Large Language Model Connected with Massive APIscited by 1,302
  2. 2020DocVQA: A Dataset for VQA on Document Imagescited by 1,288
  3. 2023Large Language Models are not Fair Evaluatorscited by 1,050
  4. 2023Teaching Large Language Models to Self-Debugcited by 963
  5. 2021Measuring Coding Challenge Competence With APPScited by 879
  6. 2022GLM-130B: An Open Bilingual Pre-trained Modelcited by 837
  7. 2021CodeXGLUE: A Machine Learning Benchmark Dataset for Code Understanding and Generationcited by 732
  8. 2023WizardCoder: Empowering Code Large Language Models with Evol-Instructcited by 728
  9. 2023ChatEval: Towards Better LLM-based Evaluators through Multi-Agent Debatecited by 724
  10. 2022DS-1000: A Natural and Reliable Benchmark for Data Science Code Generationcited by 442
  11. 2023Is ChatGPT a Good NLG Evaluator? A Preliminary Studycited by 420
  12. 2023GPTScore: Evaluate as You Desirecited by 357
  13. 2022Dynamic Prompt Learning via Policy Gradient for Semi-structured Mathematical Reasoningcited by 347
  14. 2023AgentTuning: Enabling Generalized Agent Abilities for LLMscited by 319
  15. 2023InterCode: Standardizing and Benchmarking Interactive Coding with Execution Feedbackcited by 229
  16. 2023AdaPlanner: Adaptive Planning from Feedback with Language Modelscited by 193
  17. 2023ReWOO: Decoupling Reasoning from Observations for Efficient Augmented Language Modelscited by 174
  18. 2023OpenAgents: An Open Platform for Language Agents in the Wildcited by 136
  19. 2022Large Language Models Meet NL2Code: A Surveycited by 135
  20. 2024If LLM Is the Wizard, Then Code Is the Wand: A Survey on How Code Empowers Large Language Models to Serve as Intelligent Agentscited by 77
  21. 2023Unifying the Perspectives of NLP and Software Engineering: A Survey on Language Models for Codecited by 62
  22. 2023Precedent-Enhanced Legal Judgment Prediction with LLM and Domain-Model Collaborationcited by 52
  23. 2023"What It Wants Me To Say": Bridging the Abstraction Gap Between End-User Programmers and Code-Generating Large Language Modelscited by 48
  24. 2023LLM-based Medical Assistant Personalization with Short- and Long-Term Memory Coordinationcited by 46
  25. 2023An In-depth Survey of Large Language Model-based Artificial Intelligence Agentscited by 30

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 24; 2025: 64; 2026: 46.

134 papers.

Sort:

By area:

  1. 2025Agent Laboratory: Using LLM Agents as Research Assistantscited by 405
  2. 2024Can LLMs Generate Novel Research Ideas? A Large-Scale Human Study with 100+ NLP Researcherscited by 348
  3. 2025InfiGUI-R1: Advancing Multimodal GUI Agents from Reactive Actors to Deliberative Reasonerscited by 140
  4. 2025Multi-Agent Design: Optimizing Agents with Better Prompts and Topologiescited by 106
  5. 2024SpreadsheetBench: Towards Challenging Real World Spreadsheet Manipulationcited by 100
  6. 2024AutoGLM: Autonomous Foundation Agents for GUIscited by 96
  7. 2025From Automation to Autonomy: A Survey on Large Language Models in Scientific Discoverycited by 86
  8. 2024AutoML-Agent: A Multi-Agent LLM Framework for Full-Pipeline AutoMLcited by 84
  9. 2024TableLLM: Enabling Tabular Data Manipulation by LLMs in Real Office Usage Scenarioscited by 76
  10. 2024BLADE: Benchmarking Language Model Agents for Data-Driven Sciencecited by 72
  11. 2025InfiGUIAgent: A Multimodal Generalist GUI Agent with Native Reasoning and Reflectioncited by 67
  12. 2025AgentRxiv: Towards Collaborative Autonomous Researchcited by 64
38 more
  1. 2024Are LLMs Capable of Data-based Statistical and Causal Reasoning? Benchmarking Advanced Quantitative Reasoning with Datacited by 61
  2. 2024DA-Code: Agent Data Science Code Generation Benchmark for Large Language Modelscited by 57
  3. 2024Spider2-V: How Far Are Multimodal Agents From Automating Data Science and Engineering Workflows?cited by 55
  4. 2025DataSciBench: An LLM Agent Benchmark for Data Sciencecited by 53
  5. 2024Large Language Model for Table Processing: A Surveycited by 52
  6. 2025MLE-STAR: Machine Learning Engineering Agent via Search and Targeted Refinementcited by 52
  7. 2025DABstep: Data Agent Benchmark for Multi-step Reasoningcited by 44
  8. 2024Adaptive In-conversation Team Building for Language Model Agentscited by 38
  9. 2025EXP-Bench: Can AI Conduct AI Research Experiments?cited by 36
  10. 2025OS Agents: A Survey on MLLM-based Agents for General Computing Devices Usecited by 35
  11. 2024Text2SQL is Not Enough: Unifying AI and Databases with TAGcited by 34
  12. 2025HypoBench: Towards Systematic and Principled Benchmarking for Hypothesis Generationcited by 34
  13. 2024InsightBench: Evaluating Business Analytics Agents Through Multi-Step Insight Generationcited by 30
  14. 2024Are Large Language Models Good Statisticians?cited by 26
  15. 2025SciSciGPT: Advancing Human-AI Collaboration in the Science of Sciencecited by 26
  16. 2024Kolb-Based Experiential Learning for Generalist Agents with Human-Level Kaggle Data Science Performancecited by 22
  17. 2024A Survey on Large Language Model-based Agents for Statistics and Data Sciencecited by 22
  18. 2025Heterogeneous Swarms: Jointly Optimizing Model Roles and Weights for Multi-LLM Systemscited by 22
  19. 2025TableRAG: A Retrieval Augmented Generation Framework for Heterogeneous Document Reasoningcited by 22
  20. 2025Large Language Model-based Data Science Agent: A Surveycited by 22
  21. 2025AgenticData: An Agentic Data Analytics System for Heterogeneous Datacited by 22
  22. 2025DAComp: Benchmarking Data Agents across the Full Data Intelligence Lifecyclecited by 22
  23. 2025Evaluating the Robustness of Multimodal Agents Against Active Environmental Injection Attackscited by 21
  24. 2025Self-Evolving Multi-Agent Systems via Textual Backpropagationcited by 21
  25. 2025Exploring LLM Agents for Cleaning Tabular Machine Learning Datasetscited by 20
  26. 2025Exploring Autonomous Agents: A Closer Look at Why They Fail When Completing Taskscited by 20
  27. 2024Literature Meets Data: A Synergistic Approach to Hypothesis Generationcited by 19
  28. 2024Tapilot-Crossing: Benchmarking and Evolving LLMs Towards Interactive Data Analysis Agentscited by 17
  29. 2025ELT-Bench: An End-to-End Benchmark for Evaluating AI Agents on ELT Pipelinescited by 15
  30. 2025ExCyTIn-Bench: Evaluating LLM agents on Cyber Threat Investigationcited by 15
  31. 2026Terminal-World: Scaling Terminal-Agent Environments via Agent Skillscited by 13
  32. 2024MiMoTable: A Multi-scale Spreadsheet Benchmark with Meta Operations for Table Reasoningcited by 12
  33. 2025RealHiTBench: A Comprehensive Realistic Hierarchical Table Benchmark for Evaluating LLM-Based Table Analysiscited by 12
  34. 2025Scaling Generalist Data-Analytic Agentscited by 11
  35. 2025Prompt Stability Matters: Evaluating and Optimizing Auto-Generated Prompt in General-Purpose Systemscited by 10
  36. 2025EIFBENCH: Extremely Complex Instruction Following Benchmark for Large Language Modelscited by 9
  37. 2025Data Agent: A Holistic Architecture for Orchestrating Data+AI Ecosystemscited by 9
  38. 2025A Survey of AI Scientistscited by 9

50 most cited of 134 All 134 (JSON)

Similar, not cited

Close in wording, no citation either way

  1. 2025FDABench: A Benchmark for Data Agents on Analytical Queries over Heterogeneous Data
  2. 2025IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis
  3. 2026AgenticDataBench: A Comprehensive Benchmark for Data Agents
  4. 2024Benchmarking Data Science Agents
  5. 2024Data Interpreter: An LLM Agent For Data Science
  6. 2024DSBench: How Far Are Data Science Agents from Becoming Data Science Experts?
  7. 2026DA-Studio: An Agentic System for End-to-End Data Analysis
  8. 2025LLM/Agent-as-Data-Analyst: A Survey