DataSTORM: Deep Research on Large-Scale Databases using Exploratory Data Analysis and Data Storytelling
Not on the map. Why?
Abstract (arXiv)
Deep research with Large Language Model (LLM) agents is emerging as a powerful paradigm for multi-step information discovery, synthesis, and analysis. However, existing approaches primarily focus on unstructured web data, while the challenges of conducting deep research over large-scale structured databases remain relatively underexplored. Unlike web-based research, effective data-centric research requires more than retrieval and summarization and demands iterative hypothesis generation, quantitative reasoning over structured schemas, and convergence toward a coherent analytical narrative. In this paper, we present DataSTORM, an LLM-based agentic system capable of autonomously conducting research across both large-scale structured databases and internet sources. Grounded in principles from Exploratory Data Analysis and Data Storytelling, DataSTORM reframes deep research over structured data as a thesis-driven analytical process: discovering candidate theses from data, validating them through iterative cross-source investigation, and developing them into coherent analytical narratives. We evaluate DataSTORM on InsightBench, where it achieves a new state-of-the-art result with a 19.4% relative improvement in insight-level recall and 7.2% in summary-level score. We further introduce a new dataset built on ACLED, a real-world complex database, and demonstrate that DataSTORM outperforms proprietary systems such as ChatGPT Deep Research across both automated metrics and human evaluations.
Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Builds on 31 of its 119 references that are in the map. First posted on arXiv 7 Apr 2026.
Builds on
31 of 119 references.
References · 31
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
- 2023Enabling Large Language Models to Generate Text with Citationscited by 595
- 2023DIN-SQL: Decomposed In-Context Learning of Text-to-SQL with Self-Correctioncited by 477
- 2025WebThinker: Empowering Large Reasoning Models with Deep Research Capabilitycited by 335
- 2025DeepResearch Bench: A Comprehensive Benchmark for Deep Research Agentscited by 248
- 2024Assisting in Writing Wikipedia-like Articles From Scratch with Large Language Modelscited by 154
- 2024InfiAgent-DABench: Evaluating Agents on Data Analysis Taskscited by 140
- 2024DS-Agent: Automated Data Science by Empowering Large Language Models with Case-Based Reasoningcited by 125
- 2025DR Tulu: Reinforcement Learning with Evolving Rubrics for Deep Researchcited by 114
- 2024DiscoveryBench: Towards Data-Driven Discovery with Large Language Modelscited by 109
- 2024BLADE: Benchmarking Language Model Agents for Data-Driven Sciencecited by 77
- 2024Are LLMs Capable of Data-based Statistical and Causal Reasoning? Benchmarking Advanced Quantitative Reasoning with Datacited by 63
19 more
- 2025DataSciBench: An LLM Agent Benchmark for Data Sciencecited by 57
- 2025DeepAnalyze: Agentic Large Language Models for Autonomous Data Sciencecited by 50
- 2024Into the Unknown Unknowns: Engaged Human Learning through Participation in Language Model Agent Conversationscited by 43
- 2025ReFoRCE: A Text-to-SQL Agent with Self-Refinement, Consensus Enforcement, and Column Explorationcited by 37
- 2025DeepScholar-Bench: A Live Benchmark and Automated Evaluation for Generative Research Synthesiscited by 34
- 2024InsightBench: Evaluating Business Analytics Agents Through Multi-Step Insight Generationcited by 32
- 2025Deep Research Bench: Evaluating AI Web Research Agentscited by 32
- 2024Benchmarking Data Science Agentscited by 30
- 2024SPINACH: SPARQL-Based Information Navigation for Challenging Real-World Questionscited by 27
- 2024Can Large Language Models Serve as Data Analysts? A Multi-Agent Assisted Approach for Qualitative Data Analysiscited by 20
- 2025RAPID: Efficient Retrieval-Augmented Long Text Generation with Writing Planning and Information Discoverycited by 19
- 2025OmniThink: Expanding Knowledge Boundaries in Machine Writing through Thinkingcited by 18
- 2025FDABench: A Benchmark for Data Agents on Analytical Queries over Heterogeneous Datacited by 13
- 2025An LLM-Based Approach for Insight Generation in Data Analysiscited by 12
- 2026SQL-Trail: Multi-Turn Reinforcement Learning with Interleaved Feedback for Text-to-SQLcited by 7
- 2026Hunt Instead of Wait: Evaluating Deep Data Research on Large Language Modelscited by 5
- 2026The Case of the Mysterious Citationscited by 5
- 2025InsightEval: An Expert-Curated Benchmark for Assessing Insight Discovery in LLM-Driven Data Agentscited by 3
- 2025TablePilot: Recommending Human-Preferred Tabular Data Analysis with Large Language Modelscited by 2
Built on by
Citing papers per year: 2026: 7.
7 papers.
- 2026FinResearchBench II: A Deep Research Benchmark with Consensus-Derived Gold Rubrics for Distinguishing Financial Report Qualitycited by 5
- 2026Unsupervised Skill Discovery for Agentic Data Analysiscited by 2
- 2026Discovery Agents for Real-Time Analytics: Toward Proactive Insight Systemscited by 0
- 2026Data Journalist Agent: Transforming Data into Verifiable Multimodal Storiescited by 0
- 2026Benchmarking Hybrid Deep Research Across Database Querying and Web Searchcited by 0
- 2026Fail Loudly: An Auditable Runtime for Agentic Data Analysiscited by 0
- 2026Towards Reliable AI Data Scientists: Data Agents with Workflow Harnessescited by 0
- 2026Towards Reliable AI Data Scientists: Data Agents with Workflow Harnesses28 Sep 2026
- 2026Fail Loudly: An Auditable Runtime for Agentic Data Analysis26 Sep 2026
- 2026Benchmarking Hybrid Deep Research Across Database Querying and Web Search8 Sep 2026
- 2026FinResearchBench II: A Deep Research Benchmark with Consensus-Derived Gold Rubrics for Distinguishing Financial Report Quality14 Jul 2026
- 2026Data Journalist Agent: Transforming Data into Verifiable Multimodal Stories9 Jun 2026
- 2026Unsupervised Skill Discovery for Agentic Data Analysis4 Jun 2026
- 2026Discovery Agents for Real-Time Analytics: Toward Proactive Insight Systems26 May 2026
Similar, not cited
Close in wording, no citation either way
- 2024DataNarrative: Automated Data-Driven Storytelling with Visualizations and Texts
- 2025LLM-Based Data Science Agents: A Survey of Capabilities, Challenges, and Future Directions
- 2025Deep Research: A Survey of Autonomous Research Agents
- 2025Large Language Model-based Data Science Agent: A Survey
- 2026DeepXiv-SDK: An Agentic Data Interface for Scientific Literature
- 2024A Survey on Large Language Model-based Agents for Statistics and Data Science
- 2026Towards Knowledgeable Deep Research: Framework and Benchmark
- 2026AgenticDataBench: A Comprehensive Benchmark for Data Agents