mlsanityData to 14 Oct 2026

Flowco: Rethinking Data Analysis in the Age of LLMs

arXiv 2504.14038 ↗First posted 18 Apr 2025cs.HC cs.AI cs.PLcited by 1

On the map: LLM reasoning → Reasoning benchmarks and evaluation

Abstract (arXiv)

Conducting data analysis typically involves authoring code to transform, visualize, analyze, and interpret data. Large language models (LLMs) are now capable of generating such code for simple, routine analyses. LLMs promise to democratize data science by enabling those with limited programming expertise to conduct data analyses, including in scientific research, business, and policymaking. However, analysts in many real-world settings must often exercise fine-grained control over specific analysis steps, verify intermediate results explicitly, and iteratively refine their analytical approaches. Such tasks present barriers to building robust and reproducible analyses using LLMs alone or even in conjunction with existing authoring tools (e.g., computational notebooks). This paper introduces Flowco, a new mixed-initiative system to address these challenges. Flowco leverages a visual dataflow programming model and integrates LLMs into every phase of the authoring process. A user study suggests that Flowco supports analysts, particularly those with less programming experience, in quickly authoring, debugging, and refining data analyses.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Reasoning benchmarks and evaluation, one of 17 directions in LLM reasoning. Builds on 3 of its 53 references that are in the map. First posted on arXiv 18 Apr 2025.

Builds on

3 of 53 references.

References · 3

  1. 2024RepairAgent: An Autonomous, LLM-Based Agent for Program Repaircited by 232
  2. 2025Beyond Code Generation: LLM-supported Exploration of the Program Design Spacecited by 13
  3. 2023Conversational Challenges in AI-Powered Data Science: Obstacles, Needs, and Design Opportunitiescited by 9

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2025AIRepr: An Analyst-Inspector Framework for Evaluating Reproducibility of LLMs in Data Science
  2. 2025Why Do Open-Source LLMs Struggle with Data Analysis? A Systematic Empirical Study
  3. 2025Toward Automated and Trustworthy Scientific Analysis and Visualization with LLM-Generated Code
  4. 2025Are LLMs ready to help non-expert users to make charts of official statistics data? ↗
  5. 2025LLM-Based Data Science Agents: A Survey of Capabilities, Challenges, and Future Directions
  6. 2024InsightLens: Augmenting LLM-Powered Data Analysis with Interactive Insight Management and Navigation
  7. 2025Comparing Open-Source and Commercial LLMs for Domain-Specific Analysis and Reporting: Software Engineering Challenges and Design Trade-offs ↗
  8. 2025IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis