mlsanityData to 14 Oct 2026

Where Are We So Far? Understanding Data Storytelling Tools from the Perspective of Human-AI Collaboration

arXiv 2309.15723 ↗First posted 27 Sep 2023cs.HC cs.AIcited by 13

Not on the map. Why?

Abstract (arXiv)

Data storytelling is powerful for communicating data insights, but it requires diverse skills and considerable effort from human creators. Recent research has widely explored the potential for artificial intelligence (AI) to support and augment humans in data storytelling. However, there lacks a systematic review to understand data storytelling tools from the perspective of human-AI collaboration, which hinders researchers from reflecting on the existing collaborative tool designs that promote humans' and AI's advantages and mitigate their shortcomings. This paper investigated existing tools with a framework from two perspectives: the stages in the storytelling workflow where a tool serves, including analysis, planning, implementation, and communication, and the roles of humans and AI in each stage, such as creators, assistants, optimizers, and reviewers. Through our analysis, we recognize the common collaboration patterns in existing tools, summarize lessons learned from these patterns, and further illustrate research opportunities for human-AI collaboration in data storytelling.

Key facts. Cited by 13 papers in the map (data through 14 Oct 2026). Builds on 55 of its 156 references that are in the map. First posted on arXiv 27 Sep 2023.

Builds on

55 of 156 references.

References · 55

  1. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  2. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
  3. 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,780
  4. 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,568
  5. 2019The What-If Tool: Interactive Probing of Machine Learning Modelscited by 207
  6. 2023LIDA: A Tool for Automatic Generation of Grammar-Agnostic Visualizations and Infographics using Large Language Modelscited by 82
  7. 2019Human-AI Collaboration in Data Science: Exploring Data Scientists' Perceptions of Automated AIcited by 79
  8. 2018RuleMatrix: Visualizing and Understanding Classifiers with Rulescited by 62
  9. 2018VizML: A Machine Learning Approach to Visualization Recommendationcited by 38
  10. 2021AI4VIS: Survey on Artificial Intelligence Approaches for Data Visualizationcited by 32
  11. 2019Text-to-Viz: Automatic Generation of Infographics from Proportion-Related Natural Language Statementscited by 31
  12. 2020Calliope: Automatic Visual Data Story Generation from a Spreadsheetcited by 30
38 more
  1. 2020A Survey on ML4VIS: Applying Machine Learning Advances to Data Visualizationcited by 28
  2. 2022Interpretability, Then What? Editing Machine Learning Models to Reflect Human Knowledge and Valuescited by 25
  3. 2023Visual Analytics For Machine Learning: A Data Perspective Surveycited by 25
  4. 2023DataTales: Investigating the use of Large Language Models for Authoring Data-Driven Articlescited by 24
  5. 2021Fits and Starts: Enterprise Use of AutoML and the Role of Humans in the Loopcited by 21
  6. 2019Towards Automated Infographic Design: Deep Learning-based Auto-Extraction of Extensible Timelinecited by 20
  7. 2021VizLinter: A Linter and Fixer Framework for Data Visualizationcited by 20
  8. 2021InfoColorizer: Interactive Recommendation of Color Palettes for Infographicscited by 15
  9. 2022Telling Stories from Computational Notebooks: AI-Assisted Presentation Slides Creation for Presenting Data Science Workcited by 15
  10. 2020Retrieve-Then-Adapt: Example-based Automatic Generation for Proportion-related Infographicscited by 14
  11. 2023Data Player: Automatic Generation of Data Videos with Narration-Animation Interplaycited by 13
  12. 2020VoiceCoach: Interactive Evidence-based Training for Voice Modulation Skills in Public Speakingcited by 11
  13. 2021Supporting Serendipity: Opportunities and Challenges for Human-AI Collaboration in Qualitative Analysiscited by 11
  14. 2022Structure-aware Visualization Retrievalcited by 11
  15. 2022Erato: Cooperative Data Story Editing via Fact Interpolationcited by 11
  16. 2022Sporthesia: Augmenting Sports Videos Using Natural Languagecited by 11
  17. 2023InkSight: Leveraging Sketch Interaction for Documenting Chart Findings in Computational Notebookscited by 11
  18. 2021ChartStory: Automated Partitioning, Layout, and Captioning of Charts into Comic-Style Narrativescited by 10
  19. 2021Kori: Interactive Synthesis of Text and Charts in Data Documentscited by 10
  20. 2021Explaining with Examples: Lessons Learned from Crowdsourced Introductory Description of Information Visualizationscited by 8
  21. 2023Reviving Static Charts into Live Chartscited by 8
  22. 2022The Stories We Tell About Data: Media Types for Data-Driven Storytellingcited by 7
  23. 2022How Does Automation Shape the Process of Narrative Visualization: A Survey of Toolscited by 7
  24. 2023Notable: On-the-fly Assistant for Data Storytelling in Computational Notebookscited by 7
  25. 2023Why is AI not a Panacea for Data Workers? An Interview Study on Human-AI Collaboration in Data Storytellingcited by 7
  26. 2023WonderFlow: Narration-Centric Design of Animated Data Videoscited by 7
  27. 2017Coupling Story to Visualization: Using Textual Analysis as a Bridge Between Data and Interpretationcited by 6
  28. 2021A Visual Analytics Approach to Facilitate the Proctoring of Online Examscited by 5
  29. 2022Augmented Chironomia for Presenting Data to Remote Audiencescited by 4
  30. 2022DMiner: Dashboard Design Mining and Recommendationcited by 4
  31. 2020What Makes a Data-GIF Understandable?cited by 3
  32. 2021From Jam Session to Recital: Synchronous Communication and Collaboration Around Data in Organizationscited by 3
  33. 2021Gemini2: Generating Keyframe-Oriented Animated Transitions Between Statistical Graphicscited by 3
  34. 2022Infographics Wizard: Flexible Infographics Authoring and Design Explorationcited by 3
  35. 2022ScrollyVis: Interactive visual authoring of guided dynamic narratives for scientific scrollytellingcited by 3
  36. 2022Animated Vega-Lite: Unifying Animation with a Grammar of Interactive Graphicscited by 3
  37. 2023GeoCamera: Telling Stories in Geographic Visualizations with Camera Movementscited by 3
  38. 2023Augmenting Sports Videos with VisCommentatorcited by 3

50 most cited of 55 All 55 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 2; 2025: 8; 2026: 3.

13 papers.

Sort:

By area:

  1. 2024From Data to Story: Towards Automatic Animated Data Video Creation with LLM-based Multi-Agent Systemscited by 16
  2. 2024Deconstructing Human-AI Collaboration: Agency, Interaction, and Adaptationcited by 8
  3. 2025DATAWEAVER: Authoring Data-Driven Narratives through the Integrated Composition of Visualization and Textcited by 4
  4. 2025TongSIM: A General Platform for Simulating Intelligent Machinescited by 4
  5. 2025ReSpark: Leveraging Previous Data Reports as References to Generate New Reports with LLMscited by 2
  6. 2025MDSF: Context-Aware Multi-Dimensional Data Storytelling Framework based on Large language Modelcited by 1
  7. 2025Reflection on Data Storytelling Tools in the Generative AI Era from the Human-AI Collaboration Perspectivecited by 1
  8. 2025A Review on Large Language Models for Visual Analyticscited by 1
  9. 2025DashChat: Interactive Authoring of Performance Dashboard Design Prototypes through Conversation with LLM-Powered Agentcited by 1
  10. 2025Human-AI Narrative Synthesis to Foster Shared Understanding in Civic Decision-Makingcited by 1
  11. 2026AnnoBench: A Benchmark for Visualization Annotation Generationcited by 1
  12. 2026Human-Data Interaction, Exploration, and Visualization in the AI Era: Challenges and Opportunitiescited by 0
1 more
  1. 2026Data storytelling meets interpretable machine learning: Decoding AI decisions for non-experts without revealing sensitive data and model detailscited by 0