mlsanityData to 14 Oct 2026

Agentic Visualization: Extracting Agent-based Design Patterns from Visualization Systems

arXiv 2505.19101 ↗First posted 25 May 2025cs.HCcited by 12

On the map: LLM agents and tool use → Multimodal and embodied agents

Abstract (arXiv)

Autonomous agents powered by Large Language Models are transforming AI, creating an imperative for the visualization field to embrace agentic frameworks. However, our field's focus on a human in the sensemaking loop raises critical questions about autonomy, delegation, and coordination for such textitagentic visualization that preserve human agency while amplifying analytical capabilities. This paper addresses these questions by reinterpreting existing visualization systems with semi-automated or fully automatic AI components through an agentic lens. Based on this analysis, we extract a collection of design patterns for agentic visualization, including agentic roles, communication and coordination. These patterns provide a foundation for future agentic visualization systems that effectively harness AI agents while maintaining human insight and control.

Key facts. Cited by 12 papers in the map (data through 14 Oct 2026). Placed in Multimodal and embodied agents, one of 16 directions in LLM agents and tool use. Builds on 14 of its 51 references that are in the map. First posted on arXiv 25 May 2025.

Builds on

14 of 51 references.

Closest ancestors · 2

Same direction, newest first

  1. 2024From Data to Story: Towards Automatic Animated Data Video Creation with LLM-based Multi-Agent Systems7 Aug
  2. 2023AVA: Towards Autonomous Visualization Agents through Visual Perception-Driven Decision-Making7 Dec

Other references · 12

  1. 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,568
  2. 2024WaitGPT: Monitoring and Steering Conversational LLM Agent in Data Analysis with On-the-Fly Code Visualizationcited by 39
  3. 2024Agent Design Pattern Catalogue: A Collection of Architectural Patterns for Foundation Model based Agentscited by 35
  4. 2023Data Formulator: AI-powered Concept-driven Visualization Authoringcited by 32
  5. 2024Generative AI for Visualization: State of the Art and Future Directionscited by 23
  6. 2024InsightLens: Augmenting LLM-Powered Data Analysis with Interactive Insight Management and Navigationcited by 18
  7. 2021Snowy: Recommending Utterances for Conversational Visual Analysiscited by 14
  8. 2018DataSite: Proactive Visual Data Exploration with Computation of Insight-based Recommendationscited by 12
  9. 2022An Analysis and Comparison of ACT-R and Soarcited by 12
  10. 2025Jupybara: Operationalizing a Design Space for Actionable Data Analysis and Storytelling with LLMscited by 5
  11. 2025DATAWEAVER: Authoring Data-Driven Narratives through the Integrated Composition of Visualization and Textcited by 4
  12. 2019Speculative Execution for Guided Visual Analyticscited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 5; 2026: 7.

12 papers.

  1. 2025CoDA: Agentic Systems for Collaborative Data Visualizationcited by 15
  2. 2026SciVisAgentBench: A Benchmark for Evaluating Scientific Data Analysis and Visualization Agentscited by 10
  3. 2025An Evaluation-Centric Paradigm for Scientific Visualization Agentscited by 6
  4. 2025Multi-Agent Data Visualization and Narrative Generationcited by 4
  5. 2025Illuminating LLM Coding Agents: Visual Analytics for Deeper Understanding and Enhancementcited by 3
  6. 2026Exploring LLM Agent Designs and Interaction Modalities for Scientific Visualizationcited by 2
  7. 2026HiLSVA: Design and Evaluation of a Human-in-the-Loop Agentic System for Scientific Visualizationcited by 2
  8. 2026SciVisAgentSkills: Design and Evaluation of Agent Skills for Scientific Data Analysis and Visualizationcited by 1
  9. 2025VIDEE: Visual and Interactive Decomposition, Execution, and Evaluation of Text Analytics with Intelligent Agentscited by 0
  10. 2026Context-Mediated Domain Adaptation in Multi-Agent Sensemaking Systemscited by 0
  11. 2026Point, Revise, Review: Grounded Agentic Analysis in Reactive Notebooks with marimo-lenscited by 0
  12. 2026ParallelPilot: Supporting Coordination and Monitoring in Parallel AI Codingcited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2026WidgetVA: A Widget-Centric Framework and Benchmark for Agentic Visual Analytics
  2. 2026AI Agents and the Future of VIS ↗
  3. 2025A Composable Agentic System for Automated Visual Data Reporting
  4. 2026How to Build AI Agents by Augmenting LLMs with Codified Human Expert Domain Knowledge? A Software Engineering Framework
  5. 2025Control Plane as a Tool: A Scalable Design Pattern for Agentic AI Systems
  6. 2026Agentic Design Patterns: A System-Theoretic Framework
  7. 2026When Should an AI Act? A Human-Centered Model of Scene, Context, and Behavior for Agentic AI Design
  8. 2026EvoDiagram: Agentic Editable Diagram Creation via Design Expertise Evolution