mlsanityData to 7 Oct 2026

Toward AI VIS Co-Scientists: A General and End-to-End Agent Harness for Solving Complex Data Visualization Tasks

arXiv 2605.21825 ↗First posted 20 May 2026cs.AI cs.HCcited by 2

Not on the map. Why?

Abstract (arXiv)

The ability to inspect, interpret, and communicate complex data is crucial for virtually any scientific endeavor, but often requires significant expertise outside the core domain ranging from data management and analysis to visualization design and implementation. We present an end-to-end agentic harness that, based on only the data and a high level description of the tasks, independently designs custom visual analysis applications (VIS apps). This represents an important step towards a general AI co-scientist envisioned by many as an autonomous system that can autonomously execute long horizon tasks based on high-level directions. Our proposed VIS co-scientist is an essential component of this broader AI co-scientist vision: a harness that can autonomously analyze data and design visualization solutions using a collection of agents and specialized skills that coordinate exploratory analysis, plan, configure the environment, implement, validate the interface, and most importantly evaluate the overall task completion. Each stage produces document and instruction artifacts that guide downstream work and enable iterative refinement. We validate this approach on IEEE SciVis Contests spanning multiple science and engineering fields. These contests serve as ideal proving grounds because they encode real-world complexity: ambiguous requirements, diverse data modalities, design trade-offs, and task-driven validation. Given only the data and target tasks, our system autonomously produces functional single-page VIS Apps with verified linked-view behavior, highly customized to domain experts' specified tasks and needs.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 19 of its 29 references that are in the map. First posted on arXiv 20 May 2026.

Builds on

19 of 29 references.

References · 19

  1. 2024The AI Scientist: Towards Fully Automated Open-Ended Scientific Discoverycited by 1,002
  2. 2025The AI Scientist-v2: Workshop-Level Automated Scientific Discovery via Agentic Tree Searchcited by 375
  3. 2025Accelerating scientific discovery with Co-Scientistcited by 353
  4. 2025AI-Researcher: Autonomous Scientific Innovationcited by 88
  5. 2025Kosmos: An AI Scientist for Autonomous Discoverycited by 78
  6. 2025DeepScientist: Advancing Frontier-Pushing Scientific Findings Progressivelycited by 56
  7. 2024VisEval: A Benchmark for Data Visualization in the Era of Large Language Modelscited by 43
  8. 2026EvoScientist: Towards Multi-Agent Evolving AI Scientists for End-to-End Scientific Discoverycited by 41
  9. 2023AVA: Towards Autonomous Visualization Agents through Visual Perception-Driven Decision-Makingcited by 21
  10. 2025NLI4VolVis: Natural Language Interaction for Volume Visualization via LLM Multi-Agents and Editable 3D Gaussian Splattingcited by 19
  11. 2023Mini-VLAT: A Short and Effective Measure of Visualization Literacycited by 16
  12. 2025OmniScientist: Toward a Co-evolving Ecosystem of Human and AI Scientistscited by 15
7 more
  1. 2025ParaView-MCP: An Autonomous Visualization Agent with Direct Tool Usecited by 11
  2. 2026SciVisAgentBench: A Benchmark for Evaluating Scientific Data Analysis and Visualization Agentscited by 9
  3. 2025See or Recall: A Sanity Check for the Role of Vision in Solving Visualization Question Answer Tasks with Multimodal LLMscited by 7
  4. 2025ChatVis: Large Language Model Agent for Generating Scientific Visualizationscited by 7
  5. 2025An Evaluation-Centric Paradigm for Scientific Visualization Agentscited by 6
  6. 2026SVLAT: Scientific Visualization Literacy Assessment Testcited by 6
  7. 2024From Perception to Decision: Assessing the Role of Chart Types Affordances in High-Level Decision Taskscited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026AI Agents and the Future of VIS ↗
  2. 2025A2P-Vis: an Analyzer-to-Presenter Agentic Pipeline for Visual Insights Generation and Reporting
  3. 2025A Composable Agentic System for Automated Visual Data Reporting
  4. 2026NORA: A Harness-Engineered Autonomous Research Agent for End-to-End Spatial Data Science
  5. 2026Multi-Agent Discovery and Resource-Aware Autonomous Exploration of Scientific Datasets
  6. 2026Exploring LLM Agent Designs and Interaction Modalities for Scientific Visualization
  7. 2026A case study of evaluating AI agents on a neuroscience data-to-discovery pipeline
  8. 2025Multi-Agent Data Visualization and Narrative Generation