TopoPilot: Reliable Conversational Workflow Automation for Topological Data Analysis and Visualization
On the map: LLM agents and tool use → Multimodal and embodied agents
Abstract (arXiv)
Recent agentic systems demonstrate that large language models can generate scientific visualizations from natural language. However, reliability remains a major limitation: systems may execute invalid operations, introduce subtle but consequential errors, or fail to request missing information when inputs are underspecified. These issues are amplified in real-world workflows, which often exceed the complexity of standard benchmarks. Ensuring reliability in autonomous visualization pipelines therefore remains an open challenge. We present TopoPilot, a reliable and extensible agentic framework for automating complex scientific visualization workflows. TopoPilot incorporates systematic guardrails and verification mechanisms to ensure reliable operation. While we focus on topological data analysis and visualization as a primary use case, the framework is designed to generalize across visualization domains. TopoPilot adopts a reliability-centered two-agent architecture. An orchestrator agent translates user prompts into workflows composed of atomic backend actions, while a verifier agent evaluates these workflows prior to execution, enforcing structural validity and semantic consistency. This separation of interpretation and verification reduces code-generation errors and enforces correctness guarantees. A modular architecture further improves robustness by isolating components and enabling seamless integration of new descriptors and domain-specific workflows without modifying the core system. To systematically address reliability, we introduce a taxonomy of failure modes and implement targeted safeguards for each class. In evaluations simulating 1,000 multi-turn conversations across 100 prompts, including adversarial and infeasible requests, TopoPilot achieves a success rate exceeding 99%, compared to under 50% for baselines without comprehensive guardrails and checks.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Placed in Multimodal and embodied agents, one of 16 directions in LLM agents and tool use. Builds on 35 of its 74 references that are in the map. First posted on arXiv 26 Mar 2026.
Builds on
35 of 74 references.
Closest ancestors · 11
Same direction, newest first
- 2025CoDA: Agentic Systems for Collaborative Data Visualization3 Oct
- 2025A Composable Agentic System for Automated Visual Data Reporting6 Sep
- 2025ChatVis: Large Language Model Agent for Generating Scientific Visualizations30 Jul
- 2025ProactiveVA: Proactive Visual Analytics with LLM-Based UI Agent24 Jul
- 2025VizGenie: Toward Self-Refining, Domain-Aware Workflows for Next-Generation Scientific Visualization18 Jul
- 2025NLI4VolVis: Natural Language Interaction for Volume Visualization via LLM Multi-Agents and Editable 3D Gaussian Splatting16 Jul
- 2025ParaView-MCP: An Autonomous Visualization Agent with Direct Tool Use11 May
- 2024LightVA: Lightweight Visual Analytics with LLM Agent-Based Task Planning and Execution8 Nov
- 2024DataNarrative: Automated Data-Driven Storytelling with Visualizations and Texts9 Aug
- 2024MatPlotAgent: Method and Evaluation for LLM-Based Agentic Scientific Data Visualization18 Feb
- 2023AVA: Towards Autonomous Visualization Agents through Visual Perception-Driven Decision-Making7 Dec
Other references · 24
- 2023Language Agent Tree Search Unifies Reasoning Acting and Planning in Language Modelscited by 551
- 2023ToolChain*: Efficient Action Space Navigation in Large Language Models with A* Searchcited by 103
- 2023ChartGPT: Leveraging LLMs to Generate Charts from Abstract Natural Languagecited by 71
- 2024TrustAgent: Towards Safe and Trustworthy LLM-based Agentscited by 62
- 2023Chat2VIS: Generating Data Visualisations via Natural Language using ChatGPT, Codex and GPT-3 Large Language Modelscited by 58
- 2024Current state of LLM Risks and AI Guardrailscited by 44
- 2018The Topology ToolKitcited by 39
- 2021AI4VIS: Survey on Artificial Intelligence Approaches for Data Visualizationcited by 32
- 2024Tool-Planner: Task Planning with Clusters across Multiple Toolscited by 32
- 2024Measuring and Reducing LLM Hallucination without Gold-Standard Answerscited by 31
- 2024Advancing Agentic Systems: Dynamic Task Decomposition, Tool Integration and Evaluation using Novel Metrics and Datasetcited by 24
- 2021Scalar Field Comparison with Topological Descriptors: Properties and Applications for Scientific Visualizationcited by 14
12 more
- 2026ToolGate: Contract-Grounded and Verified Tool Execution for LLMscited by 13
- 2024ChatVis: Automating Scientific Visualization with a Large Language Modelcited by 11
- 2025Automated Visualization Code Synthesis via Multi-Path Reasoning and Feedback-Driven Optimizationcited by 6
- 2024Text-based Transfer Function Design for Semantic Volume Renderingcited by 5
- 2017Using Contour Trees in the Analysis and Visualization of Radio Astronomy Data Cubescited by 4
- 2023Parallel Computation of Piecewise Linear Morse-Smale Segmentationscited by 3
- 2023TROPHY: A Topologically Robust Physics-Informed Tracking Framework for Tropical Cyclonescited by 3
- 2025Tracking Low-Level Cloud Systems with Topologycited by 3
- 2026The Six Sigma Agent: Achieving Enterprise-Grade Reliability in LLM Systems Through Consensus-Driven Decomposed Executioncited by 3
- 2020A Progressive Approach to Scalar Field Topologycited by 2
- 2025Reliable agent engineering should integrate machine-compatible organizational principlescited by 2
- 2025A Generative AI System for Biomedical Data Discovery with Grammar-Based Visualizationscited by 1
Built on by
Citing papers per year: 2026: 3.
3 papers.
- 2026SciVisAgentBench: A Benchmark for Evaluating Scientific Data Analysis and Visualization Agentscited by 9
- 2026SciVisAgentSkills: Design and Evaluation of Agent Skills for Scientific Data Analysis and Visualizationcited by 1
- 2026HiLSVA: Design and Evaluation of a Human-in-the-Loop Agentic System for Scientific Visualizationcited by 1
- 2026HiLSVA: Design and Evaluation of a Human-in-the-Loop Agentic System for Scientific Visualization25 Jun 2026
- 2026SciVisAgentSkills: Design and Evaluation of Agent Skills for Scientific Data Analysis and Visualization4 Jun 2026
- 2026SciVisAgentBench: A Benchmark for Evaluating Scientific Data Analysis and Visualization Agents31 Mar 2026
Similar, not cited
Close in wording, no citation either way
- 2026Chat2Workflow: A Benchmark for Generating Executable Visual Workflows with Natural Language
- 2026Exploring LLM Agent Designs and Interaction Modalities for Scientific Visualization
- 2025nvAgent: Automated Data Visualization from Natural Language via Collaborative Agent Workflow
- 2026Agentic Authoring of Interactive Multiview Visualizations in Genomics
- 2026GraphFlow: An Architecture for Formally Verifiable Visual Workflows Enabling Reliable Agentic AI Automation
- 2025An Evaluation-Centric Paradigm for Scientific Visualization Agents
- 2026MUSE: An Interactive Meta-Agent for Understanding and Steering LLM-powered Data Science Systems
- 2026Figures as Interfaces: Toward LLM-Native Artifacts for Scientific Discovery