ParaView-MCP: An Autonomous Visualization Agent with Direct Tool Use
On the map: LLM agents and tool use → Multimodal and embodied agents
Abstract (arXiv)
While powerful and well-established, tools like ParaView present a steep learning curve that discourages many potential users. This work introduces ParaView-MCP, an autonomous agent that integrates modern multimodal large language models (MLLMs) with ParaView to not only lower the barrier to entry but also augment ParaView with intelligent decision support. By leveraging the state-of-the-art reasoning, command execution, and vision capabilities of MLLMs, ParaView-MCP enables users to interact with ParaView through natural language and visual inputs. Specifically, our system adopted the Model Context Protocol (MCP) - a standardized interface for model-application communication - that facilitates direct interaction between MLLMs with ParaView's Python API to allow seamless information exchange between the user, the language model, and the visualization tool itself. Furthermore, by implementing a visual feedback mechanism that allows the agent to observe the viewport, we unlock a range of new capabilities, including recreating visualizations from examples, closed-loop visualization parameter updates based on user-defined goals, and even cross-application collaboration involving multiple tools. Broadly, we believe such an agent-driven visualization paradigm can profoundly change the way we interact with visualization tools. We expect a significant uptake in the development of such visualization tools, in both visualization research and industry.
Key facts. Cited by 11 papers in the map (data through 7 Oct 2026). Placed in Multimodal and embodied agents, one of 16 directions in LLM agents and tool use. Builds on 22 of its 38 references that are in the map. First posted on arXiv 11 May 2025.
Builds on
22 of 38 references.
Closest ancestors · 3
Same direction, newest first
- 2025nvAgent: Automated Data Visualization from Natural Language via Collaborative Agent Workflow7 Feb
- 2024MatPlotAgent: Method and Evaluation for LLM-Based Agentic Scientific Data Visualization18 Feb
- 2023AVA: Towards Autonomous Visualization Agents through Visual Perception-Driven Decision-Making7 Dec
Other references · 19
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversationcited by 1,906
- 2023The Dawn of LMMs: Preliminary Explorations with GPT-4V(ision)cited by 677
- 2025Agentic Large Language Models, a surveycited by 105
- 2020NL4DV: A Toolkit for Generating Analytic Specifications for Data Visualization from Natural Language Queriescited by 73
- 2021Compressive Neural Representations of Volumetric Scalar Fieldscited by 64
- 2018VizML: A Machine Learning Approach to Visualization Recommendationcited by 38
- 2021AI4VIS: Survey on Artificial Intelligence Approaches for Data Visualizationcited by 32
- 2024HAIChart: Human and AI Paired Visualization Systemcited by 26
- 2023LLM4Vis: Explainable Visualization Recommendation using ChatGPTcited by 25
- 2024Generative AI for Visualization: State of the Art and Future Directionscited by 23
- 2022Towards Natural Language-Based Visualization Authoringcited by 22
7 more
- 2024Exploring the Capability of LLMs in Performing Low-Level Visual Analytic Tasks on SVG Data Visualizationscited by 18
- 2024DracoGPT: Extracting Visualization Design Preferences from Large Language Modelscited by 12
- 2024ChatVis: Automating Scientific Visualization with a Large Language Modelcited by 11
- 2025See or Recall: A Sanity Check for the Role of Vision in Solving Visualization Question Answer Tasks with Multimodal LLMscited by 7
- 2024Text-based Transfer Function Design for Semantic Volume Renderingcited by 5
- 2024ChatGPT in Data Visualization Education: A Student Perspectivecited by 3
- 2024The Visualization JUDGE : Can Multimodal Foundation Models Guide Visualization Design Through Visual Perception?cited by 3
Built on by
Citing papers per year: 2025: 4; 2026: 7.
11 papers.
- 2025NLI4VolVis: Natural Language Interaction for Volume Visualization via LLM Multi-Agents and Editable 3D Gaussian Splattingcited by 19
- 2026SciVisAgentBench: A Benchmark for Evaluating Scientific Data Analysis and Visualization Agentscited by 9
- 2025An Evaluation-Centric Paradigm for Scientific Visualization Agentscited by 6
- 2025InferA: A Smart Assistant for Cosmological Ensemble Datacited by 6
- 2025IntuiTF: MLLM-Guided Transfer Function Optimization for Direct Volume Renderingcited by 4
- 2026TopoPilot: Reliable Conversational Workflow Automation for Topological Data Analysis and Visualizationcited by 3
- 2026Exploring LLM Agent Designs and Interaction Modalities for Scientific Visualizationcited by 2
- 2026Toward AI VIS Co-Scientists: A General and End-to-End Agent Harness for Solving Complex Data Visualization Taskscited by 2
- 2026SciVisAgentSkills: Design and Evaluation of Agent Skills for Scientific Data Analysis and Visualizationcited by 1
- 2026HiLSVA: Design and Evaluation of a Human-in-the-Loop Agentic System for Scientific Visualizationcited by 1
- 2026Multi-Agent Discovery and Resource-Aware Autonomous Exploration of Scientific Datasetscited by 0
- 2026Multi-Agent Discovery and Resource-Aware Autonomous Exploration of Scientific Datasets22 Aug 2026
- 2026HiLSVA: Design and Evaluation of a Human-in-the-Loop Agentic System for Scientific Visualization25 Jun 2026
- 2026SciVisAgentSkills: Design and Evaluation of Agent Skills for Scientific Data Analysis and Visualization4 Jun 2026
- 2026Toward AI VIS Co-Scientists: A General and End-to-End Agent Harness for Solving Complex Data Visualization Tasks20 May 2026
- 2026Exploring LLM Agent Designs and Interaction Modalities for Scientific Visualization30 Apr 2026
- 2026SciVisAgentBench: A Benchmark for Evaluating Scientific Data Analysis and Visualization Agents31 Mar 2026
- 2026TopoPilot: Reliable Conversational Workflow Automation for Topological Data Analysis and Visualization26 Mar 2026
- 2025InferA: A Smart Assistant for Cosmological Ensemble Data14 Oct 2025
- 2025An Evaluation-Centric Paradigm for Scientific Visualization Agents18 Sep 2025
- 2025NLI4VolVis: Natural Language Interaction for Volume Visualization via LLM Multi-Agents and Editable 3D Gaussian Splatting16 Jul 2025
- 2025IntuiTF: MLLM-Guided Transfer Function Optimization for Direct Volume Rendering23 Jun 2025
Similar, not cited
Close in wording, no citation either way
- 2025ChatVis: Large Language Model Agent for Generating Scientific Visualizations
- 2026MV-Bench: Benchmarking Multimodal Large Language Models for Coordinated Multi-View Interface Construction
- 2025PyVision: Agentic Vision with Dynamic Tooling
- 2026From Static to Interactive: Authoring Interactive Visualizations via Natural Language
- 2026Socratic-Geo: Synthetic Data Generation and Geometric Reasoning via Multi-Agent Interaction
- 2025PhysVLM-AVR: Active Visual Reasoning for Multimodal Large Language Models in Physical Environments
- 2026OmniHarness: Harnessing Generalizable Visual Generation via Symbolic Policy Learning
- 2024MMFactory: A Universal Solution Search Engine for Vision-Language Tasks