mlsanityData to 7 Oct 2026

ParaView-MCP: An Autonomous Visualization Agent with Direct Tool Use

arXiv 2505.07064 ↗First posted 11 May 2025cs.HC cs.AIcited by 11

On the map: LLM agents and tool use → Multimodal and embodied agents

Abstract (arXiv)

While powerful and well-established, tools like ParaView present a steep learning curve that discourages many potential users. This work introduces ParaView-MCP, an autonomous agent that integrates modern multimodal large language models (MLLMs) with ParaView to not only lower the barrier to entry but also augment ParaView with intelligent decision support. By leveraging the state-of-the-art reasoning, command execution, and vision capabilities of MLLMs, ParaView-MCP enables users to interact with ParaView through natural language and visual inputs. Specifically, our system adopted the Model Context Protocol (MCP) - a standardized interface for model-application communication - that facilitates direct interaction between MLLMs with ParaView's Python API to allow seamless information exchange between the user, the language model, and the visualization tool itself. Furthermore, by implementing a visual feedback mechanism that allows the agent to observe the viewport, we unlock a range of new capabilities, including recreating visualizations from examples, closed-loop visualization parameter updates based on user-defined goals, and even cross-application collaboration involving multiple tools. Broadly, we believe such an agent-driven visualization paradigm can profoundly change the way we interact with visualization tools. We expect a significant uptake in the development of such visualization tools, in both visualization research and industry.

Key facts. Cited by 11 papers in the map (data through 7 Oct 2026). Placed in Multimodal and embodied agents, one of 16 directions in LLM agents and tool use. Builds on 22 of its 38 references that are in the map. First posted on arXiv 11 May 2025.

Builds on

22 of 38 references.

Closest ancestors · 3

Same direction, newest first

  1. 2025nvAgent: Automated Data Visualization from Natural Language via Collaborative Agent Workflow7 Feb
  2. 2024MatPlotAgent: Method and Evaluation for LLM-Based Agentic Scientific Data Visualization18 Feb
  3. 2023AVA: Towards Autonomous Visualization Agents through Visual Perception-Driven Decision-Making7 Dec

Other references · 19

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversationcited by 1,906
  3. 2023The Dawn of LMMs: Preliminary Explorations with GPT-4V(ision)cited by 677
  4. 2025Agentic Large Language Models, a surveycited by 105
  5. 2020NL4DV: A Toolkit for Generating Analytic Specifications for Data Visualization from Natural Language Queriescited by 73
  6. 2021Compressive Neural Representations of Volumetric Scalar Fieldscited by 64
  7. 2018VizML: A Machine Learning Approach to Visualization Recommendationcited by 38
  8. 2021AI4VIS: Survey on Artificial Intelligence Approaches for Data Visualizationcited by 32
  9. 2024HAIChart: Human and AI Paired Visualization Systemcited by 26
  10. 2023LLM4Vis: Explainable Visualization Recommendation using ChatGPTcited by 25
  11. 2024Generative AI for Visualization: State of the Art and Future Directionscited by 23
  12. 2022Towards Natural Language-Based Visualization Authoringcited by 22
7 more
  1. 2024Exploring the Capability of LLMs in Performing Low-Level Visual Analytic Tasks on SVG Data Visualizationscited by 18
  2. 2024DracoGPT: Extracting Visualization Design Preferences from Large Language Modelscited by 12
  3. 2024ChatVis: Automating Scientific Visualization with a Large Language Modelcited by 11
  4. 2025See or Recall: A Sanity Check for the Role of Vision in Solving Visualization Question Answer Tasks with Multimodal LLMscited by 7
  5. 2024Text-based Transfer Function Design for Semantic Volume Renderingcited by 5
  6. 2024ChatGPT in Data Visualization Education: A Student Perspectivecited by 3
  7. 2024The Visualization JUDGE : Can Multimodal Foundation Models Guide Visualization Design Through Visual Perception?cited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 4; 2026: 7.

11 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025ChatVis: Large Language Model Agent for Generating Scientific Visualizations
  2. 2026MV-Bench: Benchmarking Multimodal Large Language Models for Coordinated Multi-View Interface Construction
  3. 2025PyVision: Agentic Vision with Dynamic Tooling
  4. 2026From Static to Interactive: Authoring Interactive Visualizations via Natural Language
  5. 2026Socratic-Geo: Synthetic Data Generation and Geometric Reasoning via Multi-Agent Interaction
  6. 2025PhysVLM-AVR: Active Visual Reasoning for Multimodal Large Language Models in Physical Environments
  7. 2026OmniHarness: Harnessing Generalizable Visual Generation via Symbolic Policy Learning
  8. 2024MMFactory: A Universal Solution Search Engine for Vision-Language Tasks