MultiVis-Agent: A Multi-Agent Framework with Logic Rules for Reliable and Comprehensive Cross-Modal Data Visualization
On the map: LLM agents and tool use → Multimodal and embodied agents
Abstract (arXiv)
Real-world visualization tasks involve complex, multi-modal requirements that extend beyond simple text-to-chart generation, requiring reference images, code examples, and iterative refinement. Current systems exhibit fundamental limitations: single-modality input, one-shot generation, and rigid workflows. While LLM-based approaches show potential for these complex requirements, they introduce reliability challenges including catastrophic failures and infinite loop susceptibility. To address this gap, we propose MultiVis-Agent, a logic rule-enhanced multi-agent framework for reliable multi-modal and multi-scenario visualization generation. Our approach introduces a four-layer logic rule framework that provides mathematical guarantees for system reliability while maintaining flexibility. Unlike traditional rule-based systems, our logic rules are mathematical constraints that guide LLM reasoning rather than replacing it. We formalize the MultiVis task spanning four scenarios from basic generation to iterative refinement, and develop MultiVis-Bench, a benchmark with over 1,000 cases for multi-modal visualization evaluation. Extensive experiments demonstrate that our approach achieves 75.63% visualization score on challenging tasks, significantly outperforming baselines (57.54-62.79%), with task completion rates of 99.58% and code execution success rates of 94.56% (vs. 74.48% and 65.10% without logic rules), successfully addressing both complexity and reliability challenges in automated visualization generation.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Placed in Multimodal and embodied agents, one of 16 directions in LLM agents and tool use. Builds on 25 of its 52 references that are in the map. First posted on arXiv 26 Jan 2026.
Builds on
25 of 52 references.
Closest ancestors · 1
Same direction, newest first
- 2025nvAgent: Automated Data Visualization from Natural Language via Collaborative Agent Workflow7 Feb
Other references · 24
- 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversationcited by 1,988
- 2018Spider: A Large-Scale Human-Labeled Dataset for Complex and Cross-Domain Semantic Parsing and Text-to-SQL Taskcited by 1,139
- 2024Spider 2.0: Evaluating Language Models on Real-World Enterprise Text-to-SQL Workflowscited by 232
- 2023LIDA: A Tool for Automatic Generation of Grammar-Agnostic Visualizations and Infographics using Large Language Modelscited by 82
- 2023ReAcTable: Enhancing ReAct for Table Question Answeringcited by 76
- 2023ChartGPT: Leveraging LLMs to Generate Charts from Abstract Natural Languagecited by 73
- 2023Is GPT-4 a Good Data Analyst?cited by 70
- 2024ChartInsights: Evaluating Multimodal Large Language Models for Low-Level Chart Question Answeringcited by 50
- 2019Text-to-Viz: Automatic Generation of Infographics from Proportion-Related Natural Language Statementscited by 31
- 2021Collecting and Characterizing Natural Language Utterances for Specifying Data Visualizationscited by 31
- 2023Natural Language Interfaces for Tabular Data Querying and Visualization: A Surveycited by 27
- 2024Advancing Multimodal Large Language Models in Chart Question Answering with Visualization-Referenced Instruction Tuningcited by 27
12 more
- 2024HAIChart: Human and AI Paired Visualization Systemcited by 26
- 2019FlowSense: A Natural Language Interface for Visual Data Exploration within a Dataflow Systemcited by 25
- 2022Towards Natural Language-Based Visualization Authoringcited by 22
- 2023Natural Language Dataset Generation Framework for Visualizations Powered by Large Language Modelscited by 20
- 2016Effortless Data Exploration with zenvisage: An Expressive and Interactive Visual Analytics Systemcited by 14
- 2020InChorus: Designing Consistent Multimodal Interactions for Data Visualization on Tablet Devicescited by 12
- 2021Lux: Always-on Visualization Recommendations for Exploratory Dataframe Workflowscited by 10
- 2021PI2: End-to-end Interactive Visualization Interface Generation from Queriescited by 10
- 2020Quda: Natural Language Queries for Visual Data Analyticscited by 9
- 2023Marrying Dialogue Systems with Data Visualization: Interactive Data Visualization Generation from Natural Language Conversationscited by 9
- 2025TEXT2DB: Integration-Aware Information Extraction with Large Language Model Agentscited by 3
- 2024Towards Robustness of Text-to-Visualization Translation against Lexical and Phrasal Variabilitycited by 2
Built on by
Citing papers per year: 2026: 3.
3 papers.
Similar, not cited
Close in wording, no citation either way
- 2025PlotGen: Multi-Agent LLM-based Scientific Data Visualization via Multimodal Feedback
- 2025CoDA: Agentic Systems for Collaborative Data Visualization
- 2025METAL: A Multi-Agent Framework for Chart Generation with Test-Time Scaling
- 2026Crystalis: Progressive Nucleation and Semantic Annealing for Coordinated Multi-View Visualization Generation
- 2026Explainable Iterative Data Visualisation Refinement via an LLM Agent
- 2025An Evaluation-Centric Paradigm for Scientific Visualization Agents
- 2025Multi-Agent Data Visualization and Narrative Generation
- 2024MatPlotAgent: Method and Evaluation for LLM-Based Agentic Scientific Data Visualization