DeepVIS: Bridging Natural Language and Data Visualization Through Step-wise Reasoning
On the map: LLM reasoning → Multimodal reasoning
Abstract (arXiv)
Although data visualization is powerful for revealing patterns and communicating insights, creating effective visualizations requires familiarity with authoring tools and often disrupts the analysis flow. While large language models show promise for automatically converting analysis intent into visualizations, existing methods function as black boxes without transparent reasoning processes, which prevents users from understanding design rationales and refining suboptimal outputs. To bridge this gap, we propose integrating Chain-of-Thought (CoT) reasoning into the Natural Language to Visualization (NL2VIS) pipeline. First, we design a comprehensive CoT reasoning process for NL2VIS and develop an automatic pipeline to equip existing datasets with structured reasoning steps. Second, we introduce nvBench-CoT, a specialized dataset capturing detailed step-by-step reasoning from ambiguous natural language descriptions to finalized visualizations, which enables state-of-the-art performance when used for model fine-tuning. Third, we develop DeepVIS, an interactive visual interface that tightly integrates with the CoT reasoning process, allowing users to inspect reasoning steps, identify errors, and make targeted adjustments to improve visualization outcomes. Quantitative benchmark evaluations, two use cases, and a user study collectively demonstrate that our CoT framework effectively enhances NL2VIS quality while providing insightful reasoning steps to users.
Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 48 of its 73 references that are in the map. First posted on arXiv 3 Aug 2025.
Builds on
48 of 73 references.
Closest ancestors · 2
Same direction, newest first
- 2025nvBench 2.0: Resolving Ambiguity in Text-to-Visualization through Stepwise Reasoning17 Mar
- 2024POEM: Interactive Prompt Optimization for Enhancing Multimodal Reasoning of Large Language Models6 Jun
Other references · 46
- 2024The Llama 3 Herd of Modelscited by 14,192
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2022Large Language Models are Zero-Shot Reasonerscited by 4,323
- 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,155
- 2025Towards Reasoning Era: A Survey of Long Chain-of-Thought for Reasoning Large Language Modelscited by 381
- 2023Towards Revealing the Mystery behind Chain of Thought: A Theoretical Perspectivecited by 293
- 2021AI Chains: Transparent and Controllable Human-AI Interaction by Chaining Large Language Model Promptscited by 265
- 2023Navigate through Enigmatic Labyrinth A Survey of Chain of Thought Reasoning: Advances, Frontiers and Futurecited by 184
- 2022PromptChainer: Chaining Large Language Model Prompts through Visual Programmingcited by 134
- 2024The Mamba in the Llama: Distilling and Accelerating Hybrid Modelscited by 120
- 2024The Dawn of Natural Language to SQL: Are We Fully Ready?cited by 78
- 2020NL4DV: A Toolkit for Generating Analytic Specifications for Data Visualization from Natural Language Queriescited by 73
34 more
- 2023ChartGPT: Leveraging LLMs to Generate Charts from Abstract Natural Languagecited by 71
- 2022Interactive and Visual Prompt Engineering for Ad-hoc Task Adaptation with Large Language Modelscited by 70
- 2024PromptCharm: Text-to-Image Generation through Multi-modal Prompting and Refinementcited by 61
- 2021Towards Natural Language Interfaces for Data Visualization: A Surveycited by 58
- 2023Chat2VIS: Generating Data Visualisations via Natural Language using ChatGPT, Codex and GPT-3 Large Language Modelscited by 58
- 2023PromptMagician: Interactive Prompt Engineering for Text-to-Image Creationcited by 58
- 2020A Survey of Visual Analytics Techniques for Machine Learningcited by 56
- 2024A Survey of Text-to-SQL in the Era of LLMs: Where are we, and where are we going?cited by 54
- 2025Atom of Thoughts for Markov LLM Test-Time Scalingcited by 54
- 2024VisEval: A Benchmark for Data Visualization in the Era of Large Language Modelscited by 43
- 2024SciInstruct: a Self-Reflective Instruction Annotated Dataset for Training Scientific Language Modelscited by 38
- 2024WaitGPT: Monitoring and Steering Conversational LLM Agent in Data Analysis with On-the-Fly Code Visualizationcited by 38
- 2025Alpha-SQL: Zero-Shot Text-to-SQL using Monte Carlo Tree Searchcited by 33
- 2023Foundation Models Meet Visualizations: Challenges and Opportunitiescited by 31
- 2024LLM Comparator: Visual Analytics for Side-by-Side Evaluation of Large Language Modelscited by 29
- 2020A Survey on ML4VIS: Applying Machine Learning Advances to Data Visualizationcited by 28
- 2024Automated Data Visualization from Natural Language via Large Language Models: An Exploratory Studycited by 26
- 2024Are Large Language Models Good Statisticians?cited by 26
- 2024HAIChart: Human and AI Paired Visualization Systemcited by 26
- 2019FlowSense: A Natural Language Interface for Visual Data Exploration within a Dataflow Systemcited by 25
- 2023Visual Analytics For Machine Learning: A Data Perspective Surveycited by 25
- 2024Patchview: LLM-Powered Worldbuilding with Generative Dust and Magnet Visualizationcited by 23
- 2022Towards Natural Language-Based Visualization Authoringcited by 22
- 2021VizLinter: A Linter and Fixer Framework for Data Visualizationcited by 20
- 2023How Good is ChatGPT in Giving Advice on Your Visualization Design?cited by 20
- 2025Benchmarking Visual Language Models on Standardized Visualization Literacy Testscited by 20
- 2024InsightLens: Augmenting LLM-Powered Data Analysis with Interactive Insight Management and Navigationcited by 17
- 2024Are LLMs ready for Visualization?cited by 16
- 2024Prompt4Vis: Prompting Large Language Models with Example Mining and Schema Filtering for Tabular Data Visualizationcited by 14
- 2021PI2: End-to-end Interactive Visualization Interface Generation from Queriescited by 10
- 2022NL2INTERFACE: Interactive Visualization Interface Generation from Natural Language Queriescited by 8
- 2025PromptMap: An Alternative Interaction Style for AI-Based Image Generationcited by 8
- 2023Agnostic Visual Recommendation Systems: Open Challenges and Future Directionscited by 4
- 2024V-RECS, a Low-Cost LLM4VIS Recommender with Explanations, Captioning and Suggestionscited by 3
Built on by
Citing papers per year: 2025: 3; 2026: 5.
8 papers.
- 2025A Survey of Data Agents: Emerging Paradigm or Overstated Hype?cited by 30
- 2025From Code Foundation Models to Agents and Applications: A Comprehensive Survey and Practical Guide to Code Intelligencecited by 13
- 2026LEDGER: Claim-to-Evidence Trace Graphs for Auditing LLM Agentscited by 4
- 2026DataSpace: Benchmarking Data Agents for Verifiable Analytics over Heterogeneous Workspacescited by 3
- 2025CycleChart: A Unified Consistency-Based Learning Framework for Bidirectional Chart Understanding and Generationcited by 0
- 2026Show Me the Infographic I Imagine: Intent-Aware Infographic Retrieval for Authoring Supportcited by 0
- 2026Chart Deception in Vision-Language Models: From Vulnerability to Mitigationcited by 0
- 2026DataVista: Diagnosing Multimodal LLMs on Data Video Understandingcited by 0
- 2026DataVista: Diagnosing Multimodal LLMs on Data Video Understanding8 Oct 2026
- 2026LEDGER: Claim-to-Evidence Trace Graphs for Auditing LLM Agents19 Aug 2026
- 2026DataSpace: Benchmarking Data Agents for Verifiable Analytics over Heterogeneous Workspaces4 Aug 2026
- 2026Chart Deception in Vision-Language Models: From Vulnerability to Mitigation12 Jun 2026
- 2026Show Me the Infographic I Imagine: Intent-Aware Infographic Retrieval for Authoring Support9 Apr 2026
- 2025CycleChart: A Unified Consistency-Based Learning Framework for Bidirectional Chart Understanding and Generation22 Dec 2025
- 2025From Code Foundation Models to Agents and Applications: A Comprehensive Survey and Practical Guide to Code Intelligence23 Nov 2025
- 2025A Survey of Data Agents: Emerging Paradigm or Overstated Hype?27 Oct 2025
Similar, not cited
Close in wording, no citation either way
- 2026VegaChat: A Robust Framework for LLM-Based Chart Generation and Assessment
- 2025nvAgent: Automated Data Visualization from Natural Language via Collaborative Agent Workflow
- 2026Beyond Static Charts: Can Language and Vision Language Models Generate Interactive Data Visualization Interfaces?
- 2025Text2Vis: A Challenging and Diverse Benchmark for Generating Multimodal Visualizations from Text
- 2026Do Large Language Models Understand Data Visualization Principles?
- 2026InsightChain: Optimized Chain-of-Insight Analytics for LLM-driven Data Visualization
- 2025Diagnosing Bottlenecks in Data Visualization Understanding by Vision-Language Models
- 2025ViStruct: Simulating Expert-Like Reasoning Through Task Decomposition and Visual Attention Cues