Generating Statistical Charts with Validation-Driven LLM Workflows
Not on the map. Why?
Abstract (arXiv)
Generating diverse, readable statistical charts from tabular data remains challenging for LLMs, as many failures become apparent after rendering and are not detectable from data or code alone. Existing chart datasets also rarely provide fully aligned artifacts, such as executable code, dataset context, and question-answer pairs. We present a structured LLM-based workflow that decomposes chart generation into dataset screening, plot proposal, code synthesis, rendering, validation-driven refinement, description generation, and question-answer generation. By incorporating rendered-output validation, the workflow addresses visualization-specific failure modes such as readability and semantic mismatch. It treats chart generation as an inspectable process rather than a one-shot prompt-to-code task, retaining each chart with its code, dataset context, description, and question-answer pairs. Applied to UCI datasets, the workflow produces 1,500 charts from 74 datasets, spanning 24 chart families and paired with 30,003 question-answer pairs. We evaluate 16 multimodal LLMs (MLLMs) on these chart-question pairs. The results show that chart-syntax questions are nearly saturated, while value extraction, comparison, and reasoning remain more challenging, illustrating the workflow's utility for diagnostic studies of chart-grounded multimodal reasoning.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 18 of its 24 references that are in the map. First posted on arXiv 1 May 2026.
Builds on
18 of 24 references.
References · 18
- 2022ChartQA: A Benchmark for Question Answering about Charts with Visual and Logical Reasoningcited by 1,449
- 2019PlotQA: Reasoning over Scientific Plotscited by 317
- 2022Chart-to-Text: A Large-Scale Benchmark for Chart Summarizationcited by 166
- 2023UniChart: A Universal Vision-language Pretrained Model for Chart Comprehension and Reasoningcited by 158
- 2022MatCha: Enhancing Visual Language Pretraining with Math Reasoning and Chart Derenderingcited by 132
- 2023VisText: A Benchmark for Semantically Rich Chart Captioningcited by 111
- 2025ChartQAPro: A More Diverse and Challenging Benchmark for Chart Question Answeringcited by 105
- 2024MatPlotAgent: Method and Evaluation for LLM-Based Agentic Scientific Data Visualizationcited by 98
- 2023ChartGPT: Leveraging LLMs to Generate Charts from Abstract Natural Languagecited by 71
- 2024ChartInstruct: Instruction Tuning for Chart Comprehension and Reasoningcited by 68
- 2022OpenCQA: Open-ended Question Answering with Chartscited by 60
- 2024ChartInsights: Evaluating Multimodal Large Language Models for Low-Level Chart Question Answeringcited by 50
6 more
- 2024VisEval: A Benchmark for Data Visualization in the Era of Large Language Modelscited by 43
- 2024EvoChart: A Benchmark and a Self-Training Approach Towards Real-World Chart Understandingcited by 32
- 2022Chart Question Answering: State of the Art and Future Directionscited by 26
- 2025Effective Training Data Synthesis for Improving MLLM Chart Understandingcited by 20
- 2025Improved Iterative Refinement for Chart-to-Code Generation via Structured Instructioncited by 8
- 2025SimVecVis: A Dataset for Enhancing MLLMs in Visualization Understandingcited by 5
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2024Charting the Future: Using Chart Question-Answering for Scalable Evaluation of LLM-Driven Data Visualizations
- 2024Synthesize Step-by-Step: Tools, Templates and LLMs as Data Generators for Reasoning-Based Chart VQA
- 2024C2: Scalable Auto-Feedback for LLM-based Chart Generation
- 2024Advancing Multimodal Large Language Models in Chart Question Answering with Visualization-Referenced Instruction Tuning
- 2025Automated Visualization Makeovers with LLMs
- 2025Charts-of-Thought: Enhancing LLM Visualization Literacy Through Structured Data Extraction
- 2024CharXiv: Charting Gaps in Realistic Chart Understanding in Multimodal LLMs
- 2026ChartDesign: Towards LLM Designer of Data Visualization