Evaluating LLMs for Visualization Tasks
Not on the map. Why?
Abstract (arXiv)
Information Visualization has been utilized to gain insights from complex data. In recent times, Large Language Models (LLMs) have performed very well in many tasks. In this paper, we showcase the capabilities of different popular LLMs to generate code for visualization based on simple prompts. We also analyze the power of LLMs to understand some common visualizations by answering simple questions. Our study shows that LLMs could generate code for some visualizations as well as answer questions about them. However, LLMs also have several limitations. We believe that our insights can be used to improve both LLMs and Information Visualization systems.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 17 of its 26 references that are in the map. First posted on arXiv 10 Apr 2025.
Builds on
17 of 26 references.
References · 17
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2021Evaluating Large Language Models Trained on Codecited by 8,320
- 2021Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processingcited by 2,234
- 2022ChartQA: A Benchmark for Question Answering about Charts with Visual and Logical Reasoningcited by 1,479
- 2017FigureQA: An Annotated Figure Dataset for Visual Reasoningcited by 319
- 2023UReader: Universal OCR-free Visually-situated Language Understanding with Multimodal Large Language Modelcited by 143
- 2023LIDA: A Tool for Automatic Generation of Grammar-Agnostic Visualizations and Infographics using Large Language Modelscited by 82
- 2024ChartAssisstant: A Universal Chart Multimodal Language Model via Chart-to-Table Pre-training and Multitask Instruction Tuningcited by 79
- 2020NL4DV: A Toolkit for Generating Analytic Specifications for Data Visualization from Natural Language Queriescited by 74
- 2021Towards Natural Language Interfaces for Data Visualization: A Surveycited by 59
- 2023Chat2VIS: Generating Data Visualisations via Natural Language using ChatGPT, Codex and GPT-3 Large Language Modelscited by 59
5 more
- 2018Data2Vis: Automatic Generation of Data Visualizations Using Sequence to Sequence Recurrent Neural Networkscited by 48
- 2021AI4VIS: Survey on Artificial Intelligence Approaches for Data Visualizationcited by 32
- 2024Visualization Generation with Large Language Models: An Evaluationcited by 29
- 2023Let the Chart Spark: Embedding Semantic Context into Chart with Text-to-Image Generative Modelcited by 21
- 2024Are LLMs ready for Visualization?cited by 16
Built on by
Not cited yet.