mlsanityData to 7 Oct 2026

Collecting and Characterizing Natural Language Utterances for Specifying Data Visualizations

arXiv 2110.00680 ↗First posted 1 Oct 2021cs.HCcited by 31

Not on the map. Why?

Abstract (arXiv)

Natural language interfaces (NLIs) for data visualization are becoming increasingly popular both in academic research and in commercial software. Yet, there is a lack of empirical understanding of how people specify visualizations through natural language. To bridge this gap, we conducted an online study with 102 participants. We showed participants a series of ten visualizations for a given dataset and asked them to provide utterances they would pose to generate the displayed charts. The curated list of utterances generated from the study is provided below. This corpus of utterances can be used to evaluate existing NLIs for data visualization as well as for creating new systems and models to generate visualizations from natural language utterances.

Key facts. Cited by 31 papers in the map (data through 7 Oct 2026). First posted on arXiv 1 Oct 2021.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 2; 2022: 2; 2023: 5; 2024: 8; 2025: 5; 2026: 9.

31 papers.

Sort:

By area:

  1. 2022Synchromesh: Reliable code generation from pre-trained language modelscited by 156
  2. 2024VisEval: A Benchmark for Data Visualization in the Era of Large Language Modelscited by 43
  3. 2021Accessible Visualization via Natural Language Descriptions: A Four-Level Model of Semantic Contentcited by 38
  4. 2023Data Formulator: AI-powered Concept-driven Visualization Authoringcited by 31
  5. 2024IterGen: Iterative Semantic-aware Structured LLM Generation with Backtrackingcited by 28
  6. 2021nvBench: A Large-Scale Synthesized Dataset for Cross-Domain Natural Language to Visualization Taskcited by 27
  7. 2023Natural Language Interfaces for Tabular Data Querying and Visualization: A Surveycited by 27
  8. 2022Chart Question Answering: State of the Art and Future Directionscited by 26
  9. 2023XNLI: Explaining and Diagnosing NLI-based Visual Data Analysiscited by 18
  10. 2024Vi(E)va LLM! A Conceptual Stack for Evaluating and Interpreting Generative AI-based Visualizationscited by 10
  11. 2023Conversational AI Threads for Visualizing Multidimensional Datasetscited by 8
  12. 2025VIS-Shepherd: Constructing Critic for LLM-based Data Visualization Generationcited by 8
19 more
  1. 2024Data Analysis in the Era of Generative AIcited by 6
  2. 2025Exploring Multimodal Prompt for Visualization Authoring with Large Language Modelscited by 5
  3. 2023Automatic Data Visualization Generation from Chinese Natural Language Questionscited by 4
  4. 2024V-RECS, a Low-Cost LLM4VIS Recommender with Explanations, Captioning and Suggestionscited by 3
  5. 2026MultiVis-Agent: A Multi-Agent Framework with Logic Rules for Reliable and Comprehensive Cross-Modal Data Visualizationcited by 3
  6. 2026Aligning Text, Code, and Vision: A Multi-Objective Reinforcement Learning Framework for Text-to-Visualizationcited by 2
  7. 2025MDSF: Context-Aware Multi-Dimensional Data Storytelling Framework based on Large language Modelcited by 1
  8. 2025Capturing Visualization Design Rationalecited by 1
  9. 2026VegaChat: A Robust Framework for LLM-Based Chart Generation and Assessmentcited by 1
  10. 2026Lexara: A User-Centered Toolkit for Evaluating Large Language Models for Conversational Visual Analyticscited by 1
  11. 2024Evaluating the Semantic Profiling Abilities of LLMs for Natural Language Utterances in Data Visualizationcited by 0
  12. 2024Do Text-to-Vis Benchmarks Test Real Use of Visualisations?cited by 0
  13. 2024Macro-Queries: An Exploration into Guided Chart Generation from High Level Promptscited by 0
  14. 2025NOVAID: Natural-language Observability Visualization Assistant for ITOps Dashboard Widget Generationcited by 0
  15. 2026Agentic Authoring of Interactive Multiview Visualizations in Genomicscited by 0
  16. 2026Crystalis: Progressive Nucleation and Semantic Annealing for Coordinated Multi-View Visualization Generationcited by 0
  17. 2026VisInteract: Towards Dynamic Interactive Text-to-Visualization under Imperfect Queriescited by 0
  18. 2026Lexara-RF: Reference-Free Metrics for Evaluating Conversational Visual Analytics Agentscited by 0
  19. 2026Beyond Static Charts: Can Language and Vision Language Models Generate Interactive Data Visualization Interfaces?cited by 0