nvBench: A Large-Scale Synthesized Dataset for Cross-Domain Natural Language to Visualization Task
Not on the map. Why?
Abstract (arXiv)
NL2VIS - which translates natural language (NL) queries to corresponding visualizations (VIS) - has attracted more and more attention both in commercial visualization vendors and academic researchers. In the last few years, the advanced deep learning-based models have achieved human-like abilities in many natural language processing (NLP) tasks, which clearly tells us that the deep learning-based technique is a good choice to push the field of NL2VIS. However, a big balk is the lack of benchmarks with lots of (NL, VIS) pairs. We present nvBench, the first large-scale NL2VIS benchmark, containing 25,750 (NL, VIS) pairs from 750 tables over 105 domains, synthesized from (NL, SQL) benchmarks to support cross-domain NL2VIS task. The quality of nvBench has been extensively validated by 23 experts and 300+ crowd workers. Deep learning-based models training using nvBench demonstrate that nvBench can push the field of NL2VIS.
Key facts. Cited by 28 papers in the map (data through 14 Oct 2026). Builds on 11 of its 36 references that are in the map. First posted on arXiv 24 Dec 2021.
Builds on
11 of 36 references.
References · 11
- 2017Attention Is All You Needcited by 60,361
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2014Sequence to Sequence Learning with Neural Networkscited by 2,986
- 2018Spider: A Large-Scale Human-Labeled Dataset for Complex and Cross-Domain Semantic Parsing and Text-to-SQL Taskcited by 1,139
- 2017Seq2SQL: Generating Structured Queries from Natural Language using Reinforcement Learningcited by 687
- 2020NL4DV: A Toolkit for Generating Analytic Specifications for Data Visualization from Natural Language Queriescited by 74
- 2018VizML: A Machine Learning Approach to Visualization Recommendationcited by 38
- 2021Collecting and Characterizing Natural Language Utterances for Specifying Data Visualizationscited by 31
- 2019FlowSense: A Natural Language Interface for Visual Data Exploration within a Dataflow Systemcited by 25
- 2020Interweaving Multimodal Interaction with Flexible Unit Visualizations for Data Explorationcited by 6
Built on by
Citing papers per year: 2023: 4; 2024: 6; 2025: 9; 2026: 9.
28 papers.
Sort:
By area:
- 2023Summary of ChatGPT-Related Research and Perspective Towards the Future of Large Language Modelscited by 154
- 2024ChartInsights: Evaluating Multimodal Large Language Models for Low-Level Chart Question Answeringcited by 50
- 2025Transforming Science with Large Language Models: A Survey on AI-assisted Scientific Discovery, Experimentation, Content Generation, and Evaluationcited by 42
- 2023Natural Language Interfaces for Tabular Data Querying and Visualization: A Surveycited by 27
- 2024HAIChart: Human and AI Paired Visualization Systemcited by 26
- 2024Drawing Pandas: A Benchmark for LLMs in Generating Plotting Codecited by 23
- 2025nvAgent: Automated Data Visualization from Natural Language via Collaborative Agent Workflowcited by 23
- 2023XNLI: Explaining and Diagnosing NLI-based Visual Data Analysiscited by 19
- 2024FinDABench: Benchmarking Financial Data Analysis Ability of Large Language Modelscited by 11
- 2024Vi(E)va LLM! A Conceptual Stack for Evaluating and Interpreting Generative AI-based Visualizationscited by 10
- 2025VIS-Shepherd: Constructing Critic for LLM-based Data Visualization Generationcited by 9
- 2024Data Analysis in the Era of Generative AIcited by 6
16 more
- 2025VisCoder2: Building Multi-Language Visualization Coding Agentscited by 6
- 2026Beyond NL2Code: A Structured Survey of Multimodal Code Intelligencecited by 6
- 2025Measuring Data Science Automation: A Survey of Evaluation Tools for AI Assistants and Agentscited by 4
- 2026VisEditBench: Can Vision-Language Models Edit Visualization Code from Multimodal Feedback?cited by 4
- 2023Natural Language Models for Data Visualization Utilizing nvBench Datasetcited by 3
- 2025Multi-Agent Actor-Critic Generative AI for Query Resolution and Analysiscited by 3
- 2026Aligning Text, Code, and Vision: A Multi-Objective Reinforcement Learning Framework for Text-to-Visualizationcited by 2
- 2026Making Multimodal LLMs Reliable Chart Data Extractors: A Benchmark and Training Frameworkcited by 2
- 2026Lexara: A User-Centered Toolkit for Evaluating Large Language Models for Conversational Visual Analyticscited by 1
- 2026AnnoBench: A Benchmark for Visualization Annotation Generationcited by 1
- 2025GQVis: A Dataset of Genomics Data Questions and Visualizations for Generative AIcited by 0
- 2025CycleChart: A Unified Consistency-Based Learning Framework for Bidirectional Chart Understanding and Generationcited by 0
- 2025NOVAID: Natural-language Observability Visualization Assistant for ITOps Dashboard Widget Generationcited by 0
- 2026DashArena: Benchmarking LLMs on Interactive Analytic Dashboard Generationcited by 0
- 2026DEEPCHART: How Far are LLMs from Faithful Data-Science Chart Generation?cited by 0
- 2026Beyond Static Charts: Can Language and Vision Language Models Generate Interactive Data Visualization Interfaces?cited by 0
- 2026DEEPCHART: How Far are LLMs from Faithful Data-Science Chart Generation?27 Aug 2026
- 2026Beyond Static Charts: Can Language and Vision Language Models Generate Interactive Data Visualization Interfaces?11 Aug 2026
- 2026DashArena: Benchmarking LLMs on Interactive Analytic Dashboard Generation11 Aug 2026
- 2026VisEditBench: Can Vision-Language Models Edit Visualization Code from Multimodal Feedback?11 Aug 2026
- 2026AnnoBench: A Benchmark for Visualization Annotation Generation28 Jul 2026
- 2026Making Multimodal LLMs Reliable Chart Data Extractors: A Benchmark and Training Framework29 Jun 2026
- 2026Beyond NL2Code: A Structured Survey of Multimodal Code Intelligence14 Jun 2026
- 2026Lexara: A User-Centered Toolkit for Evaluating Large Language Models for Conversational Visual Analytics6 Mar 2026
- 2026Aligning Text, Code, and Vision: A Multi-Objective Reinforcement Learning Framework for Text-to-Visualization8 Jan 2026
- 2025CycleChart: A Unified Consistency-Based Learning Framework for Bidirectional Chart Understanding and Generation22 Dec 2025
- 2025NOVAID: Natural-language Observability Visualization Assistant for ITOps Dashboard Widget Generation20 Nov 2025
- 2025VisCoder2: Building Multi-Language Visualization Coding Agents24 Oct 2025
16 more
- 2025GQVis: A Dataset of Genomics Data Questions and Visualizations for Generative AI19 Sep 2025
- 2025VIS-Shepherd: Constructing Critic for LLM-based Data Visualization Generation16 Jun 2025
- 2025Measuring Data Science Automation: A Survey of Evaluation Tools for AI Assistants and Agents10 Jun 2025
- 2025Multi-Agent Actor-Critic Generative AI for Query Resolution and Analysis17 Feb 2025
- 2025Transforming Science with Large Language Models: A Survey on AI-assisted Scientific Discovery, Experimentation, Content Generation, and Evaluation7 Feb 2025
- 2025nvAgent: Automated Data Visualization from Natural Language via Collaborative Agent Workflow7 Feb 2025
- 2024Drawing Pandas: A Benchmark for LLMs in Generating Plotting Code3 Dec 2024
- 2024Data Analysis in the Era of Generative AI27 Sep 2024
- 2024HAIChart: Human and AI Paired Visualization System16 Jun 2024
- 2024ChartInsights: Evaluating Multimodal Large Language Models for Low-Level Chart Question Answering11 May 2024
- 2024Vi(E)va LLM! A Conceptual Stack for Evaluating and Interpreting Generative AI-based Visualizations3 Feb 2024
- 2024FinDABench: Benchmarking Financial Data Analysis Ability of Large Language Models1 Jan 2024
- 2023Natural Language Interfaces for Tabular Data Querying and Visualization: A Survey27 Oct 2023
- 2023Natural Language Models for Data Visualization Utilizing nvBench Dataset2 Oct 2023
- 2023Summary of ChatGPT-Related Research and Perspective Towards the Future of Large Language Models4 Apr 2023
- 2023XNLI: Explaining and Diagnosing NLI-based Visual Data Analysis25 Jan 2023
- 2024ChartInsights: Evaluating Multimodal Large Language Models for Low-Level Chart Question Answeringcited by 50
- 2025Transforming Science with Large Language Models: A Survey on AI-assisted Scientific Discovery, Experimentation, Content Generation, and Evaluationcited by 42
- 2026VisEditBench: Can Vision-Language Models Edit Visualization Code from Multimodal Feedback?cited by 4
- 2026Making Multimodal LLMs Reliable Chart Data Extractors: A Benchmark and Training Frameworkcited by 2
- 2026Beyond Static Charts: Can Language and Vision Language Models Generate Interactive Data Visualization Interfaces?cited by 0
- 2026Beyond Static Charts: Can Language and Vision Language Models Generate Interactive Data Visualization Interfaces?11 Aug 2026
- 2026VisEditBench: Can Vision-Language Models Edit Visualization Code from Multimodal Feedback?11 Aug 2026
- 2026Making Multimodal LLMs Reliable Chart Data Extractors: A Benchmark and Training Framework29 Jun 2026
- 2025Transforming Science with Large Language Models: A Survey on AI-assisted Scientific Discovery, Experimentation, Content Generation, and Evaluation7 Feb 2025
- 2024ChartInsights: Evaluating Multimodal Large Language Models for Low-Level Chart Question Answering11 May 2024
- 2023Summary of ChatGPT-Related Research and Perspective Towards the Future of Large Language Modelscited by 154
- 2023Natural Language Interfaces for Tabular Data Querying and Visualization: A Surveycited by 27
- 2024HAIChart: Human and AI Paired Visualization Systemcited by 26
- 2024Drawing Pandas: A Benchmark for LLMs in Generating Plotting Codecited by 23
- 2023XNLI: Explaining and Diagnosing NLI-based Visual Data Analysiscited by 19
- 2024FinDABench: Benchmarking Financial Data Analysis Ability of Large Language Modelscited by 11
- 2024Vi(E)va LLM! A Conceptual Stack for Evaluating and Interpreting Generative AI-based Visualizationscited by 10
- 2025VIS-Shepherd: Constructing Critic for LLM-based Data Visualization Generationcited by 9
- 2024Data Analysis in the Era of Generative AIcited by 6
- 2026Beyond NL2Code: A Structured Survey of Multimodal Code Intelligencecited by 6
- 2023Natural Language Models for Data Visualization Utilizing nvBench Datasetcited by 3
- 2025Multi-Agent Actor-Critic Generative AI for Query Resolution and Analysiscited by 3
12 most cited of 20 All 20 (JSON)
- 2026DEEPCHART: How Far are LLMs from Faithful Data-Science Chart Generation?27 Aug 2026
- 2026DashArena: Benchmarking LLMs on Interactive Analytic Dashboard Generation11 Aug 2026
- 2026AnnoBench: A Benchmark for Visualization Annotation Generation28 Jul 2026
- 2026Beyond NL2Code: A Structured Survey of Multimodal Code Intelligence14 Jun 2026
- 2026Lexara: A User-Centered Toolkit for Evaluating Large Language Models for Conversational Visual Analytics6 Mar 2026
- 2026Aligning Text, Code, and Vision: A Multi-Objective Reinforcement Learning Framework for Text-to-Visualization8 Jan 2026
- 2025CycleChart: A Unified Consistency-Based Learning Framework for Bidirectional Chart Understanding and Generation22 Dec 2025
- 2025NOVAID: Natural-language Observability Visualization Assistant for ITOps Dashboard Widget Generation20 Nov 2025
- 2025GQVis: A Dataset of Genomics Data Questions and Visualizations for Generative AI19 Sep 2025
- 2025VIS-Shepherd: Constructing Critic for LLM-based Data Visualization Generation16 Jun 2025
- 2025Multi-Agent Actor-Critic Generative AI for Query Resolution and Analysis17 Feb 2025
- 2024Drawing Pandas: A Benchmark for LLMs in Generating Plotting Code3 Dec 2024
12 newest of 20 All 20 (JSON)