VizML: A Machine Learning Approach to Visualization Recommendation
Not on the map. Why?
Abstract (arXiv)
Data visualization should be accessible for all analysts with data, not just the few with technical expertise. Visualization recommender systems aim to lower the barrier to exploring basic visualizations by automatically generating results for analysts to search and select, rather than manually specify. Here, we demonstrate a novel machine learning-based approach to visualization recommendation that learns visualization design choices from a large corpus of datasets and associated visualizations. First, we identify five key design choices made by analysts while creating visualizations, such as selecting a visualization type and choosing to encode a column along the X- or Y-axis. We train models to predict these design choices using one million dataset-visualization pairs collected from a popular online visualization platform. Neural networks predict these design choices with high accuracy compared to baseline models. We report and interpret feature importances from one of these baseline models. To evaluate the generalizability and uncertainty of our approach, we benchmark with a crowdsourced test set, and show that the performance of our model is comparable to human performance when predicting consensus visualization type, and exceeds that of other ML-based systems.
Key facts. Cited by 38 papers in the map (data through 7 Oct 2026). First posted on arXiv 14 Aug 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 9; 2022: 7; 2023: 4; 2024: 9; 2025: 5; 2026: 4.
38 papers.
Sort:
By area:
- 2022Fine-tuning language models to find agreement among humans with diverse preferencescited by 189
- 2024VisEval: A Benchmark for Data Visualization in the Era of Large Language Modelscited by 43
- 2022Table Pre-training: A Survey on Model Architectures, Pre-training Objectives, and Downstream Taskscited by 42
- 2021nvBench: A Large-Scale Synthesized Dataset for Cross-Domain Natural Language to Visualization Taskcited by 27
- 2024Advancing Multimodal Large Language Models in Chart Question Answering with Visualization-Referenced Instruction Tuningcited by 27
- 2022Chart Question Answering: State of the Art and Future Directionscited by 26
- 2024HAIChart: Human and AI Paired Visualization Systemcited by 26
- 2023LLM4Vis: Explainable Visualization Recommendation using ChatGPTcited by 25
- 2024Generative AI for Visualization: State of the Art and Future Directionscited by 23
- 2024LightVA: Lightweight Visual Analytics with LLM Agent-Based Task Planning and Executioncited by 20
- 2023Where Are We So Far? Understanding Data Storytelling Tools from the Perspective of Human-AI Collaborationcited by 13
- 2025ParaView-MCP: An Autonomous Visualization Agent with Direct Tool Usecited by 11
26 more
- 2021EDAssistant: Supporting Exploratory Data Analysis in Computational Notebooks with In-Situ Code Search and Recommendationcited by 8
- 2025SimVecVis: A Dataset for Enhancing MLLMs in Visualization Understandingcited by 5
- 2023Agnostic Visual Recommendation Systems: Open Challenges and Future Directionscited by 4
- 2023AdaTyper: Adaptive Semantic Column Type Detectioncited by 4
- 2022Infographics Wizard: Flexible Infographics Authoring and Design Explorationcited by 3
- 2024V-RECS, a Low-Cost LLM4VIS Recommender with Explanations, Captioning and Suggestionscited by 3
- 2025Generalization of CNNs on Relational Reasoning with Bar Chartscited by 3
- 2021Personalized Visualization Recommendationcited by 2
- 2021User-Centric Semi-Automated Infographics Authoring and Recommendationcited by 2
- 2024ChartKG: A Knowledge-Graph-Based Representation for Chart Imagescited by 2
- 2026Making Multimodal LLMs Reliable Chart Data Extractors: A Benchmark and Training Frameworkcited by 2
- 2021Making Table Understanding Work in Practicecited by 1
- 2021VizAI : Selecting Accurate Visualizations of Numerical Datacited by 1
- 2024Exploratory Visual Analysis for Increasing Data Readiness in Artificial Intelligence Projectscited by 1
- 2021Insight-centric Visualization Recommendationcited by 0
- 2021MitoVis: A Visually-guided Interactive Intelligent System for Neuronal Mitochondria Analysiscited by 0
- 2021Route Optimization via Environment-Aware Deep Network and Reinforcement Learningcited by 0
- 2022AutoCl : A Visual Interactive System for Automatic Deep Learning Classifier Recommendation Based on Models Performancecited by 0
- 2022Addressing Bias in Visualization Recommenders by Identifying Trends in Training Data: Improving VizML Through a Statistical Analysis of the Plotly Community Feedcited by 0
- 2022ASTA: Learning Analytical Semantics over Tables for Intelligent Data Analysis and Visualizationcited by 0
- 2024Crafting Tomorrow: The Influence of Design Choices on Fresh Content in Social Media Recommendationcited by 0
- 2025A Data Aggregation Visualization System supported by Processing-in-Memorycited by 0
- 2025Data Therapist: Eliciting Domain Knowledge from Subject Matter Experts Using Large Language Modelscited by 0
- 2026Show Me the Infographic I Imagine: Intent-Aware Infographic Retrieval for Authoring Supportcited by 0
- 2026Crystalis: Progressive Nucleation and Semantic Annealing for Coordinated Multi-View Visualization Generationcited by 0
- 2026DEEPCHART: How Far are LLMs from Faithful Data-Science Chart Generation?cited by 0
- 2026DEEPCHART: How Far are LLMs from Faithful Data-Science Chart Generation?27 Aug 2026
- 2026Making Multimodal LLMs Reliable Chart Data Extractors: A Benchmark and Training Framework29 Jun 2026
- 2026Crystalis: Progressive Nucleation and Semantic Annealing for Coordinated Multi-View Visualization Generation7 Jun 2026
- 2026Show Me the Infographic I Imagine: Intent-Aware Infographic Retrieval for Authoring Support9 Apr 2026
- 2025SimVecVis: A Dataset for Enhancing MLLMs in Visualization Understanding26 Jun 2025
- 2025ParaView-MCP: An Autonomous Visualization Agent with Direct Tool Use11 May 2025
- 2025Data Therapist: Eliciting Domain Knowledge from Subject Matter Experts Using Large Language Models1 May 2025
- 2025A Data Aggregation Visualization System supported by Processing-in-Memory11 Mar 2025
- 2025Generalization of CNNs on Relational Reasoning with Bar Charts28 Feb 2025
- 2024LightVA: Lightweight Visual Analytics with LLM Agent-Based Task Planning and Execution8 Nov 2024
- 2024Crafting Tomorrow: The Influence of Design Choices on Fresh Content in Social Media Recommendation19 Oct 2024
- 2024ChartKG: A Knowledge-Graph-Based Representation for Chart Images13 Oct 2024
26 more
- 2024Exploratory Visual Analysis for Increasing Data Readiness in Artificial Intelligence Projects5 Sep 2024
- 2024Advancing Multimodal Large Language Models in Chart Question Answering with Visualization-Referenced Instruction Tuning29 Jul 2024
- 2024VisEval: A Benchmark for Data Visualization in the Era of Large Language Models1 Jul 2024
- 2024V-RECS, a Low-Cost LLM4VIS Recommender with Explanations, Captioning and Suggestions21 Jun 2024
- 2024HAIChart: Human and AI Paired Visualization System16 Jun 2024
- 2024Generative AI for Visualization: State of the Art and Future Directions28 Apr 2024
- 2023AdaTyper: Adaptive Semantic Column Type Detection23 Nov 2023
- 2023LLM4Vis: Explainable Visualization Recommendation using ChatGPT11 Oct 2023
- 2023Where Are We So Far? Understanding Data Storytelling Tools from the Perspective of Human-AI Collaboration27 Sep 2023
- 2023Agnostic Visual Recommendation Systems: Open Challenges and Future Directions1 Feb 2023
- 2022Fine-tuning language models to find agreement among humans with diverse preferences28 Nov 2022
- 2022ASTA: Learning Analytical Semantics over Tables for Intelligent Data Analysis and Visualization1 Aug 2022
- 2022Chart Question Answering: State of the Art and Future Directions8 May 2022
- 2022Infographics Wizard: Flexible Infographics Authoring and Design Exploration21 Apr 2022
- 2022Addressing Bias in Visualization Recommenders by Identifying Trends in Training Data: Improving VizML Through a Statistical Analysis of the Plotly Community Feed9 Mar 2022
- 2022AutoCl : A Visual Interactive System for Automatic Deep Learning Classifier Recommendation Based on Models Performance24 Feb 2022
- 2022Table Pre-training: A Survey on Model Architectures, Pre-training Objectives, and Downstream Tasks24 Jan 2022
- 2021nvBench: A Large-Scale Synthesized Dataset for Cross-Domain Natural Language to Visualization Task24 Dec 2021
- 2021EDAssistant: Supporting Exploratory Data Analysis in Computational Notebooks with In-Situ Code Search and Recommendation15 Dec 2021
- 2021Route Optimization via Environment-Aware Deep Network and Reinforcement Learning16 Nov 2021
- 2021VizAI : Selecting Accurate Visualizations of Numerical Data7 Nov 2021
- 2021Making Table Understanding Work in Practice11 Sep 2021
- 2021MitoVis: A Visually-guided Interactive Intelligent System for Neuronal Mitochondria Analysis3 Sep 2021
- 2021User-Centric Semi-Automated Infographics Authoring and Recommendation26 Aug 2021
- 2021Insight-centric Visualization Recommendation21 Mar 2021
- 2021Personalized Visualization Recommendation12 Feb 2021
- 2024Advancing Multimodal Large Language Models in Chart Question Answering with Visualization-Referenced Instruction Tuningcited by 27
- 2025SimVecVis: A Dataset for Enhancing MLLMs in Visualization Understandingcited by 5
- 2026Making Multimodal LLMs Reliable Chart Data Extractors: A Benchmark and Training Frameworkcited by 2
- 2026Making Multimodal LLMs Reliable Chart Data Extractors: A Benchmark and Training Framework29 Jun 2026
- 2025SimVecVis: A Dataset for Enhancing MLLMs in Visualization Understanding26 Jun 2025
- 2024Advancing Multimodal Large Language Models in Chart Question Answering with Visualization-Referenced Instruction Tuning29 Jul 2024
- 2024VisEval: A Benchmark for Data Visualization in the Era of Large Language Modelscited by 43
- 2022Table Pre-training: A Survey on Model Architectures, Pre-training Objectives, and Downstream Taskscited by 42
- 2021nvBench: A Large-Scale Synthesized Dataset for Cross-Domain Natural Language to Visualization Taskcited by 27
- 2022Chart Question Answering: State of the Art and Future Directionscited by 26
- 2024HAIChart: Human and AI Paired Visualization Systemcited by 26
- 2023LLM4Vis: Explainable Visualization Recommendation using ChatGPTcited by 25
- 2024Generative AI for Visualization: State of the Art and Future Directionscited by 23
- 2023Where Are We So Far? Understanding Data Storytelling Tools from the Perspective of Human-AI Collaborationcited by 13
- 2021EDAssistant: Supporting Exploratory Data Analysis in Computational Notebooks with In-Situ Code Search and Recommendationcited by 8
- 2023Agnostic Visual Recommendation Systems: Open Challenges and Future Directionscited by 4
- 2023AdaTyper: Adaptive Semantic Column Type Detectioncited by 4
- 2022Infographics Wizard: Flexible Infographics Authoring and Design Explorationcited by 3
12 most cited of 32 All 32 (JSON)
- 2026DEEPCHART: How Far are LLMs from Faithful Data-Science Chart Generation?27 Aug 2026
- 2026Crystalis: Progressive Nucleation and Semantic Annealing for Coordinated Multi-View Visualization Generation7 Jun 2026
- 2026Show Me the Infographic I Imagine: Intent-Aware Infographic Retrieval for Authoring Support9 Apr 2026
- 2025Data Therapist: Eliciting Domain Knowledge from Subject Matter Experts Using Large Language Models1 May 2025
- 2025A Data Aggregation Visualization System supported by Processing-in-Memory11 Mar 2025
- 2025Generalization of CNNs on Relational Reasoning with Bar Charts28 Feb 2025
- 2024Crafting Tomorrow: The Influence of Design Choices on Fresh Content in Social Media Recommendation19 Oct 2024
- 2024ChartKG: A Knowledge-Graph-Based Representation for Chart Images13 Oct 2024
- 2024Exploratory Visual Analysis for Increasing Data Readiness in Artificial Intelligence Projects5 Sep 2024
- 2024VisEval: A Benchmark for Data Visualization in the Era of Large Language Models1 Jul 2024
- 2024V-RECS, a Low-Cost LLM4VIS Recommender with Explanations, Captioning and Suggestions21 Jun 2024
- 2024HAIChart: Human and AI Paired Visualization System16 Jun 2024
12 newest of 32 All 32 (JSON)