mlsanityData to 14 Oct 2026

LIDA: A Tool for Automatic Generation of Grammar-Agnostic Visualizations and Infographics using Large Language Models

arXiv 2303.02927 ↗First posted 6 Mar 2023cs.AI cs.HC cs.PLcited by 82

Not on the map. Why?

Cited by 24 in LLM agents and tool use, but placed by its own abstract, which didn’t fit.

Abstract (arXiv)

Systems that support users in the automatic creation of visualizations must address several subtasks - understand the semantics of data, enumerate relevant visualization goals and generate visualization specifications. In this work, we pose visualization generation as a multi-stage generation problem and argue that well-orchestrated pipelines based on large language models (LLMs) such as ChatGPT/GPT-4 and image generation models (IGMs) are suitable to addressing these tasks. We present LIDA, a novel tool for generating grammar-agnostic visualizations and infographics. LIDA comprises of 4 modules - A SUMMARIZER that converts data into a rich but compact natural language summary, a GOAL EXPLORER that enumerates visualization goals given the data, a VISGENERATOR that generates, refines, executes and filters visualization code and an INFOGRAPHER module that yields data-faithful stylized graphics using IGMs. LIDA provides a python api, and a hybrid user interface (direct manipulation and multilingual natural language) for interactive chart, infographics and data story generation. Learn more about the project here - https://microsoft.github.io/lida/

Key facts. Cited by 82 papers in the map (data through 14 Oct 2026). Builds on 31 of its 48 references that are in the map. First posted on arXiv 6 Mar 2023.

Builds on

31 of 48 references.

References · 31

  1. 2017Attention Is All You Needcited by 60,361
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  3. 2020Language Models are Few-Shot Learnerscited by 32,419
  4. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  5. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
  6. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
  7. 2021Evaluating Large Language Models Trained on Codecited by 8,320
  8. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,585
  9. 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,708
  10. 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,326
  11. 2022Large Language Models are Zero-Shot Reasonerscited by 4,374
  12. 2021Zero-Shot Text-to-Image Generationcited by 4,288
19 more
  1. 2021On the Opportunities and Risks of Foundation Modelscited by 4,033
  2. 2022OPT: Open Pre-trained Transformer Language Modelscited by 3,512
  3. 2022Language Models (Mostly) Know What They Knowcited by 1,856
  4. 2022Competition-Level Code Generation with AlphaCodecited by 1,462
  5. 2022LaMDA: Language Models for Dialog Applicationscited by 1,220
  6. 2022Teaching Models to Express Their Uncertainty in Wordscited by 751
  7. 2022PAL: Program-aided Language Modelscited by 652
  8. 2022Language Models are Multilingual Chain-of-Thought Reasonerscited by 530
  9. 2022InCoder: A Generative Model for Code Infilling and Synthesiscited by 498
  10. 2023Augmented Language Models: a Surveycited by 403
  11. 2022Efficient Training of Language Models to Fill in the Middlecited by 255
  12. 2020NL4DV: A Toolkit for Generating Analytic Specifications for Data Visualization from Natural Language Queriescited by 74
  13. 2018Data2Vis: Automatic Generation of Data Visualizations Using Sequence to Sequence Recurrent Neural Networkscited by 48
  14. 2022Towards Natural Language-Based Visualization Authoringcited by 22
  15. 2022Facilitating Conversational Interaction in Natural Language Interfaces for Visualizationcited by 12
  16. 2022Type-Directed Synthesis of Visualizations from Natural Language Queriescited by 5
  17. 2023Agnostic Visual Recommendation Systems: Open Challenges and Future Directionscited by 4
  18. 2019Sato: Contextual Semantic Type Detection in Tablescited by 3
  19. 2021User-Centric Semi-Automated Infographics Authoring and Recommendationcited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2023: 7; 2024: 19; 2025: 32; 2026: 24.

82 papers.

Sort:

By area:

  1. 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversationcited by 1,988
  2. 2024Rethinking Interpretability in the Era of Large Language Modelscited by 111
  3. 2024BLADE: Benchmarking Language Model Agents for Data-Driven Sciencecited by 77
  4. 2023Data-Copilot: Bridging Billions of Data and Humans with Autonomous Workflowcited by 76
  5. 2024VisEval: A Benchmark for Data Visualization in the Era of Large Language Modelscited by 45
  6. 2023Data Formulator: AI-powered Concept-driven Visualization Authoringcited by 32
  7. 2026PaperBanana: Automating Academic Illustration for AI Scientistscited by 26
  8. 2024Generative AI for Visualization: State of the Art and Future Directionscited by 23
  9. 2023AVA: Towards Autonomous Visualization Agents through Visual Perception-Driven Decision-Makingcited by 21
  10. 2024LightVA: Lightweight Visual Analytics with LLM Agent-Based Task Planning and Executioncited by 20
  11. 2024From Data to Story: Towards Automatic Animated Data Video Creation with LLM-based Multi-Agent Systemscited by 16
  12. 2024The Synergy between Data and Multi-Modal Large Language Models: A Survey from Co-Development Perspectivecited by 15
38 more
  1. 2025ProactiveVA: Proactive Visual Analytics with LLM-Based UI Agentcited by 14
  2. 2023Where Are We So Far? Understanding Data Storytelling Tools from the Perspective of Human-AI Collaborationcited by 13
  3. 2025InterChat: Enhancing Generative Visual Analytics using Multimodal Interactionscited by 13
  4. 2025AstroVisBench: A Code Benchmark for Scientific Computing and Visualization in Astronomycited by 13
  5. 2024BISCUIT: Scaffolding LLM-Generated Code with Ephemeral UIs in Computational Notebookscited by 12
  6. 2026SciVisAgentBench: A Benchmark for Evaluating Scientific Data Analysis and Visualization Agentscited by 10
  7. 2024A Review of Multimodal Explainable Artificial Intelligence: Past, Present and Futurecited by 9
  8. 2025ChartInsighter: An Approach for Mitigating Hallucination in Time-series Chart Summary Generation with A Benchmark Datasetcited by 9
  9. 2025VIS-Shepherd: Constructing Critic for LLM-based Data Visualization Generationcited by 9
  10. 2024DataLab: A Unified Platform for LLM-Powered Business Intelligencecited by 8
  11. 2025SPIO: Ensemble and Selective Strategies via LLM-Based Multi-Agent Planning in Automated Data Sciencecited by 7
  12. 2025Just-In-Time Objectives: A General Approach for Specialized AI Interactionscited by 7
  13. 2024Data Analysis in the Era of Generative AIcited by 6
  14. 2024Natural Language Generation for Visualizations: State of the Art, Challenges and Future Directionscited by 6
  15. 2025Explainable XR: Understanding User Behaviors of XR Environments using LLM-assisted Analytics Frameworkcited by 6
  16. 2025Charts-of-Thought: Enhancing LLM Visualization Literacy Through Structured Data Extractioncited by 6
  17. 2025Generative Interfaces for Language Modelscited by 6
  18. 2025VisCoder2: Building Multi-Language Visualization Coding Agentscited by 6
  19. 2025Exploring Multimodal Prompt for Visualization Authoring with Large Language Modelscited by 5
  20. 2025AuraGenome: An LLM-Powered Framework for On-the-Fly Reusable and Scalable Circular Genome Visualizationscited by 5
  21. 2025Evaluating LLMs for Visualization Generation and Understandingcited by 5
  22. 2023Capture the Flag: Uncovering Data Insights with Large Language Modelscited by 4
  23. 2024Had enough of experts? Quantitative knowledge retrieval from large language modelscited by 4
  24. 2024V-RECS, a Low-Cost LLM4VIS Recommender with Explanations, Captioning and Suggestionscited by 4
  25. 2025Measuring Data Science Automation: A Survey of Evaluation Tools for AI Assistants and Agentscited by 4
  26. 2025ReTrace: Interactive Visualizations for Reasoning Traces of Large Reasoning Modelscited by 3
  27. 2026MultiVis-Agent: A Multi-Agent Framework with Logic Rules for Reliable and Comprehensive Cross-Modal Data Visualizationcited by 3
  28. 2024LLM-Assisted Visual Analytics: Opportunities and Challengescited by 2
  29. 2025ReSpark: Leveraging Previous Data Reports as References to Generate New Reports with LLMscited by 2
  30. 2025PublicAgent: Multi-Agent Design Principles From an LLM-Based Open Data Analysis Frameworkcited by 2
  31. 2026HiLSVA: Design and Evaluation of a Human-in-the-Loop Agentic System for Scientific Visualizationcited by 2
  32. 2023Anticipating User Needs: Insights from Design Fiction on Conversational Agents for Computational Thinkingcited by 1
  33. 2025MDSF: Context-Aware Multi-Dimensional Data Storytelling Framework based on Large language Modelcited by 1
  34. 2025Reflection on Data Storytelling Tools in the Generative AI Era from the Human-AI Collaboration Perspectivecited by 1
  35. 2025A Review on Large Language Models for Visual Analyticscited by 1
  36. 2025DashChat: Interactive Authoring of Performance Dashboard Design Prototypes through Conversation with LLM-Powered Agentcited by 1
  37. 2025Capturing Visualization Design Rationalecited by 1
  38. 2025Story Ribbons: Reimagining Storyline Visualizations with Large Language Modelscited by 1

50 most cited of 82 All 82 (JSON)