mlsanityData to 14 Oct 2026

A Review on Large Language Models for Visual Analytics

arXiv 2503.15176 ↗First posted 19 Mar 2025cs.HC cs.CL cs.CVcited by 1

Not on the map. Why?

Abstract (arXiv)

This paper provides a comprehensive review of the integration of Large Language Models (LLMs) with visual analytics, addressing their foundational concepts, capabilities, and wide-ranging applications. It begins by outlining the theoretical underpinnings of visual analytics and the transformative potential of LLMs, specifically focusing on their roles in natural language understanding, natural language generation, dialogue systems, and text-to-media transformations. The review further investigates how the synergy between LLMs and visual analytics enhances data interpretation, visualization techniques, and interactive exploration capabilities. Key tools and platforms including LIDA, Chat2VIS, Julius AI, and Zoho Analytics, along with specialized multimodal models such as ChartLlama and CharXIV, are critically evaluated. The paper discusses their functionalities, strengths, and limitations in supporting data exploration, visualization enhancement, automated reporting, and insight extraction. The taxonomy of LLM tasks, ranging from natural language understanding (NLU), natural language generation (NLG), to dialogue systems and text-to-media transformations, is systematically explored. This review provides a SWOT analysis of integrating Large Language Models (LLMs) with visual analytics, highlighting strengths like accessibility and flexibility, weaknesses such as computational demands and biases, opportunities in multimodal integration and user collaboration, and threats including privacy concerns and skill degradation. It emphasizes addressing ethical considerations and methodological improvements for effective integration.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 72 of its 123 references that are in the map. First posted on arXiv 19 Mar 2025.

Builds on

72 of 123 references.

References · 72

  1. 2017Attention Is All You Needcited by 60,361
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  3. 2020Language Models are Few-Shot Learnerscited by 32,419
  4. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  5. 2023GPT-4 Technical Reportcited by 18,396
  6. 2022Training language models to follow instructions with human feedbackcited by 15,971
  7. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
  8. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
  9. 2021Evaluating Large Language Models Trained on Codecited by 8,320
  10. 2023Visual Instruction Tuningcited by 7,869
  11. 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,326
  12. 2014Neural Machine Translation by Jointly Learning to Align and Translatecited by 4,548
38 more
  1. 2022Flamingo: a Visual Language Model for Few-Shot Learningcited by 4,386
  2. 2013Efficient Estimation of Word Representations in Vector Spacecited by 4,375
  3. 2014Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translationcited by 4,057
  4. 2021On the Opportunities and Risks of Foundation Modelscited by 4,033
  5. 2022BLOOM: A 176B-Parameter Open-Access Multilingual Language Modelcited by 1,984
  6. 2020mT5: A massively multilingual pre-trained text-to-text transformercited by 1,818
  7. 2021WebGPT: Browser-assisted question-answering with human feedbackcited by 1,745
  8. 2022ChartQA: A Benchmark for Question Answering about Charts with Visual and Logical Reasoningcited by 1,479
  9. 2023Video-LLaMA: An Instruction-tuned Audio-Visual Language Model for Video Understandingcited by 1,471
  10. 2022LaMDA: Language Models for Dialog Applicationscited by 1,220
  11. 2021Scaling Language Models: Methods, Analysis & Insights from Training Gophercited by 1,202
  12. 2021Ethical and social risks of harm from Language Modelscited by 966
  13. 2023BloombergGPT: A Large Language Model for Financecited by 939
  14. 2023Instruction Tuning with GPT-4cited by 686
  15. 2022Towards Reasoning in Large Language Models: A Surveycited by 596
  16. 2023How Good Are GPT Models at Machine Translation? A Comprehensive Evaluationcited by 348
  17. 2017FigureQA: An Annotated Figure Dataset for Visual Reasoningcited by 319
  18. 2024CharXiv: Charting Gaps in Realistic Chart Understanding in Multimodal LLMscited by 234
  19. 2023ChartLlama: A Multimodal LLM for Chart Understanding and Generationcited by 163
  20. 2021PanGu-α: Large-scale Autoregressive Pretrained Chinese Language Models with Auto-parallel Computationcited by 134
  21. 2023BuboGPT: Enabling Visual Grounding in Multi-Modal LLMscited by 114
  22. 2020AVLnet: Learning Audio-Visual Language Representations from Instructional Videoscited by 111
  23. 2023Foundational Models Defining a New Era in Vision: A Survey and Outlookcited by 110
  24. 2023LIDA: A Tool for Automatic Generation of Grammar-Agnostic Visualizations and Infographics using Large Language Modelscited by 82
  25. 2023ChartGPT: Leveraging LLMs to Generate Charts from Abstract Natural Languagecited by 73
  26. 2024Hypothesis Generation with Large Language Modelscited by 71
  27. 2018Seq2Seq-Vis: A Visual Debugging Tool for Sequence-to-Sequence Modelscited by 69
  28. 2023Promptify: Text-to-Image Generation through Interactive Prompt Exploration with Large Language Modelscited by 67
  29. 2023Automating Customer Service using LangChain: Building custom open-source GPT Chatbot for organizationscited by 61
  30. 2021Towards Natural Language Interfaces for Data Visualization: A Surveycited by 59
  31. 2023Chat2VIS: Generating Data Visualisations via Natural Language using ChatGPT, Codex and GPT-3 Large Language Modelscited by 59
  32. 2024Koala: Key frame-conditioned long video-LLMcited by 57
  33. 2021CPM-2: Large-scale Cost-effective Pre-trained Language Modelscited by 52
  34. 2021Named Entity Recognition and Classification on Historical Documents: A Surveycited by 47
  35. 2023Visual cognition in multimodal large language modelscited by 38
  36. 2025Visual Large Language Models for Generalized and Specialized Applicationscited by 36
  37. 2023How Do Analysts Understand and Verify AI-Assisted Data Analyses?cited by 26
  38. 2024Can Large Language Models Understand Context?cited by 26

50 most cited of 72 All 72 (JSON)

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.