The Role of Interactive Visualization in Explaining (Large) NLP Models: from Data to Inference
Not on the map. Why?
Abstract (arXiv)
With a constant increase of learned parameters, modern neural language models become increasingly more powerful. Yet, explaining these complex model's behavior remains a widely unsolved problem. In this paper, we discuss the role interactive visualization can play in explaining NLP models (XNLP). We motivate the use of visualization in relation to target users and common NLP pipelines. We also present several use cases to provide concrete examples on XNLP with visualization. Finally, we point out an extensive list of research opportunities in this field.
Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Builds on 25 of its 52 references that are in the map. First posted on arXiv 11 Jan 2023.
Builds on
25 of 52 references.
References · 25
- 2017Attention Is All You Needcited by 59,932
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,304
- 2022OPT: Open Pre-trained Transformer Language Modelscited by 3,464
- 2019Language Models as Knowledge Bases?cited by 1,922
- 2021Multitask Prompted Training Enables Zero-Shot Task Generalizationcited by 1,462
- 2018Model Cards for Model Reportingcited by 1,068
- 2019BERT Rediscovers the Classical NLP Pipelinecited by 1,046
- 2020Beyond Accuracy: Behavioral Testing of NLP models with CheckListcited by 979
- 2019GLTR: Statistical Detection and Visualization of Generated Textcited by 490
- 2019What do you learn from context? Probing for sentence structure in contextualized word representationscited by 436
13 more
- 2019A Multiscale Visualization of Attention in the Transformer Modelcited by 292
- 2020A Survey on Neural Network Interpretabilitycited by 291
- 2018Analysis Methods in Neural Language Processing: A Surveycited by 276
- 2020A Survey of the State of Explainable AI for Natural Language Processingcited by 206
- 2017What do Neural Machine Translation Models Learn about Morphology?cited by 165
- 2020The Language Interpretability Tool: Extensible, Interactive Visualizations and Analysis for NLP Modelscited by 125
- 2018Seq2Seq-Vis: A Visual Debugging Tool for Sequence-to-Sequence Modelscited by 69
- 2022Interactive Model Cards: A Human-Centered Approach to Model Documentationcited by 61
- 2020Attention Flows: Analyzing and Comparing Attention Mechanisms in Language Modelscited by 49
- 2021Controlling Hallucinations at Word Level in Data-to-Text Generationcited by 41
- 2021The Low-Dimensional Linear Geometry of Contextualized Word Representationscited by 39
- 2019Embedding Comparator: Visualizing Differences in Global Structure and Local Neighborhoods via Small Multiplescited by 38
- 2018NeuroX: A Toolkit for Analyzing Individual Neurons in Neural Networkscited by 31
Built on by
Citing papers per year: 2023: 1; 2024: 6; 2025: 1; 2026: 1.
9 papers.
- 2024LLM Comparator: Visual Analytics for Side-by-Side Evaluation of Large Language Modelscited by 29
- 2024Automatic Histograms: Leveraging Language Models for Text Dataset Explorationcited by 8
- 2024Understanding Large Language Model Behaviors through Interactive Counterfactual Generation and Analysiscited by 8
- 2024Talaria: Interactively Optimizing Machine Learning Models for Efficient Inferencecited by 6
- 2024Exploring Empty Spaces: Human-in-the-Loop Data Augmentationcited by 6
- 2024The Evolution of LLM Adoption in Industry Data Curation Practicescited by 6
- 2023Visualizing Linguistic Diversity of Text Datasets Synthesized by Large Language Modelscited by 4
- 2026RAGExplorer: A Visual Analytics System for the Comparative Diagnosis of RAG Systemscited by 2
- 2025A Visual Tool for Interactive Model Explanation using Sensitivity Analysiscited by 0
- 2026RAGExplorer: A Visual Analytics System for the Comparative Diagnosis of RAG Systems19 Jan 2026
- 2025A Visual Tool for Interactive Model Explanation using Sensitivity Analysis6 Aug 2025
- 2024The Evolution of LLM Adoption in Industry Data Curation Practices20 Dec 2024
- 2024Exploring Empty Spaces: Human-in-the-Loop Data Augmentation1 Oct 2024
- 2024Understanding Large Language Model Behaviors through Interactive Counterfactual Generation and Analysis23 Apr 2024
- 2024Talaria: Interactively Optimizing Machine Learning Models for Efficient Inference3 Apr 2024
- 2024Automatic Histograms: Leveraging Language Models for Text Dataset Exploration21 Feb 2024
- 2024LLM Comparator: Visual Analytics for Side-by-Side Evaluation of Large Language Models16 Feb 2024
- 2023Visualizing Linguistic Diversity of Text Datasets Synthesized by Large Language Models19 May 2023