mlsanityData to 7 Oct 2026

The Role of Interactive Visualization in Explaining (Large) NLP Models: from Data to Inference

arXiv 2301.04528 ↗First posted 11 Jan 2023cs.CL cs.HCcited by 9

Not on the map. Why?

Abstract (arXiv)

With a constant increase of learned parameters, modern neural language models become increasingly more powerful. Yet, explaining these complex model's behavior remains a widely unsolved problem. In this paper, we discuss the role interactive visualization can play in explaining NLP models (XNLP). We motivate the use of visualization in relation to target users and common NLP pipelines. We also present several use cases to provide concrete examples on XNLP with visualization. Finally, we point out an extensive list of research opportunities in this field.

Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Builds on 25 of its 52 references that are in the map. First posted on arXiv 11 Jan 2023.

Builds on

25 of 52 references.

References · 25

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2020Language Models are Few-Shot Learnerscited by 32,199
  4. 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,304
  5. 2022OPT: Open Pre-trained Transformer Language Modelscited by 3,464
  6. 2019Language Models as Knowledge Bases?cited by 1,922
  7. 2021Multitask Prompted Training Enables Zero-Shot Task Generalizationcited by 1,462
  8. 2018Model Cards for Model Reportingcited by 1,068
  9. 2019BERT Rediscovers the Classical NLP Pipelinecited by 1,046
  10. 2020Beyond Accuracy: Behavioral Testing of NLP models with CheckListcited by 979
  11. 2019GLTR: Statistical Detection and Visualization of Generated Textcited by 490
  12. 2019What do you learn from context? Probing for sentence structure in contextualized word representationscited by 436
13 more
  1. 2019A Multiscale Visualization of Attention in the Transformer Modelcited by 292
  2. 2020A Survey on Neural Network Interpretabilitycited by 291
  3. 2018Analysis Methods in Neural Language Processing: A Surveycited by 276
  4. 2020A Survey of the State of Explainable AI for Natural Language Processingcited by 206
  5. 2017What do Neural Machine Translation Models Learn about Morphology?cited by 165
  6. 2020The Language Interpretability Tool: Extensible, Interactive Visualizations and Analysis for NLP Modelscited by 125
  7. 2018Seq2Seq-Vis: A Visual Debugging Tool for Sequence-to-Sequence Modelscited by 69
  8. 2022Interactive Model Cards: A Human-Centered Approach to Model Documentationcited by 61
  9. 2020Attention Flows: Analyzing and Comparing Attention Mechanisms in Language Modelscited by 49
  10. 2021Controlling Hallucinations at Word Level in Data-to-Text Generationcited by 41
  11. 2021The Low-Dimensional Linear Geometry of Contextualized Word Representationscited by 39
  12. 2019Embedding Comparator: Visualizing Differences in Global Structure and Local Neighborhoods via Small Multiplescited by 38
  13. 2018NeuroX: A Toolkit for Analyzing Individual Neurons in Neural Networkscited by 31

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 1; 2024: 6; 2025: 1; 2026: 1.

9 papers.