ViT-Explainer: An Interactive Walkthrough of the Vision Transformer Pipeline
Not on the map. Why?
Abstract (arXiv)
Transformer-based architectures have become the shared backbone of natural language processing and computer vision. However, understanding how these models operate remains challenging, particularly in vision settings, where images are processed as sequences of patch tokens. Existing interpretability tools often focus on isolated components or expert-oriented analysis, leaving a gap in guided, end-to-end understanding of the full inference pipeline. To bridge this gap, we present ViT-Explainer, a web-based interactive system that provides an integrated visualization of Vision Transformer inference, from patch tokenization to final classification. The system combines animated walkthroughs, patch-level attention overlays, and a vision-adapted Logit Lens within both guided and free exploration modes. A user study with six participants suggests that ViT-Explainer is easy to learn and use, helping users interpret and understand Vision Transformer behavior.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 15 of its 25 references that are in the map. First posted on arXiv 2 Apr 2026.
Builds on
15 of 25 references.
References · 15
- 2017Attention Is All You Needcited by 59,932
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2020Transformer Feed-Forward Layers Are Key-Value Memoriescited by 1,307
- 2019What Does BERT Look At? An Analysis of BERT's Attentioncited by 994
- 2023Eliciting Latent Predictions from Transformers with the Tuned Lenscited by 579
- 2019A Multiscale Visualization of Attention in the Transformer Modelcited by 292
- 2020A Survey on Neural Network Interpretabilitycited by 291
- 2020CNN Explainer: Learning Convolutional Neural Networks with Interactive Visualizationcited by 57
- 2022VL-InterpreT: An Interactive Visualization Tool for Interpreting Vision-Language Transformerscited by 53
- 2023How Does Attention Work in Vision Transformers? A Visual Analytics Attemptcited by 29
- 2021Dodrio: Exploring Transformer Models with Interactive Visualizationcited by 28
- 2022Visualizing and Understanding Patch Interactions in Vision Transformercited by 26
Built on by
Not cited yet.