Seq2Seq-Vis: A Visual Debugging Tool for Sequence-to-Sequence Models
Not on the map. Why?
Abstract (arXiv)
Neural Sequence-to-Sequence models have proven to be accurate and robust for many sequence prediction tasks, and have become the standard approach for automatic translation of text. The models work in a five stage blackbox process that involves encoding a source sequence to a vector space and then decoding out to a new target sequence. This process is now standard, but like many deep learning methods remains quite difficult to understand or debug. In this work, we present a visual analysis tool that allows interaction with a trained sequence-to-sequence model through each stage of the translation process. The aim is to identify which patterns have been learned and to detect model errors. We demonstrate the utility of our tool through several real-world large-scale sequence-to-sequence use cases.
Key facts. Cited by 69 papers in the map (data through 7 Oct 2026). First posted on arXiv 25 Apr 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 11; 2022: 12; 2023: 19; 2024: 13; 2025: 7; 2026: 7.
69 papers.
Sort:
By area:
- 2023Explainability for Large Language Models: A Surveycited by 331
- 2021Post-hoc Interpretability for Neural NLP: A Surveycited by 155
- 2022Towards Faithful Model Explanation in NLP: A Surveycited by 129
- 2022Toward Transparent AI: A Survey on Interpreting the Inner Structures of Deep Neural Networkscited by 126
- 2021Interpretable Deep Learning: Interpretation, Interpretability, Trustworthiness, and Beyondcited by 116
- 2023AttentionViz: A Global View of Transformer Attentioncited by 50
- 2021Approximating How Single Head Attention Learnscited by 38
- 2022On the Explainability of Natural Language Processing Deep Modelscited by 37
- 2023VISIT: Visualizing and Interpreting the Semantic Information Flow of Transformerscited by 32
- 2022The State of the Art in Enhancing Trust in Machine Learning Models with the Use of Visualizationscited by 29
- 2023How Does Attention Work in Vision Transformers? A Visual Analytics Attemptcited by 29
- 2022ferret: a Framework for Benchmarking Explainers on Transformerscited by 26
38 more
- 2023Visual Analytics For Machine Learning: A Data Perspective Surveycited by 25
- 2023RELIC: Investigating Large Language Model Responses using Self-Consistencycited by 23
- 2021VisQA: X-raying Vision and Language Reasoning in Transformerscited by 19
- 2021Relating Neural Text Degeneration to Exposure Biascited by 19
- 2022Symphony: Composing Interactive Interfaces for Machine Learningcited by 18
- 2022A Unified Understanding of Deep NLP Models for Text Classificationcited by 18
- 2021LMdiff: A Visual Diff Tool to Compare Language Modelscited by 17
- 2022Diagnosing AI Explanation Methods with Folk Concepts of Behaviorcited by 15
- 2022Visual Comparison of Language Model Adaptationcited by 14
- 2021SummVis: Interactive Visual Analysis of Models, Data, and Evaluation for Text Summarizationcited by 13
- 2022Diagnosing Ensemble Few-Shot Classifierscited by 13
- 2021GenNI: Human-AI Collaboration for Data-Backed Text Generationcited by 11
- 2023Angler: Helping Machine Translation Practitioners Prioritize Model Improvementscited by 11
- 2024Computational Experiments Meet Large Language Model Based Agents: A Survey and Perspectivecited by 11
- 2025Interpretation Meets Safety: A Survey on Interpretation Methods and Tools for Improving LLM Safetycited by 10
- 2023The Role of Interactive Visualization in Explaining (Large) NLP Models: from Data to Inferencecited by 9
- 2024Understanding Large Language Model Behaviors through Interactive Counterfactual Generation and Analysiscited by 8
- 2021AdViCE: Aggregated Visual Counterfactual Explanations for Machine Learning Model Validationcited by 7
- 2023Automatically Summarizing Evidence from Clinical Trials: A Prototype Highlighting Current Challengescited by 7
- 2024KnowledgeVIS: Interpreting Language Models by Comparing Fill-in-the-Blank Promptscited by 7
- 2024Abstraction Alignment: Comparing Model-Learned and Human-Encoded Conceptual Relationshipscited by 7
- 2022A Visual Analytics System for Improving Attention-based Traffic Forecasting Modelscited by 6
- 2023Revealing the Unwritten: Visual Investigation of Beam Search Trees to Address Language Model Prompting Challengescited by 6
- 2024iScore: Visual Analytics for Interpreting How Language Models Automatically Score Summariescited by 6
- 2024Interactive Prompt Debugging with Sequence Saliencecited by 6
- 2024Exploring Empty Spaces: Human-in-the-Loop Data Augmentationcited by 6
- 2023Visual Explanations with Attributions and Counterfactuals on Time Series Classificationcited by 5
- 2023Decoding Layer Saliency in Language Transformerscited by 5
- 2023ProtoExplorer: Interpretable Forensic Analysis of Deepfake Videos using Prototype Exploration and Refinementcited by 5
- 2024generAItor: Tree-in-the-Loop Text Generation for Language Model Explainability and Adaptationcited by 5
- 2024Lightweight Safety Classification Using Pruned Language Modelscited by 5
- 2021FedNLP: An interpretable NLP System to Decode Federal Reserve Communicationscited by 4
- 2023Visual Analytics for Efficient Image Exploration and User-Guided Image Captioningcited by 4
- 2025Unlearning Comparator: A Visual Analytics System for Comparative Evaluation of Machine Unlearning Methodscited by 4
- 2021Explaining the Road Not Takencited by 3
- 2023Interpretability in Activation Space Analysis of Transformers: A Focused Surveycited by 3
- 2023Semantic-Based Neural Network Repaircited by 3
- 2023Are We Closing the Loop Yet? Gaps in the Generalizability of VIS4ML Researchcited by 3
50 most cited of 69 All 69 (JSON)
- 2026Token Signatures of Code: Comparing Coding Behaviors Across Large Language Models12 Aug 2026
- 2026string2string Studio: An Interactive, In-Browser Platform for String-to-String Algorithms4 Aug 2026
- 2026SketchXplain: Intuitive Visual Explanations of Image Classifiers with Sketches16 Jun 2026
- 2026VeriLLMed: Interactive Visual Debugging of Medical Large Language Models with Knowledge Graphs25 Apr 2026
- 2026GFlowState: Visualizing the Training of Generative Flow Networks Beyond the Reward23 Apr 2026
- 2026Decomposing Query-Key Feature Interactions Using Contrastive Covariances4 Feb 2026
- 2026RAGExplorer: A Visual Analytics System for the Comparative Diagnosis of RAG Systems19 Jan 2026
- 2025Epistemoverse: Toward an AI-Driven Knowledge Metaverse for Intellectual Heritage Preservation13 Dec 2025
- 2025InFerActive: Interactive Tree-Based Exploration of LLM Sampling for Safety Evaluation11 Dec 2025
- 2025ConceptViz: A Visual Analytics Approach for Exploring Concepts in Large Language Models20 Sep 2025
- 2025Unlearning Comparator: A Visual Analytics System for Comparative Evaluation of Machine Unlearning Methods18 Aug 2025
- 2025Illuminating LLM Coding Agents: Visual Analytics for Deeper Understanding and Enhancement18 Aug 2025
38 more
- 2025Interpretation Meets Safety: A Survey on Interpretation Methods and Tools for Improving LLM Safety5 Jun 2025
- 2025A Review on Large Language Models for Visual Analytics19 Mar 2025
- 2024Lightweight Safety Classification Using Pruned Language Models18 Dec 2024
- 2024Exploring Empty Spaces: Human-in-the-Loop Data Augmentation1 Oct 2024
- 2024RuleExplorer: A Scalable Matrix Visualization for Understanding Tree Ensemble Classifiers5 Sep 2024
- 2024Abstraction Alignment: Comparing Model-Learned and Human-Encoded Conceptual Relationships17 Jul 2024
- 2024JailbreakHunter: A Visual Analytics Approach for Jailbreak Prompts Discovery from Large-Scale Human-LLM Conversational Datasets3 Jul 2024
- 2024Understanding Large Language Model Behaviors through Interactive Counterfactual Generation and Analysis23 Apr 2024
- 2024Interactive Prompt Debugging with Sequence Salience11 Apr 2024
- 2024generAItor: Tree-in-the-Loop Text Generation for Language Model Explainability and Adaptation12 Mar 2024
- 2024iScore: Visual Analytics for Interpreting How Language Models Automatically Score Summaries7 Mar 2024
- 2024KnowledgeVIS: Interpreting Language Models by Comparing Fill-in-the-Blank Prompts7 Mar 2024
- 2024Consistency Matters: Explore LLMs Consistency From a Black-Box Perspective27 Feb 2024
- 2024Computational Experiments Meet Large Language Model Based Agents: A Survey and Perspective1 Feb 2024
- 2024EL-VIT: Probing Vision Transformer with Interactive Visualization23 Jan 2024
- 2023A Large Language Model-based Computational Approach to Improve Identity-Related Write-Ups27 Dec 2023
- 2023k* Distribution: Evaluating the Latent Space of Deep Neural Networks using Local Neighborhood Analysis7 Dec 2023
- 2023RELIC: Investigating Large Language Model Responses using Self-Consistency28 Nov 2023
- 2023Visual Analytics for Efficient Image Exploration and User-Guided Image Captioning2 Nov 2023
- 2023Revealing the Unwritten: Visual Investigation of Beam Search Trees to Address Language Model Prompting Challenges17 Oct 2023
- 2023ProtoExplorer: Interpretable Forensic Analysis of Deepfake Videos using Prototype Exploration and Refinement20 Sep 2023
- 2023Explainability for Large Language Models: A Survey2 Sep 2023
- 2023Are We Closing the Loop Yet? Gaps in the Generalizability of VIS4ML Research10 Aug 2023
- 2023Decoding Layer Saliency in Language Transformers9 Aug 2023
- 2023Visual Analytics For Machine Learning: A Data Perspective Survey15 Jul 2023
- 2023Visual Explanations with Attributions and Counterfactuals on Time Series Classification14 Jul 2023
- 2023Semantic-Based Neural Network Repair12 Jun 2023
- 2023VISIT: Visualizing and Interpreting the Semantic Information Flow of Transformers22 May 2023
- 2023AttentionViz: A Global View of Transformer Attention4 May 2023
- 2023Angler: Helping Machine Translation Practitioners Prioritize Model Improvements12 Apr 2023
- 2023How Does Attention Work in Vision Transformers? A Visual Analytics Attempt24 Mar 2023
- 2023Automatically Summarizing Evidence from Clinical Trials: A Prototype Highlighting Current Challenges7 Mar 2023
- 2023Interpretability in Activation Space Analysis of Transformers: A Focused Survey22 Jan 2023
- 2023The Role of Interactive Visualization in Explaining (Large) NLP Models: from Data to Inference11 Jan 2023
- 2022The State of the Art in Enhancing Trust in Machine Learning Models with the Use of Visualizations22 Dec 2022
- 2022On the Explainability of Natural Language Processing Deep Models13 Oct 2022
- 2022Towards Faithful Model Explanation in NLP: A Survey22 Sep 2022
- 2022Visual Comparison of Language Model Adaptation17 Aug 2022
50 newest of 69 All 69 (JSON)
- 2025Interpretation Meets Safety: A Survey on Interpretation Methods and Tools for Improving LLM Safetycited by 10
- 2024Exploring Empty Spaces: Human-in-the-Loop Data Augmentationcited by 6
- 2024Lightweight Safety Classification Using Pruned Language Modelscited by 5
- 2025Unlearning Comparator: A Visual Analytics System for Comparative Evaluation of Machine Unlearning Methodscited by 4
- 2024JailbreakHunter: A Visual Analytics Approach for Jailbreak Prompts Discovery from Large-Scale Human-LLM Conversational Datasetscited by 1
- 2025Unlearning Comparator: A Visual Analytics System for Comparative Evaluation of Machine Unlearning Methods18 Aug 2025
- 2025Interpretation Meets Safety: A Survey on Interpretation Methods and Tools for Improving LLM Safety5 Jun 2025
- 2024Lightweight Safety Classification Using Pruned Language Models18 Dec 2024
- 2024Exploring Empty Spaces: Human-in-the-Loop Data Augmentation1 Oct 2024
- 2024JailbreakHunter: A Visual Analytics Approach for Jailbreak Prompts Discovery from Large-Scale Human-LLM Conversational Datasets3 Jul 2024
- 2023RELIC: Investigating Large Language Model Responses using Self-Consistencycited by 23
- 2022ExAIS: Executable AI Semanticscited by 1
- 2023RELIC: Investigating Large Language Model Responses using Self-Consistency28 Nov 2023
- 2022ExAIS: Executable AI Semantics20 Feb 2022
- 2023Explainability for Large Language Models: A Surveycited by 331
- 2021Post-hoc Interpretability for Neural NLP: A Surveycited by 155
- 2022Towards Faithful Model Explanation in NLP: A Surveycited by 129
- 2022Toward Transparent AI: A Survey on Interpreting the Inner Structures of Deep Neural Networkscited by 126
- 2021Interpretable Deep Learning: Interpretation, Interpretability, Trustworthiness, and Beyondcited by 116
- 2023AttentionViz: A Global View of Transformer Attentioncited by 50
- 2021Approximating How Single Head Attention Learnscited by 38
- 2022On the Explainability of Natural Language Processing Deep Modelscited by 37
- 2023VISIT: Visualizing and Interpreting the Semantic Information Flow of Transformerscited by 32
- 2022The State of the Art in Enhancing Trust in Machine Learning Models with the Use of Visualizationscited by 29
- 2023How Does Attention Work in Vision Transformers? A Visual Analytics Attemptcited by 29
- 2022ferret: a Framework for Benchmarking Explainers on Transformerscited by 26
12 most cited of 59 All 59 (JSON)
- 2026Token Signatures of Code: Comparing Coding Behaviors Across Large Language Models12 Aug 2026
- 2026string2string Studio: An Interactive, In-Browser Platform for String-to-String Algorithms4 Aug 2026
- 2026SketchXplain: Intuitive Visual Explanations of Image Classifiers with Sketches16 Jun 2026
- 2026VeriLLMed: Interactive Visual Debugging of Medical Large Language Models with Knowledge Graphs25 Apr 2026
- 2026GFlowState: Visualizing the Training of Generative Flow Networks Beyond the Reward23 Apr 2026
- 2026Decomposing Query-Key Feature Interactions Using Contrastive Covariances4 Feb 2026
- 2025Epistemoverse: Toward an AI-Driven Knowledge Metaverse for Intellectual Heritage Preservation13 Dec 2025
- 2025InFerActive: Interactive Tree-Based Exploration of LLM Sampling for Safety Evaluation11 Dec 2025
- 2025ConceptViz: A Visual Analytics Approach for Exploring Concepts in Large Language Models20 Sep 2025
- 2025A Review on Large Language Models for Visual Analytics19 Mar 2025
- 2024RuleExplorer: A Scalable Matrix Visualization for Understanding Tree Ensemble Classifiers5 Sep 2024
- 2024Abstraction Alignment: Comparing Model-Learned and Human-Encoded Conceptual Relationships17 Jul 2024
12 newest of 59 All 59 (JSON)