Visual Analytics for Explainable Deep Learning
Not on the map. Why?
Abstract (arXiv)
Recently, deep learning has been advancing the state of the art in artificial intelligence to a new level, and humans rely on artificial intelligence techniques more than ever. However, even with such unprecedented advancements, the lack of explanation regarding the decisions made by deep learning models and absence of control over their internal processes act as major drawbacks in critical decision-making processes, such as precision medicine and law enforcement. In response, efforts are being made to make deep learning interpretable and controllable by humans. In this paper, we review visual analytics, information visualization, and machine learning perspectives relevant to this aim, and discuss potential challenges and future research directions.
Key facts. Cited by 39 papers in the map (data through 7 Oct 2026). First posted on arXiv 7 Apr 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 12; 2022: 3; 2023: 14; 2024: 4; 2025: 3; 2026: 3.
39 papers.
Sort:
By area:
- 2021Explainable AI (XAI): A Systematic Meta-Survey of Current Challenges and Future Opportunitiescited by 125
- 2021Inspect, Understand, Overcome: A Survey of Practical Methods for AI Safetycited by 35
- 2023Foundation Models Meet Visualizations: Challenges and Opportunitiescited by 31
- 2022The State of the Art in Enhancing Trust in Machine Learning Models with the Use of Visualizationscited by 29
- 2023How Does Attention Work in Vision Transformers? A Visual Analytics Attemptcited by 29
- 2021Designing ECG Monitoring Healthcare System with Federated Transfer Learning and Explainable AIcited by 26
- 2021To trust or not to trust an explanation: using LEAF to evaluate local linear XAI methodscited by 26
- 2023Visual Analytics For Machine Learning: A Data Perspective Surveycited by 25
- 2024XAI for All: Can Large Language Models Simplify Explainable AI?cited by 21
- 2023A Comprehensive Survey of Artificial Intelligence Techniques for Talent Analyticscited by 17
- 2021Explainable Artificial Intelligence for Human Decision-Support System in Medical Domaincited by 12
- 2023A Review of ChatGPT Applications in Education, Marketing, Software Engineering, and Healthcare: Benefits, Drawbacks, and Research Directionscited by 12
27 more
- 2021Towards Visual Explainable Active Learning for Zero-Shot Classificationcited by 10
- 2021TGHop: An Explainable, Efficient and Lightweight Method for Texture Generationcited by 8
- 2021Explainable Adversarial Attacks in Deep Neural Networks Using Activation Profilescited by 6
- 2022ShortcutLens: A Visual Analytics Approach for Exploring Shortcuts in Natural Language Understanding Datasetcited by 6
- 2024Integrating LLMs for Explainable Fault Diagnosis in Complex Systemscited by 6
- 2024The FIX Benchmark: Extracting Features Interpretable to eXpertscited by 5
- 2021TorchEsegeta: Framework for Interpretability and Explainability of Image-based Deep Learning Modelscited by 4
- 2023Visual Analytics of Neuron Vulnerability to Adversarial Attacks on Convolutional Neural Networkscited by 4
- 2021VERB: Visualizing and Interpreting Bias Mitigation Techniques for Word Representationscited by 3
- 2023Visual Analytics of Multivariate Networks with Representation Learning and Composite Variable Constructioncited by 3
- 2025RAG Without the Lag: Interactive Debugging for Retrieval-Augmented Generation Pipelinescited by 3
- 2025Model Science: getting serious about verification, explanation and control of AI systemscited by 3
- 2021AHMoSe: A Knowledge-Based Visual Support System for Selecting Regression Machine Learning Modelscited by 2
- 2023Communicating Uncertainty in Machine Learning Explanations: A Visualization Analytics Approach for Predictive Process Monitoringcited by 2
- 2023Visualization for Recommendation Explainability: A Survey and New Perspectivescited by 2
- 2023XAI for time-series classification leveraging image highlight methodscited by 2
- 2021Global explainability in aligned image modalitiescited by 1
- 2022Black-box Error Diagnosis in Deep Neural Networks for Computer Vision: a Survey of Toolscited by 1
- 2025A Rigorous Behavior Assessment of CNNs Using a Data-Domain Sampling Regimecited by 1
- 2026KEditVis: A Visual Analytics System for Knowledge Editing of Large Language Modelscited by 1
- 2023Explainable Machine Learning: The Importance of a System-Centric Perspectivecited by 0
- 2023Evaluating how interactive visualizations can assist in finding samples where and how computer vision models make mistakescited by 0
- 2023Detection of Non-uniformity in Parameters for Magnetic Domain Pattern Generation by Machine Learningcited by 0
- 2023A Comparative Visual Analytics Framework for Evaluating Evolutionary Processes in Multi-objective Optimizationcited by 0
- 2024An Explainable Fast Deep Neural Network for Emotion Recognitioncited by 0
- 2026Visualization of Machine Learning Models through Their Spatial and Temporal Listenerscited by 0
- 2026Spatial Action Review: A Visual Analytics Dashboard for Auditing Language-to-Action Hand-offs in Electron Microscopycited by 0
- 2026Spatial Action Review: A Visual Analytics Dashboard for Auditing Language-to-Action Hand-offs in Electron Microscopy21 Sep 2026
- 2026KEditVis: A Visual Analytics System for Knowledge Editing of Large Language Models31 Mar 2026
- 2026Visualization of Machine Learning Models through Their Spatial and Temporal Listeners29 Mar 2026
- 2025Model Science: getting serious about verification, explanation and control of AI systems27 Aug 2025
- 2025A Rigorous Behavior Assessment of CNNs Using a Data-Domain Sampling Regime5 Jul 2025
- 2025RAG Without the Lag: Interactive Debugging for Retrieval-Augmented Generation Pipelines18 Apr 2025
- 2024The FIX Benchmark: Extracting Features Interpretable to eXperts20 Sep 2024
- 2024An Explainable Fast Deep Neural Network for Emotion Recognition20 Jul 2024
- 2024Integrating LLMs for Explainable Fault Diagnosis in Complex Systems8 Feb 2024
- 2024XAI for All: Can Large Language Models Simplify Explainable AI?23 Jan 2024
- 2023XAI for time-series classification leveraging image highlight methods28 Nov 2023
- 2023Foundation Models Meet Visualizations: Challenges and Opportunities9 Oct 2023
27 more
- 2023A Comparative Visual Analytics Framework for Evaluating Evolutionary Processes in Multi-objective Optimization10 Aug 2023
- 2023Visual Analytics For Machine Learning: A Data Perspective Survey15 Jul 2023
- 2023A Comprehensive Survey of Artificial Intelligence Techniques for Talent Analytics3 Jul 2023
- 2023Detection of Non-uniformity in Parameters for Magnetic Domain Pattern Generation by Machine Learning24 May 2023
- 2023Evaluating how interactive visualizations can assist in finding samples where and how computer vision models make mistakes19 May 2023
- 2023Visualization for Recommendation Explainability: A Survey and New Perspectives19 May 2023
- 2023A Review of ChatGPT Applications in Education, Marketing, Software Engineering, and Healthcare: Benefits, Drawbacks, and Research Directions29 Apr 2023
- 2023Communicating Uncertainty in Machine Learning Explanations: A Visualization Analytics Approach for Predictive Process Monitoring12 Apr 2023
- 2023How Does Attention Work in Vision Transformers? A Visual Analytics Attempt24 Mar 2023
- 2023Visual Analytics of Multivariate Networks with Representation Learning and Composite Variable Construction16 Mar 2023
- 2023Visual Analytics of Neuron Vulnerability to Adversarial Attacks on Convolutional Neural Networks6 Mar 2023
- 2023Explainable Machine Learning: The Importance of a System-Centric Perspective5 Feb 2023
- 2022The State of the Art in Enhancing Trust in Machine Learning Models with the Use of Visualizations22 Dec 2022
- 2022ShortcutLens: A Visual Analytics Approach for Exploring Shortcuts in Natural Language Understanding Dataset17 Aug 2022
- 2022Black-box Error Diagnosis in Deep Neural Networks for Computer Vision: a Survey of Tools17 Jan 2022
- 2021Global explainability in aligned image modalities17 Dec 2021
- 2021Explainable AI (XAI): A Systematic Meta-Survey of Current Challenges and Future Opportunities11 Nov 2021
- 2021TorchEsegeta: Framework for Interpretability and Explainability of Image-based Deep Learning Models16 Oct 2021
- 2021Towards Visual Explainable Active Learning for Zero-Shot Classification15 Aug 2021
- 2021TGHop: An Explainable, Efficient and Lightweight Method for Texture Generation8 Jul 2021
- 2021To trust or not to trust an explanation: using LEAF to evaluate local linear XAI methods1 Jun 2021
- 2021Designing ECG Monitoring Healthcare System with Federated Transfer Learning and Explainable AI26 May 2021
- 2021Explainable Artificial Intelligence for Human Decision-Support System in Medical Domain5 May 2021
- 2021Inspect, Understand, Overcome: A Survey of Practical Methods for AI Safety29 Apr 2021
- 2021VERB: Visualizing and Interpreting Bias Mitigation Techniques for Word Representations6 Apr 2021
- 2021Explainable Adversarial Attacks in Deep Neural Networks Using Activation Profiles18 Mar 2021
- 2021AHMoSe: A Knowledge-Based Visual Support System for Selecting Regression Machine Learning Models28 Jan 2021
- 2021Explainable AI (XAI): A Systematic Meta-Survey of Current Challenges and Future Opportunitiescited by 125
- 2021Inspect, Understand, Overcome: A Survey of Practical Methods for AI Safetycited by 35
- 2023Foundation Models Meet Visualizations: Challenges and Opportunitiescited by 31
- 2022The State of the Art in Enhancing Trust in Machine Learning Models with the Use of Visualizationscited by 29
- 2023How Does Attention Work in Vision Transformers? A Visual Analytics Attemptcited by 29
- 2021Designing ECG Monitoring Healthcare System with Federated Transfer Learning and Explainable AIcited by 26
- 2021To trust or not to trust an explanation: using LEAF to evaluate local linear XAI methodscited by 26
- 2023Visual Analytics For Machine Learning: A Data Perspective Surveycited by 25
- 2024XAI for All: Can Large Language Models Simplify Explainable AI?cited by 21
- 2023A Comprehensive Survey of Artificial Intelligence Techniques for Talent Analyticscited by 17
- 2021Explainable Artificial Intelligence for Human Decision-Support System in Medical Domaincited by 12
- 2023A Review of ChatGPT Applications in Education, Marketing, Software Engineering, and Healthcare: Benefits, Drawbacks, and Research Directionscited by 12
12 most cited of 37 All 37 (JSON)
- 2026KEditVis: A Visual Analytics System for Knowledge Editing of Large Language Models31 Mar 2026
- 2026Visualization of Machine Learning Models through Their Spatial and Temporal Listeners29 Mar 2026
- 2025Model Science: getting serious about verification, explanation and control of AI systems27 Aug 2025
- 2025A Rigorous Behavior Assessment of CNNs Using a Data-Domain Sampling Regime5 Jul 2025
- 2024The FIX Benchmark: Extracting Features Interpretable to eXperts20 Sep 2024
- 2024An Explainable Fast Deep Neural Network for Emotion Recognition20 Jul 2024
- 2024Integrating LLMs for Explainable Fault Diagnosis in Complex Systems8 Feb 2024
- 2024XAI for All: Can Large Language Models Simplify Explainable AI?23 Jan 2024
- 2023XAI for time-series classification leveraging image highlight methods28 Nov 2023
- 2023Foundation Models Meet Visualizations: Challenges and Opportunities9 Oct 2023
- 2023A Comparative Visual Analytics Framework for Evaluating Evolutionary Processes in Multi-objective Optimization10 Aug 2023
- 2023Visual Analytics For Machine Learning: A Data Perspective Survey15 Jul 2023
12 newest of 37 All 37 (JSON)