Towards Better Analysis of Machine Learning Models: A Visual Analytics Perspective
Not on the map. Why?
Abstract (arXiv)
Interactive model analysis, the process of understanding, diagnosing, and refining a machine learning model with the help of interactive visualization, is very important for users to efficiently solve real-world artificial intelligence and data mining problems. Dramatic advances in big data analytics has led to a wide variety of interactive model analysis tasks. In this paper, we present a comprehensive analysis and interpretation of this rapidly developing area. Specifically, we classify the relevant work into three categories: understanding, diagnosis, and refinement. Each category is exemplified by recent influential work. Possible future research opportunities are also explored and discussed.
Key facts. Cited by 36 papers in the map (data through 14 Oct 2026). First posted on arXiv 4 Feb 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 11; 2022: 8; 2023: 7; 2024: 3; 2025: 4; 2026: 3.
36 papers.
Sort:
By area:
- 2021Inspect, Understand, Overcome: A Survey of Practical Methods for AI Safetycited by 35
- 2022DL4SciVis: A State-of-the-Art Survey on Deep Learning for Scientific Visualizationcited by 32
- 2023Foundation Models Meet Visualizations: Challenges and Opportunitiescited by 31
- 2022The State of the Art in Enhancing Trust in Machine Learning Models with the Use of Visualizationscited by 29
- 2023Visual Analytics For Machine Learning: A Data Perspective Surveycited by 25
- 2021Explainable Machine Learning with Prior Knowledge: An Overviewcited by 15
- 2022Learning-From-Disagreement: A Model Comparison and Visual Analytics Frameworkcited by 10
- 2021Responsible and Regulatory Conform Machine Learning for Medicine: A Survey of Challenges and Solutionscited by 7
- 2021Explainable Adversarial Attacks in Deep Neural Networks Using Activation Profilescited by 6
- 2022Interactive Machine Learning: A State of the Art Reviewcited by 6
- 2024iScore: Visual Analytics for Interpreting How Language Models Automatically Score Summariescited by 6
- 2023Visual Explanations with Attributions and Counterfactuals on Time Series Classificationcited by 5
24 more
- 2021Non-linear Visual Knowledge Discovery with Elliptic Paired Coordinatescited by 4
- 2022Efficient Human-in-the-loop System for Guiding DNNs Attentioncited by 4
- 2021VERB: Visualizing and Interpreting Bias Mitigation Techniques for Word Representationscited by 3
- 2021Visualization Techniques to Enhance Automated Event Extractioncited by 3
- 2022An Empirical Comparison of Explainable Artificial Intelligence Methods for Clinical Data: A Case Study on Traumatic Brain Injurycited by 3
- 2021AHMoSe: A Knowledge-Based Visual Support System for Selecting Regression Machine Learning Modelscited by 2
- 2023Visualization for Recommendation Explainability: A Survey and New Perspectivescited by 2
- 2024iGAiVA: Integrated Generative AI and Visual Analytics in a Machine Learning Workflow for Text Classificationcited by 2
- 2026RAGExplorer: A Visual Analytics System for the Comparative Diagnosis of RAG Systemscited by 2
- 2021Multi-point dimensionality reduction to improve projection layout reliabilitycited by 1
- 2021Novelty Detection in Sequential Data by Informed Clustering and Modelingcited by 1
- 2021Proposing an Interactive Audit Pipeline for Visual Privacy Researchcited by 1
- 2023GeoExplainer: A Visual Analytics Framework for Spatial Modeling Contextualization and Report Generationcited by 1
- 2024TrafPS: A Shapley-based Visual Analytics Approach to Interpret Trafficcited by 1
- 2025A Rigorous Behavior Assessment of CNNs Using a Data-Domain Sampling Regimecited by 1
- 2025NeuroBreak: Unveil Internal Jailbreak Mechanisms in Large Language Modelscited by 1
- 2025ConceptViz: A Visual Analytics Approach for Exploring Concepts in Large Language Modelscited by 1
- 2022Trust Calibration as a Function of the Evolution of Uncertainty in Knowledge Generation: A Surveycited by 0
- 2022Towards Efficient Visual Simplification of Computational Graphs in Deep Neural Networkscited by 0
- 2023A Concurrent CNN-RNN Approach for Multi-Step Wind Power Forecastingcited by 0
- 2023Evaluating how interactive visualizations can assist in finding samples where and how computer vision models make mistakescited by 0
- 2025IKIWISI: An Interactive Visual Pattern Generator for Evaluating the Reliability of Vision-Language Models Without Ground Truthcited by 0
- 2026Visualization of Machine Learning Models through Their Spatial and Temporal Listenerscited by 0
- 2026Spatial Action Review: A Visual Analytics Dashboard for Auditing Language-to-Action Hand-offs in Electron Microscopycited by 0
- 2026Spatial Action Review: A Visual Analytics Dashboard for Auditing Language-to-Action Hand-offs in Electron Microscopy21 Sep 2026
- 2026Visualization of Machine Learning Models through Their Spatial and Temporal Listeners29 Mar 2026
- 2026RAGExplorer: A Visual Analytics System for the Comparative Diagnosis of RAG Systems19 Jan 2026
- 2025ConceptViz: A Visual Analytics Approach for Exploring Concepts in Large Language Models20 Sep 2025
- 2025NeuroBreak: Unveil Internal Jailbreak Mechanisms in Large Language Models4 Sep 2025
- 2025A Rigorous Behavior Assessment of CNNs Using a Data-Domain Sampling Regime5 Jul 2025
- 2025IKIWISI: An Interactive Visual Pattern Generator for Evaluating the Reliability of Vision-Language Models Without Ground Truth28 May 2025
- 2024iGAiVA: Integrated Generative AI and Visual Analytics in a Machine Learning Workflow for Text Classification24 Sep 2024
- 2024TrafPS: A Shapley-based Visual Analytics Approach to Interpret Traffic7 Mar 2024
- 2024iScore: Visual Analytics for Interpreting How Language Models Automatically Score Summaries7 Mar 2024
- 2023Foundation Models Meet Visualizations: Challenges and Opportunities9 Oct 2023
- 2023GeoExplainer: A Visual Analytics Framework for Spatial Modeling Contextualization and Report Generation25 Aug 2023
24 more
- 2023Visual Analytics For Machine Learning: A Data Perspective Survey15 Jul 2023
- 2023Visual Explanations with Attributions and Counterfactuals on Time Series Classification14 Jul 2023
- 2023Evaluating how interactive visualizations can assist in finding samples where and how computer vision models make mistakes19 May 2023
- 2023Visualization for Recommendation Explainability: A Survey and New Perspectives19 May 2023
- 2023A Concurrent CNN-RNN Approach for Multi-Step Wind Power Forecasting2 Jan 2023
- 2022The State of the Art in Enhancing Trust in Machine Learning Models with the Use of Visualizations22 Dec 2022
- 2022Towards Efficient Visual Simplification of Computational Graphs in Deep Neural Networks21 Dec 2022
- 2022Trust Calibration as a Function of the Evolution of Uncertainty in Knowledge Generation: A Survey9 Sep 2022
- 2022An Empirical Comparison of Explainable Artificial Intelligence Methods for Clinical Data: A Case Study on Traumatic Brain Injury13 Aug 2022
- 2022Interactive Machine Learning: A State of the Art Review13 Jul 2022
- 2022Efficient Human-in-the-loop System for Guiding DNNs Attention13 Jun 2022
- 2022DL4SciVis: A State-of-the-Art Survey on Deep Learning for Scientific Visualization13 Apr 2022
- 2022Learning-From-Disagreement: A Model Comparison and Visual Analytics Framework19 Jan 2022
- 2021Proposing an Interactive Audit Pipeline for Visual Privacy Research7 Nov 2021
- 2021Responsible and Regulatory Conform Machine Learning for Medicine: A Survey of Challenges and Solutions20 Jul 2021
- 2021Non-linear Visual Knowledge Discovery with Elliptic Paired Coordinates11 Jul 2021
- 2021Visualization Techniques to Enhance Automated Event Extraction11 Jun 2021
- 2021Explainable Machine Learning with Prior Knowledge: An Overview21 May 2021
- 2021Inspect, Understand, Overcome: A Survey of Practical Methods for AI Safety29 Apr 2021
- 2021VERB: Visualizing and Interpreting Bias Mitigation Techniques for Word Representations6 Apr 2021
- 2021Explainable Adversarial Attacks in Deep Neural Networks Using Activation Profiles18 Mar 2021
- 2021Novelty Detection in Sequential Data by Informed Clustering and Modeling5 Mar 2021
- 2021AHMoSe: A Knowledge-Based Visual Support System for Selecting Regression Machine Learning Models28 Jan 2021
- 2021Multi-point dimensionality reduction to improve projection layout reliability15 Jan 2021
- 2021Inspect, Understand, Overcome: A Survey of Practical Methods for AI Safetycited by 35
- 2022DL4SciVis: A State-of-the-Art Survey on Deep Learning for Scientific Visualizationcited by 32
- 2023Foundation Models Meet Visualizations: Challenges and Opportunitiescited by 31
- 2022The State of the Art in Enhancing Trust in Machine Learning Models with the Use of Visualizationscited by 29
- 2023Visual Analytics For Machine Learning: A Data Perspective Surveycited by 25
- 2021Explainable Machine Learning with Prior Knowledge: An Overviewcited by 15
- 2022Learning-From-Disagreement: A Model Comparison and Visual Analytics Frameworkcited by 10
- 2021Responsible and Regulatory Conform Machine Learning for Medicine: A Survey of Challenges and Solutionscited by 7
- 2021Explainable Adversarial Attacks in Deep Neural Networks Using Activation Profilescited by 6
- 2022Interactive Machine Learning: A State of the Art Reviewcited by 6
- 2024iScore: Visual Analytics for Interpreting How Language Models Automatically Score Summariescited by 6
- 2023Visual Explanations with Attributions and Counterfactuals on Time Series Classificationcited by 5
12 most cited of 31 All 31 (JSON)
- 2026Visualization of Machine Learning Models through Their Spatial and Temporal Listeners29 Mar 2026
- 2025A Rigorous Behavior Assessment of CNNs Using a Data-Domain Sampling Regime5 Jul 2025
- 2024iGAiVA: Integrated Generative AI and Visual Analytics in a Machine Learning Workflow for Text Classification24 Sep 2024
- 2024TrafPS: A Shapley-based Visual Analytics Approach to Interpret Traffic7 Mar 2024
- 2024iScore: Visual Analytics for Interpreting How Language Models Automatically Score Summaries7 Mar 2024
- 2023Foundation Models Meet Visualizations: Challenges and Opportunities9 Oct 2023
- 2023GeoExplainer: A Visual Analytics Framework for Spatial Modeling Contextualization and Report Generation25 Aug 2023
- 2023Visual Analytics For Machine Learning: A Data Perspective Survey15 Jul 2023
- 2023Visual Explanations with Attributions and Counterfactuals on Time Series Classification14 Jul 2023
- 2023Evaluating how interactive visualizations can assist in finding samples where and how computer vision models make mistakes19 May 2023
- 2023Visualization for Recommendation Explainability: A Survey and New Perspectives19 May 2023
- 2023A Concurrent CNN-RNN Approach for Multi-Step Wind Power Forecasting2 Jan 2023
12 newest of 31 All 31 (JSON)