AutoAIViz: Opening the Blackbox of Automated Artificial Intelligence with Conditional Parallel Coordinates
Not on the map. Why?
Abstract (arXiv)
Artificial Intelligence (AI) can now automate the algorithm selection, feature engineering, and hyperparameter tuning steps in a machine learning workflow. Commonly known as AutoML or AutoAI, these technologies aim to relieve data scientists from the tedious manual work. However, today's AutoAI systems often present only limited to no information about the process of how they select and generate model results. Thus, users often do not understand the process, neither do they trust the outputs. In this short paper, we provide a first user evaluation by 10 data scientists of an experimental system, AutoAIViz, that aims to visualize AutoAI's model generation process. We find that the proposed system helps users to complete the data science tasks, and increases their understanding, toward the goal of increasing trust in the AutoAI system.
Key facts. Cited by 24 papers in the map (data through 14 Oct 2026). First posted on arXiv 13 Dec 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 10; 2022: 7; 2023: 5; 2024: 2.
24 papers.
Sort:
- 2021AutoDS: Towards Human-Centered Automation of Data Sciencecited by 32
- 2021"Brilliant AI Doctor" in Rural China: Tensions and Challenges in AI-Powered CDSS Deploymentcited by 28
- 2021Whither AutoML? Understanding the Role of Automation in Machine Learning Workflowscited by 22
- 2021Fits and Starts: Enterprise Use of AutoML and the Role of Humans in the Loopcited by 21
- 2021How Much Automation Does a Data Scientist Want?cited by 20
- 2023Out of Context: Investigating the Bias and Fairness Concerns of "Artificial Intelligence as a Service"cited by 15
- 2021Model LineUpper: Supporting Interactive Model Comparison at Multiple Levels for AutoMLcited by 12
- 2022XAutoML: A Visual Analytics Tool for Understanding and Validating Automated Machine Learningcited by 8
- 2023AutoML in The Wild: Obstacles, Workarounds, and Expectationscited by 8
- 2023Why is AI not a Panacea for Data Workers? An Interview Study on Human-AI Collaboration in Data Storytellingcited by 7
- 2024Compress and Compare: Interactively Evaluating Efficiency and Behavior Across ML Model Compression Experimentscited by 4
- 2021Preserve, Promote, or Attack? GNN Explanation via Topology Perturbationcited by 3
12 more
- 2022Visual Analysis of Neural Architecture Spaces for Summarizing Design Principlescited by 3
- 2023AutoDOViz: Human-Centered Automation for Decision Optimizationcited by 3
- 2021SINGA-Easy: An Easy-to-Use Framework for MultiModal Analysiscited by 0
- 2021VisualTextRank: Unsupervised Graph-based Content Extraction for Automating Ad Text to Image Searchcited by 0
- 2021Text is NOT Enough: Integrating Visual Impressions into Open-domain Dialogue Generationcited by 0
- 2022Discovering Personalized Semantics for Soft Attributes in Recommender Systems using Concept Activation Vectorscited by 0
- 2022Reinforced MOOCs Concept Recommendation in Heterogeneous Information Networkscited by 0
- 2022Explanation-Guided Fairness Testing through Genetic Algorithmcited by 0
- 2022Using Graph Neural Networks for Program Terminationcited by 0
- 2022Assessment of cognitive characteristics in intelligent systems and predictive abilitycited by 0
- 2023Tribe or Not? Critical Inspection of Group Differences Using TribalGramcited by 0
- 2024Deciphering AutoML Ensembles: cattleia's Assistance in Decision-Makingcited by 0
- 2024Compress and Compare: Interactively Evaluating Efficiency and Behavior Across ML Model Compression Experiments6 Aug 2024
- 2024Deciphering AutoML Ensembles: cattleia's Assistance in Decision-Making19 Mar 2024
- 2023Why is AI not a Panacea for Data Workers? An Interview Study on Human-AI Collaboration in Data Storytelling17 Apr 2023
- 2023Tribe or Not? Critical Inspection of Group Differences Using TribalGram16 Mar 2023
- 2023AutoML in The Wild: Obstacles, Workarounds, and Expectations21 Feb 2023
- 2023AutoDOViz: Human-Centered Automation for Decision Optimization19 Feb 2023
- 2023Out of Context: Investigating the Bias and Fairness Concerns of "Artificial Intelligence as a Service"2 Feb 2023
- 2022Assessment of cognitive characteristics in intelligent systems and predictive ability16 Sep 2022
- 2022Visual Analysis of Neural Architecture Spaces for Summarizing Design Principles20 Aug 2022
- 2022Using Graph Neural Networks for Program Termination28 Jul 2022
- 2022Explanation-Guided Fairness Testing through Genetic Algorithm16 May 2022
- 2022Reinforced MOOCs Concept Recommendation in Heterogeneous Information Networks8 Mar 2022
12 more
- 2022XAutoML: A Visual Analytics Tool for Understanding and Validating Automated Machine Learning24 Feb 2022
- 2022Discovering Personalized Semantics for Soft Attributes in Recommender Systems using Concept Activation Vectors6 Feb 2022
- 2021Text is NOT Enough: Integrating Visual Impressions into Open-domain Dialogue Generation13 Sep 2021
- 2021VisualTextRank: Unsupervised Graph-based Content Extraction for Automating Ad Text to Image Search5 Aug 2021
- 2021SINGA-Easy: An Easy-to-Use Framework for MultiModal Analysis3 Aug 2021
- 2021Model LineUpper: Supporting Interactive Model Comparison at Multiple Levels for AutoML9 Apr 2021
- 2021Preserve, Promote, or Attack? GNN Explanation via Topology Perturbation25 Mar 2021
- 2021AutoDS: Towards Human-Centered Automation of Data Science13 Jan 2021
- 2021Whither AutoML? Understanding the Role of Automation in Machine Learning Workflows13 Jan 2021
- 2021Fits and Starts: Enterprise Use of AutoML and the Role of Humans in the Loop12 Jan 2021
- 2021How Much Automation Does a Data Scientist Want?7 Jan 2021
- 2021"Brilliant AI Doctor" in Rural China: Tensions and Challenges in AI-Powered CDSS Deployment4 Jan 2021
- 2021AutoDS: Towards Human-Centered Automation of Data Sciencecited by 32
- 2021"Brilliant AI Doctor" in Rural China: Tensions and Challenges in AI-Powered CDSS Deploymentcited by 28
- 2021Whither AutoML? Understanding the Role of Automation in Machine Learning Workflowscited by 22
- 2021Fits and Starts: Enterprise Use of AutoML and the Role of Humans in the Loopcited by 21
- 2021How Much Automation Does a Data Scientist Want?cited by 20
- 2023Out of Context: Investigating the Bias and Fairness Concerns of "Artificial Intelligence as a Service"cited by 15
- 2021Model LineUpper: Supporting Interactive Model Comparison at Multiple Levels for AutoMLcited by 12
- 2022XAutoML: A Visual Analytics Tool for Understanding and Validating Automated Machine Learningcited by 8
- 2023AutoML in The Wild: Obstacles, Workarounds, and Expectationscited by 8
- 2023Why is AI not a Panacea for Data Workers? An Interview Study on Human-AI Collaboration in Data Storytellingcited by 7
- 2024Compress and Compare: Interactively Evaluating Efficiency and Behavior Across ML Model Compression Experimentscited by 4
- 2021Preserve, Promote, or Attack? GNN Explanation via Topology Perturbationcited by 3
12 most cited of 24 All 24 (JSON)
- 2024Compress and Compare: Interactively Evaluating Efficiency and Behavior Across ML Model Compression Experiments6 Aug 2024
- 2024Deciphering AutoML Ensembles: cattleia's Assistance in Decision-Making19 Mar 2024
- 2023Why is AI not a Panacea for Data Workers? An Interview Study on Human-AI Collaboration in Data Storytelling17 Apr 2023
- 2023Tribe or Not? Critical Inspection of Group Differences Using TribalGram16 Mar 2023
- 2023AutoML in The Wild: Obstacles, Workarounds, and Expectations21 Feb 2023
- 2023AutoDOViz: Human-Centered Automation for Decision Optimization19 Feb 2023
- 2023Out of Context: Investigating the Bias and Fairness Concerns of "Artificial Intelligence as a Service"2 Feb 2023
- 2022Assessment of cognitive characteristics in intelligent systems and predictive ability16 Sep 2022
- 2022Visual Analysis of Neural Architecture Spaces for Summarizing Design Principles20 Aug 2022
- 2022Using Graph Neural Networks for Program Termination28 Jul 2022
- 2022Explanation-Guided Fairness Testing through Genetic Algorithm16 May 2022
- 2022Reinforced MOOCs Concept Recommendation in Heterogeneous Information Networks8 Mar 2022
12 newest of 24 All 24 (JSON)