mlsanityData to 7 Oct 2026

Exploratory Visual Analysis for Increasing Data Readiness in Artificial Intelligence Projects

arXiv 2409.03805 ↗First posted 5 Sep 2024stat.ME cs.AIcited by 1

Not on the map. Why?

Abstract (arXiv)

We present experiences and lessons learned from increasing data readiness of heterogeneous data for artificial intelligence projects using visual analysis methods. Increasing the data readiness level involves understanding both the data as well as the context in which it is used, which are challenges well suitable to visual analysis. For this purpose, we contribute a mapping between data readiness aspects and visual analysis techniques suitable for different data types. We use the defined mapping to increase data readiness levels in use cases involving time-varying data, including numerical, categorical, and text. In addition to the mapping, we extend the data readiness concept to better take aspects of the task and solution into account and explicitly address distribution shifts during data collection time. We report on our experiences in using the presented visual analysis techniques to aid future artificial intelligence projects in raising the data readiness level.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 26 of its 66 references that are in the map. First posted on arXiv 5 Sep 2024.

Builds on

26 of 66 references.

References · 26

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2020Language Models are Few-Shot Learnerscited by 32,199
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  4. 2017A Unified Approach to Interpreting Model Predictionscited by 6,488
  5. 2016XGBoost: A Scalable Tree Boosting Systemcited by 5,120
  6. 2015You Only Look Once: Unified, Real-Time Object Detectioncited by 4,829
  7. 2020wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representationscited by 3,853
  8. 2022A ConvNet for the 2020scited by 3,545
  9. 2018UMAP: Uniform Manifold Approximation and Projection for Dimension Reductioncited by 2,841
  10. 2019Optuna: A Next-generation Hyperparameter Optimization Frameworkcited by 2,455
  11. 2022No Language Left Behind: Scaling Human-Centered Machine Translationcited by 1,290
  12. 2019Aleatoric and Epistemic Uncertainty in Machine Learning: An Introduction to Concepts and Methodscited by 903
14 more
  1. 2017Natural TTS Synthesis by Conditioning WaveNet on Mel Spectrogram Predictionscited by 800
  2. 2020Learning under Concept Drift: A Reviewcited by 470
  3. 2019The What-If Tool: Interactive Probing of Machine Learning Modelscited by 207
  4. 2020Challenges in Deploying Machine Learning: a Survey of Case Studiescited by 151
  5. 2018Net2Vec: Quantifying and Explaining how Concepts are Encoded by Filters in Deep Neural Networkscited by 128
  6. 2021Dive into Deep Learningcited by 111
  7. 2019A Comparative Analysis of XGBoostcited by 80
  8. 2014Automatic Construction and Natural-Language Description of Nonparametric Regression Modelscited by 40
  9. 2018VizML: A Machine Learning Approach to Visualization Recommendationcited by 38
  10. 2021Who Needs MLOps: What Data Scientists Seek to Accomplish and How Can MLOps Help?cited by 37
  11. 2017Data Readiness Levelscited by 12
  12. 2022OneLabeler: A Flexible System for Building Data Labeling Toolscited by 9
  13. 2020HyperTendril: Visual Analytics for User-Driven Hyperparameter Optimization of Deep Neural Networkscited by 7
  14. 2021On the Value of ML Modelscited by 3

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.

  1. 2025AI Application Operations -- A Socio-Technical Framework for Data-driven Organizationscited by 0