mlsanityData to 7 Oct 2026

SuperNOVA: Design Strategies and Opportunities for Interactive Visualization in Computational Notebooks

arXiv 2305.03039 ↗First posted 4 May 2023cs.HC cs.LGcited by 3

Not on the map. Why?

Abstract (arXiv)

Computational notebooks, such as Jupyter Notebook, have become data scientists' de facto programming environments. Many visualization researchers and practitioners have developed interactive visualization tools that support notebooks, yet little is known about the appropriate design of these tools. To address this critical research gap, we investigate the design strategies in this space by analyzing 163 notebook visualization tools. Our analysis encompasses 64 systems from academic papers and 105 systems sourced from a pool of 55k notebooks containing interactive visualizations that we obtain via scraping 8.6 million notebooks on GitHub. Through this study, we identify key design implications and trade-offs, such as leveraging multimodal data in notebooks as well as balancing the degree of visualization-notebook integration. Furthermore, we provide empirical evidence that tools compatible with more notebook platforms have a greater impact. Finally, we develop SuperNOVA, an open-source interactive browser to help researchers explore existing notebook visualization tools. SuperNOVA is publicly accessible at: https://poloclub.github.io/supernova/.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 59 of its 208 references that are in the map. First posted on arXiv 4 May 2023.

Builds on

59 of 208 references.

References · 59

  1. 2017A Unified Approach to Interpreting Model Predictionscited by 6,488
  2. 2018Model Cards for Model Reportingcited by 1,068
  3. 2022BERTopic: Neural topic modeling with a class-based TF-IDF procedurecited by 779
  4. 2018Open3D: A Modern Library for 3D Data Processingcited by 717
  5. 2019A Multiscale Visualization of Attention in the Transformer Modelcited by 292
  6. 2019InterpretML: A Unified Framework for Machine Learning Interpretabilitycited by 243
  7. 2019The What-If Tool: Interactive Probing of Machine Learning Modelscited by 207
  8. 2018Aequitas: A Bias and Fairness Audit Toolkitcited by 145
  9. 2020The Language Interpretability Tool: Extensible, Interactive Visualizations and Analysis for NLP Modelscited by 125
  10. 2023The Semantic Scholar Open Data Platformcited by 109
  11. 2021Jigsaw: Large Language Models meet Program Synthesiscited by 103
  12. 2020NL4DV: A Toolkit for Generating Analytic Specifications for Data Visualization from Natural Language Queriescited by 73
38 more
  1. 2014Machine Learning for Neuroimaging with Scikit-Learncited by 70
  2. 2020How do Data Science Workers Collaborate? Roles, Workflows, and Toolscited by 64
  3. 2020Where Responsible AI meets Reality: Practitioner Perspectives on Enablers for shifting Organizational Practicescited by 38
  4. 2022Exploring How Machine Learning Practitioners (Try To) Use Fairness Toolkitscited by 33
  5. 2023On the Design of AI-powered Code Assistants for Notebookscited by 28
  6. 2020Principles to Practices for Responsible AI: Closing the Gapcited by 25
  7. 2022Interpretability, Then What? Editing Machine Learning Models to Reflect Human Knowledge and Valuescited by 25
  8. 2017Beagle: Automated Extraction and Interpretation of Visualizations from the Webcited by 19
  9. 2020PipelineProfiler: A Visual Analytics Tool for the Exploration of AutoML Pipelinescited by 19
  10. 2022Symphony: Composing Interactive Interfaces for Machine Learningcited by 18
  11. 2022Emblaze: Illuminating Machine Learning Representations through Interactive Comparison of Embedding Spacescited by 16
  12. 2023Model Sketching: Centering Concepts in Early-Stage Machine Learning Model Designcited by 15
  13. 2022Aspirations and Practice of Model Documentation: Moving the Needle with Nudging and Traceabilitycited by 14
  14. 2020mage: Fluid Moves Between Code and Graphical Work in Computational Notebookscited by 13
  15. 2022TimberTrek: Exploring and Curating Sparse Decision Trees with Interactive Visualizationcited by 13
  16. 2018A User-based Visual Analytics Workflow for Exploratory Model Analysiscited by 12
  17. 2021Interactive Dimensionality Reduction for Comparative Analysiscited by 12
  18. 2019VizSeq: A Visual Analysis Toolkit for Text Generation Taskscited by 10
  19. 2021Lux: Always-on Visualization Recommendations for Exploratory Dataframe Workflowscited by 10
  20. 2021PI2: End-to-end Interactive Visualization Interface Generation from Queriescited by 10
  21. 2020Network visualizations with Pyvis and VisJScited by 8
  22. 2021EDAssistant: Supporting Exploratory Data Analysis in Computational Notebooks with In-Situ Code Search and Recommendationcited by 8
  23. 2023Causalvis: Visualizations for Causal Inferencecited by 8
  24. 2015What May Visualization Processes Optimize?cited by 7
  25. 2021DataPrep.EDA: Task-Centric Exploratory Data Analysis for Statistical Modeling in Pythoncited by 7
  26. 2021Attribute-based Explanations of Non-Linear Embeddings of High-Dimensional Datacited by 7
  27. 2023Notable: On-the-fly Assistant for Data Storytelling in Computational Notebookscited by 7
  28. 2021VAINE: Visualization and AI for Natural Experimentscited by 6
  29. 2022In Defence of Visual Analytics Systems: Replies to Criticscited by 6
  30. 2022StickyLand: Breaking the Linear Presentation of Computational Notebookscited by 6
  31. 2022Calibrate: Interactive Analysis of Probabilistic Model Outputcited by 6
  32. 2022Visual Auditor: Interactive Visualization for Detection and Summarization of Model Biasescited by 5
  33. 2022NOVA: A Practical Method for Creating Notebook-Ready Visual Analyticscited by 4
  34. 2020Argo Lite: Open-Source Interactive Graph Exploration and Visualization in Browserscited by 3
  35. 2020Going Beyond T-SNE: Exposing textttwhatlies in Text Embeddingscited by 3
  36. 2022Data+Shift: Supporting visual investigation of data distribution shifts by data scientistscited by 3
  37. 2022Plotly-Resampler: Effective Visual Analytics for Large Time Seriescited by 3
  38. 2017Taggle: Combining Overview and Details in Tabular Data Visualizationscited by 2

50 most cited of 59 All 59 (JSON)

Built on by

Cited by year

Citing papers per year: 2023: 1; 2024: 2.

3 papers.