SuperNOVA: Design Strategies and Opportunities for Interactive Visualization in Computational Notebooks
Not on the map. Why?
Abstract (arXiv)
Computational notebooks, such as Jupyter Notebook, have become data scientists' de facto programming environments. Many visualization researchers and practitioners have developed interactive visualization tools that support notebooks, yet little is known about the appropriate design of these tools. To address this critical research gap, we investigate the design strategies in this space by analyzing 163 notebook visualization tools. Our analysis encompasses 64 systems from academic papers and 105 systems sourced from a pool of 55k notebooks containing interactive visualizations that we obtain via scraping 8.6 million notebooks on GitHub. Through this study, we identify key design implications and trade-offs, such as leveraging multimodal data in notebooks as well as balancing the degree of visualization-notebook integration. Furthermore, we provide empirical evidence that tools compatible with more notebook platforms have a greater impact. Finally, we develop SuperNOVA, an open-source interactive browser to help researchers explore existing notebook visualization tools. SuperNOVA is publicly accessible at: https://poloclub.github.io/supernova/.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 59 of its 208 references that are in the map. First posted on arXiv 4 May 2023.
Builds on
59 of 208 references.
References · 59
- 2017A Unified Approach to Interpreting Model Predictionscited by 6,488
- 2018Model Cards for Model Reportingcited by 1,068
- 2022BERTopic: Neural topic modeling with a class-based TF-IDF procedurecited by 779
- 2018Open3D: A Modern Library for 3D Data Processingcited by 717
- 2019A Multiscale Visualization of Attention in the Transformer Modelcited by 292
- 2019InterpretML: A Unified Framework for Machine Learning Interpretabilitycited by 243
- 2019The What-If Tool: Interactive Probing of Machine Learning Modelscited by 207
- 2018Aequitas: A Bias and Fairness Audit Toolkitcited by 145
- 2020The Language Interpretability Tool: Extensible, Interactive Visualizations and Analysis for NLP Modelscited by 125
- 2023The Semantic Scholar Open Data Platformcited by 109
- 2021Jigsaw: Large Language Models meet Program Synthesiscited by 103
- 2020NL4DV: A Toolkit for Generating Analytic Specifications for Data Visualization from Natural Language Queriescited by 73
38 more
- 2014Machine Learning for Neuroimaging with Scikit-Learncited by 70
- 2020How do Data Science Workers Collaborate? Roles, Workflows, and Toolscited by 64
- 2020Where Responsible AI meets Reality: Practitioner Perspectives on Enablers for shifting Organizational Practicescited by 38
- 2022Exploring How Machine Learning Practitioners (Try To) Use Fairness Toolkitscited by 33
- 2023On the Design of AI-powered Code Assistants for Notebookscited by 28
- 2020Principles to Practices for Responsible AI: Closing the Gapcited by 25
- 2022Interpretability, Then What? Editing Machine Learning Models to Reflect Human Knowledge and Valuescited by 25
- 2017Beagle: Automated Extraction and Interpretation of Visualizations from the Webcited by 19
- 2020PipelineProfiler: A Visual Analytics Tool for the Exploration of AutoML Pipelinescited by 19
- 2022Symphony: Composing Interactive Interfaces for Machine Learningcited by 18
- 2022Emblaze: Illuminating Machine Learning Representations through Interactive Comparison of Embedding Spacescited by 16
- 2023Model Sketching: Centering Concepts in Early-Stage Machine Learning Model Designcited by 15
- 2022Aspirations and Practice of Model Documentation: Moving the Needle with Nudging and Traceabilitycited by 14
- 2020mage: Fluid Moves Between Code and Graphical Work in Computational Notebookscited by 13
- 2022TimberTrek: Exploring and Curating Sparse Decision Trees with Interactive Visualizationcited by 13
- 2018A User-based Visual Analytics Workflow for Exploratory Model Analysiscited by 12
- 2021Interactive Dimensionality Reduction for Comparative Analysiscited by 12
- 2019VizSeq: A Visual Analysis Toolkit for Text Generation Taskscited by 10
- 2021Lux: Always-on Visualization Recommendations for Exploratory Dataframe Workflowscited by 10
- 2021PI2: End-to-end Interactive Visualization Interface Generation from Queriescited by 10
- 2020Network visualizations with Pyvis and VisJScited by 8
- 2021EDAssistant: Supporting Exploratory Data Analysis in Computational Notebooks with In-Situ Code Search and Recommendationcited by 8
- 2023Causalvis: Visualizations for Causal Inferencecited by 8
- 2015What May Visualization Processes Optimize?cited by 7
- 2021DataPrep.EDA: Task-Centric Exploratory Data Analysis for Statistical Modeling in Pythoncited by 7
- 2021Attribute-based Explanations of Non-Linear Embeddings of High-Dimensional Datacited by 7
- 2023Notable: On-the-fly Assistant for Data Storytelling in Computational Notebookscited by 7
- 2021VAINE: Visualization and AI for Natural Experimentscited by 6
- 2022In Defence of Visual Analytics Systems: Replies to Criticscited by 6
- 2022StickyLand: Breaking the Linear Presentation of Computational Notebookscited by 6
- 2022Calibrate: Interactive Analysis of Probabilistic Model Outputcited by 6
- 2022Visual Auditor: Interactive Visualization for Detection and Summarization of Model Biasescited by 5
- 2022NOVA: A Practical Method for Creating Notebook-Ready Visual Analyticscited by 4
- 2020Argo Lite: Open-Source Interactive Graph Exploration and Visualization in Browserscited by 3
- 2020Going Beyond T-SNE: Exposing textttwhatlies in Text Embeddingscited by 3
- 2022Data+Shift: Supporting visual investigation of data distribution shifts by data scientistscited by 3
- 2022Plotly-Resampler: Effective Visual Analytics for Large Time Seriescited by 3
- 2017Taggle: Combining Overview and Details in Tabular Data Visualizationscited by 2
50 most cited of 59 All 59 (JSON)
Built on by
Citing papers per year: 2023: 1; 2024: 2.
3 papers.