Ten Simple Rules for Reproducible Research in Jupyter Notebooks
Not on the map. Why?
Abstract (arXiv)
Reproducibility of computational studies is a hallmark of scientific methodology. It enables researchers to build with confidence on the methods and findings of others, reuse and extend computational pipelines, and thereby drive scientific progress. Since many experimental studies rely on computational analyses, biologists need guidance on how to set up and document reproducible data analyses or simulations. In this paper, we address several questions about reproducibility. For example, what are the technical and non-technical barriers to reproducible computational studies? What opportunities and challenges do computational notebooks offer to overcome some of these barriers? What tools are available and how can they be used effectively? We have developed a set of rules to serve as a guide to scientists with a specific focus on computational notebook systems, such as Jupyter Notebooks, which have become a tool of choice for many applications. Notebooks combine detailed workflows with narrative text and visualization of results. Combined with software repositories and open source licensing, notebooks are powerful tools for transparent, collaborative, reproducible, and reusable data analyses.
Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). First posted on arXiv 13 Oct 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 2; 2022: 2; 2023: 0; 2024: 2.
6 papers.
- 2021On the Reproducibility of Neural Network Predictionscited by 28
- 2024Predictive Churn with the Set of Good Modelscited by 15
- 2022Eliciting Best Practices for Collaboration with Computational Notebookscited by 4
- 2024A Flexible Cell Classification for ML Projects in Jupyter Notebookscited by 2
- 2021Ten Quick Tips for Deep Learning in Biologycited by 1
- 2022Assessing the Quality of Computational Notebooks for a Frictionless Transition from Exploration to Productioncited by 1
- 2024A Flexible Cell Classification for ML Projects in Jupyter Notebooks12 Mar 2024
- 2024Predictive Churn with the Set of Good Models12 Feb 2024
- 2022Assessing the Quality of Computational Notebooks for a Frictionless Transition from Exploration to Production24 May 2022
- 2022Eliciting Best Practices for Collaboration with Computational Notebooks15 Feb 2022
- 2021Ten Quick Tips for Deep Learning in Biology29 May 2021
- 2021On the Reproducibility of Neural Network Predictions5 Feb 2021