Reproducibility, Replicability, and Repeatability: A survey of reproducible research with a focus on high performance computing
Not on the map. Why?
Abstract (arXiv)
Reproducibility is widely acknowledged as a fundamental principle in scientific research. Currently, the scientific community grapples with numerous challenges associated with reproducibility, often referred to as the ''reproducibility crisis.'' This crisis permeated numerous scientific disciplines. In this study, we examined the factors in scientific practices that might contribute to this lack of reproducibility. Significant focus is placed on the prevalent integration of computation in research, which can sometimes function as a black box in published papers. Our study primarily focuses on highperformance computing (HPC), which presents unique reproducibility challenges. This paper provides a comprehensive review of these concerns and potential solutions. Furthermore, we discuss the critical role of reproducible research in advancing science and identifying persisting issues within the field of HPC.
Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). First posted on arXiv 12 Feb 2024.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2025: 4; 2026: 4.
8 papers.
- 2026Can Coding Agents Reproduce Findings in Computational Materials Science?cited by 9
- 2025LLM Output Drift: Cross-Provider Validation & Mitigation for Financial Workflowscited by 6
- 2025Statistical Quality and Reproducibility of Pseudorandom Number Generators in Machine Learning technologiescited by 1
- 2025CC30k: A Citation Contexts Dataset for Reproducibility-Oriented Sentiment Analysiscited by 0
- 2025A K-Means, Ward and DBSCAN repeatability studycited by 0
- 2026Reproducible AI Requires Reproducible Randomnesscited by 0
- 2026Position: Let's Strengthen Verifiability If We Can't Enforce Reproducibilitycited by 0
- 2026The Other Half of Workflow Portability: Evidence-Backed HPC Site Profiles with Agentic Discoverycited by 0
- 2026The Other Half of Workflow Portability: Evidence-Backed HPC Site Profiles with Agentic Discovery1 Oct 2026
- 2026Position: Let's Strengthen Verifiability If We Can't Enforce Reproducibility25 Sep 2026
- 2026Reproducible AI Requires Reproducible Randomness22 Sep 2026
- 2026Can Coding Agents Reproduce Findings in Computational Materials Science?1 May 2026
- 2025A K-Means, Ward and DBSCAN repeatability study22 Dec 2025
- 2025CC30k: A Citation Contexts Dataset for Reproducibility-Oriented Sentiment Analysis11 Nov 2025
- 2025LLM Output Drift: Cross-Provider Validation & Mitigation for Financial Workflows10 Nov 2025
- 2025Statistical Quality and Reproducibility of Pseudorandom Number Generators in Machine Learning technologies2 Jul 2025