# Automatically Finding and Categorizing Replication Studies

arXiv: https://arxiv.org/abs/2311.15055 · HTML: https://mlsanity.com/paper/2311.15055/

## Key facts

- No citing papers in the map yet (data through 14 Oct 2026).
- Builds on 0 of its 4 references that are in the map.
- First posted on arXiv 25 Nov 2023.

## Abstract (arXiv)

In many fields of experimental science, papers that failed to replicate continue to be cited as a result of the poor discoverability of replication studies. As a first step to creating a system that automatically finds replication studies for a given paper, 334 replication studies and 344 replicated studies were collected. Replication studies could be identified in the dataset based on text content at a higher rate than chance (AUROC = 0.886). Additionally, successful replication studies could be distinguished from failed replication studies at a higher rate than chance (AUROC = 0.664).