Repro: An Open-Source Library for Improving the Reproducibility and Usability of Publicly Available Research Code
Not on the map. Why?
Abstract (arXiv)
We introduce Repro, an open-source library which aims at improving the reproducibility and usability of research code. The library provides a lightweight Python API for running software released by researchers within Docker containers which contain the exact required runtime configuration and dependencies for the code. Because the environment setup for each package is handled by Docker, users do not have to do any configuration themselves. Once Repro is installed, users can run the code for the 30+ papers currently supported by the library. We hope researchers see the value provided to others by including their research code in Repro and consider adding support for their own research code.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 33 of its 42 references that are in the map. First posted on arXiv 29 Apr 2022.
Builds on
33 of 42 references.
References · 33
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,874
- 2019BERTScore: Evaluating Text Generation with BERTcited by 5,462
- 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,388
- 2018A Call for Clarity in Reporting BLEU Scorescited by 1,790
- 2020BLEURT: Learning Robust Metrics for Text Generationcited by 1,196
- 2020COMET: A Neural Framework for MT Evaluationcited by 1,024
- 2021BARTScore: Evaluating Generated Text as Text Generationcited by 719
- 2019Text Summarization with Pretrained Encoderscited by 553
- 2021Datasets: A Community Library for Natural Language Processingcited by 526
- 2019MoverScore: Text Generation Evaluating with Contextualized Embeddings and Earth Mover Distancecited by 415
- 2018AllenNLP: A Deep Semantic Natural Language Processing Platformcited by 347
21 more
- 2020FEQA: A Question Answering Evaluation Framework for Faithfulness Assessment in Abstractive Summarizationcited by 292
- 2021QuestEval: Summarization Asks for Fact-based Evaluationcited by 241
- 2020GSum: A General Framework for Guided Neural Abstractive Summarizationcited by 129
- 2020Evaluating Factuality in Generation with Dependency-level Entailmentcited by 122
- 2018Multilingual Constituency Parsing with Self-Attention and Pre-Trainingcited by 117
- 2020Automatic Machine Translation Evaluation in Many Languages via Zero-Shot Paraphrasingcited by 114
- 2019Answers Unite! Unsupervised Metrics for Reinforced Summarization Modelscited by 92
- 2020Towards Question-Answering as an Automatic Metric for Evaluating the Content Quality of a Summarycited by 87
- 2020Fill in the BLANC: Human-free quality estimation of document summariescited by 80
- 2020SUPERT: Towards New Frontiers in Unsupervised Evaluation Metrics for Multi-Document Summarizationcited by 69
- 2019Neural Module Networks for Reasoning over Textcited by 65
- 2018Large-Scale QA-SRL Parsingcited by 45
- 2021Finding a Balanced Degree of Automation for Summary Evaluationcited by 43
- 2020MOCHA: A Dataset for Training and Evaluating Generative Reading Comprehension Metricscited by 42
- 2021Automatic Text Evaluation through the Lens of Wasserstein Barycenterscited by 38
- 2020RoFT: A Tool for Evaluating Human Detection of Machine-Generated Textcited by 36
- 2020NUBIA: NeUral Based Interchangeability Assessor for Text Generationcited by 34
- 2021InfoLM: A New Metric to Evaluate Summarization & Data2Text Generationcited by 33
- 2021Asking It All: Generating Contextualized Questions for any Semantic Rolecited by 22
- 2020SacreROUGE: An Open-Source Library for Using and Developing Summarization Evaluation Metricscited by 18
- 2021A Pseudo-Metric between Probability Distributions based on Depth-Trimmed Regionscited by 17
Built on by
Citing papers per year: 2022: 2.
2 papers.