A Large-Scale, Cross-Disciplinary Corpus of Systematic Reviews
Not on the map. Why?
Abstract (arXiv)
Existing benchmarks for systematic reviewing remain limited either in scale or in disciplinary coverage, with some collections comprising only a modest number of topics and others focusing primarily on biomedical research. We present Webis-SR4ALL-26, a large-scale, cross-disciplinary corpus of 301,871 systematic reviews spanning all scientific fields as covered by OpenAlex. Using a multi-stage pre-processing pipeline, we link reviews to resolved OpenAlex metadata and reference lists and extract, when explicitly reported, structured method artifacts relevant to retrieval and screening. These artifacts include reported search strategies (Boolean queries or keyword lists) that we normalize into executable approximations, as well as reported inclusion and exclusion criteria. Together, these layers support cross-domain benchmarking of retrieval and screening components against review reference lists, training and evaluation of extraction methods for review artifacts, and comparative meta-science analyses of systematic review practices across disciplines and time. To demonstrate one concrete use case, we report large-scale baseline retrieval signals by executing normalized search strategies in OpenAlex and comparing retrieved sets to resolved reference lists. We release the corpus and the pre-processing pipeline, along with code used for extraction validation and the retrieval demonstration.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 4 of its 34 references that are in the map. First posted on arXiv 23 Apr 2026.
Builds on
4 of 34 references.
References · 4
- 2022OpenAlex: A fully-open index of scholarly works, authors, venues, institutions, and conceptscited by 166
- 2022From Little Things Big Things Grow: A Collection with Seed Studies for Medical Systematic Review Literature Searchcited by 10
- 2024Reference Coverage Analysis of OpenAlex compared to Web of Science and Scopuscited by 10
- 2025SafePassage: High-Fidelity Information Extraction with Black Box LLMscited by 2
Built on by
Not cited yet.