EviStreams: Human-in-the-Loop AI Data Extraction for Systematic Reviews in Medicine
Not on the map. Why?
Abstract (arXiv)
Systematic reviews underpin clinical guidelines, yet their data-extraction step is a major expert-labor bottleneck bound by a protocolized workflow: two reviewers extract each study independently, an adjudicator resolves disagreements, and the team keeps an auditable record of how every value was produced. Large language models can assist with extraction, but that assistance must fit established review protocols and preserve reproducibility. We present EviStreams, a live, open-source, no-code web platform that puts review teams in control of AI-assisted extraction at three key stages: program design (a structured decomposition approved before any code runs), field specification (typed field definitions calibrated from a pilot), and extracted predictions (reviewer-blinded dual review with adjudication). Working through a form builder, a domain expert defines typed fields rather than prompts, runs extraction over uploaded PDFs, inspects every value alongside the supporting passage it came from, and resolves a reviewer-blinded dual review into an auditable consensus export. An evaluation across four clinical corpora and three frontier model families, released with the system, shows that extraction quality is shaped far more by the field specification than by the choice of model. EviStreams is live at https://evistreams.com/demo and released under Apache-2.0.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 11 of its 35 references that are in the map. First posted on arXiv 23 Sep 2026.
Builds on
11 of 35 references.
References · 11
- 2023DSPy: Compiling Declarative Language Model Calls into Self-Improving Pipelinescited by 832
- 2022Decomposed Prompting: A Modular Approach for Solving Complex Taskscited by 558
- 2024Optimizing Instructions and Demonstrations for Multi-Stage Language Model Programscited by 291
- 2022POTATO: The Portable Text Annotation Toolcited by 64
- 2020Trialstreamer: Mapping and Browsing Medical Evidence in Real-Timecited by 12
- 2025What Level of Automation is "Good Enough"? A Benchmark of Large Language Models for Meta-Analysis Data Extractioncited by 6
- 2025ROBoto2: An Interactive System and Dataset for LLM-assisted Clinical Trial Risk of Bias Assessmentcited by 3
- 2026ScheMatiQ: From Research Question to Structured Data through Interactive Schema Discoverycited by 3
- 2025DocSpiral: A Platform for Integrated Assistive Document Annotation through Human-in-the-Spiralcited by 2
- 2025ClinicalTrialsHub: Bridging Registries and Literature for Comprehensive Clinical Trial Accesscited by 1
- 2026AutoForest: Automatically Generating Forest Plots from Biomedical Studies with End-to-End Evidence Extraction and Synthesiscited by 1
Built on by
Not cited yet.