Sent2Span: Span Detection for PICO Extraction in the Biomedical Text without Span Annotations
Not on the map. Why?
Abstract (arXiv)
The rapid growth in published clinical trials makes it difficult to maintain up-to-date systematic reviews, which requires finding all relevant trials. This leads to policy and practice decisions based on out-of-date, incomplete, and biased subsets of available clinical evidence. Extracting and then normalising Population, Intervention, Comparator, and Outcome (PICO) information from clinical trial articles may be an effective way to automatically assign trials to systematic reviews and avoid searching and screening - the two most time-consuming systematic review processes. We propose and test a novel approach to PICO span detection. The major difference between our proposed method and previous approaches comes from detecting spans without needing annotated span data and using only crowdsourced sentence-level annotations. Experiments on two datasets show that PICO span detection results achieve much higher results for recall when compared to fully supervised methods with PICO sentence detection at least as good as human annotations. By removing the reliance on expert annotations for span detection, this work could be used in human-machine pipeline for turning low-quality crowdsourced, and sentence-level PICO annotations into structured information that can be used to quickly assign trials to relevant systematic reviews.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 21 of its 34 references that are in the map. First posted on arXiv 6 Sep 2021.
Builds on
21 of 34 references.
References · 21
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
- 2019ALBERT: A Lite BERT for Self-supervised Learning of Language Representationscited by 2,772
- 2018Deep contextualized word representationscited by 2,285
- 2019BioBERT: a pre-trained biomedical language representation model for biomedical text miningcited by 1,935
- 2019SciBERT: A Pretrained Language Model for Scientific Textcited by 1,404
- 2019SpanBERT: Improving Pre-training by Representing and Predicting Spanscited by 832
- 2016Neural Architectures for Named Entity Recognitioncited by 548
- 2016End-to-end Sequence Labeling via Bi-directional LSTM-CNNs-CRFcited by 341
- 2019Transfer Learning in Biomedical Natural Language Processing: An Evaluation of BERT and ELMo on Ten Benchmarking Datasetscited by 298
- 2019Multi-Sentence Argument Linkingcited by 80
9 more
- 2018A Corpus with Multi-Level Annotations of Patients, Interventions and Outcomes to Support Language Processing for Medical Literaturecited by 79
- 2020Every Document Owns Its Structure: Inductive Text Classification via Graph Neural Networkscited by 77
- 2019Text Level Graph Neural Network for Text Classificationcited by 60
- 2019Fine-tuning Pre-Trained Transformer Language Models to Distantly Supervised Relation Extractioncited by 36
- 2019Multi-Grained Named Entity Recognitioncited by 19
- 2018A Span Selection Model for Semantic Role Labelingcited by 15
- 2019HAMNER: Headword Amplified Multi-span Distantly Supervised Method for Domain Specific Named Entity Recognitioncited by 7
- 2019A Study on Agreement in PICO Span Annotationscited by 6
- 2017A shared latent space matrix factorisation method for recommending new trial evidence for systematic review updatescited by 1
Built on by
Citing papers per year: 2024: 2.
2 papers.