Sequence tagging for biomedical extractive question answering
Not on the map. Why?
Abstract (arXiv)
Current studies in extractive question answering (EQA) have modeled the single-span extraction setting, where a single answer span is a label to predict for a given question-passage pair. This setting is natural for general domain EQA as the majority of the questions in the general domain can be answered with a single span. Following general domain EQA models, current biomedical EQA (BioEQA) models utilize the single-span extraction setting with post-processing steps. In this article, we investigate the question distribution across the general and biomedical domains and discover biomedical questions are more likely to require list-type answers (multiple answers) than factoid-type answers (single answer). This necessitates the models capable of producing multiple answers for a question. Based on this preliminary study, we propose a sequence tagging approach for BioEQA, which is a multi-span extraction setting. Our approach directly tackles questions with a variable number of phrases as their answer and can learn to decide the number of answers for a question from training data. Our experimental results on the BioASQ 7b and 8b list-type questions outperformed the best-performing existing models without requiring post-processing steps. Source codes and resources are freely available for download at https://github.com/dmis-lab/SeqTagQA
Key facts. Cited by 12 papers in the map (data through 7 Oct 2026). Builds on 25 of its 48 references that are in the map. First posted on arXiv 15 Apr 2021.
Builds on
25 of 48 references.
References · 25
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2016SQuAD: 100,000+ Questions for Machine Comprehension of Textcited by 4,115
- 2018HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answeringcited by 3,686
- 2019BoolQ: Exploring the Surprising Difficulty of Natural Yes/No Questionscited by 2,140
- 2019BioBERT: a pre-trained biomedical language representation model for biomedical text miningcited by 1,935
- 2016MS MARCO: A Human Generated MAchine Reading COmprehension Datasetcited by 1,591
- 2018Know What You Don't Know: Unanswerable Questions for SQuADcited by 1,538
- 2016Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translationcited by 1,471
- 2019PubMedQA: A Dataset for Biomedical Research Question Answeringcited by 1,271
- 2015Teaching Machines to Read and Comprehendcited by 1,039
- 2020Domain-Specific Language Model Pretraining for Biomedical Natural Language Processingcited by 996
- 2015Bidirectional LSTM-CRF Models for Sequence Taggingcited by 544
13 more
- 2019Transfer Learning in Biomedical Natural Language Processing: An Evaluation of BERT and ELMo on Ten Benchmarking Datasetscited by 298
- 2016Bidirectional Attention Flow for Machine Comprehensioncited by 278
- 2019A Unified MRC Framework for Named Entity Recognitioncited by 199
- 2017DuReader: a Chinese Machine Reading Comprehension Dataset from Real-world Applicationscited by 110
- 2019Entity-Relation Extraction as Multi-Turn Question Answeringcited by 96
- 2020Biomedical Entity Representations with Synonym Marginalizationcited by 59
- 2020BIOMRC: A Dataset for Biomedical Machine Reading Comprehensioncited by 35
- 2017Making Neural QA as Simple as Possible but not Simplercited by 33
- 2019Pre-trained Language Model for Biomedical Question Answeringcited by 31
- 2017Neural Domain Adaptation for Biomedical Question Answeringcited by 30
- 2020Results of the seventh edition of the BioASQ Challengecited by 28
- 2018CollaboNet: collaboration of deep neural networks for biomedical named entity recognitioncited by 10
- 2020Transferability of Natural Language Inference to Biomedical Question Answeringcited by 10
Built on by
Citing papers per year: 2021: 2; 2022: 1; 2023: 4; 2024: 1; 2025: 3; 2026: 1.
12 papers.
- 2021Pre-trained Language Models in Biomedical Domain: A Systematic Surveycited by 87
- 2021Overview of BioASQ 2021: The ninth BioASQ challenge on Large-Scale Biomedical Semantic Indexing and Question Answeringcited by 19
- 2023LIQUID: A Framework for List Question Answering Dataset Generationcited by 19
- 2025DocHop-QA: Towards Multi-Hop Reasoning over Multimodal Document Collectionscited by 7
- 2023Explanatory Argument Extraction of Correct Answers in Resident Medical Examscited by 6
- 2025LOCORE: Image Re-ranking with Long-Context Sequence Modelingcited by 5
- 2023Adapting Pre-trained Generative Models for Extractive Question Answeringcited by 4
- 2022Development of an Extractive Clinical Question Answering Dataset with Multi-Answer and Multi-Focus Questionscited by 3
- 2023Advancing Italian Biomedical Information Extraction with Transformers-based Models: Methodological Insights and Multicenter Practical Applicationcited by 3
- 2024Question answering systems for health professionals at the point of care -- a systematic reviewcited by 3
- 2025Evaluating List Construction and Temporal Understanding capabilities of Large Language Modelscited by 1
- 2026Causal Connections: Leveraging Multilingual Fine-Tuning for Financial QA@FinCausal 2026cited by 0
- 2026Causal Connections: Leveraging Multilingual Fine-Tuning for Financial QA@FinCausal 202625 Jun 2026
- 2025DocHop-QA: Towards Multi-Hop Reasoning over Multimodal Document Collections20 Aug 2025
- 2025Evaluating List Construction and Temporal Understanding capabilities of Large Language Models26 Jun 2025
- 2025LOCORE: Image Re-ranking with Long-Context Sequence Modeling27 Mar 2025
- 2024Question answering systems for health professionals at the point of care -- a systematic review24 Jan 2024
- 2023Explanatory Argument Extraction of Correct Answers in Resident Medical Exams1 Dec 2023
- 2023Adapting Pre-trained Generative Models for Extractive Question Answering6 Nov 2023
- 2023Advancing Italian Biomedical Information Extraction with Transformers-based Models: Methodological Insights and Multicenter Practical Application8 Jun 2023
- 2023LIQUID: A Framework for List Question Answering Dataset Generation3 Feb 2023
- 2022Development of an Extractive Clinical Question Answering Dataset with Multi-Answer and Multi-Focus Questions7 Jan 2022
- 2021Pre-trained Language Models in Biomedical Domain: A Systematic Survey11 Oct 2021
- 2021Overview of BioASQ 2021: The ninth BioASQ challenge on Large-Scale Biomedical Semantic Indexing and Question Answering28 Jun 2021