Overview of BioASQ 2020: The eighth BioASQ challenge on Large-Scale Biomedical Semantic Indexing and Question Answering
Not on the map. Why?
Abstract (arXiv)
In this paper, we present an overview of the eighth edition of the BioASQ challenge, which ran as a lab in the Conference and Labs of the Evaluation Forum (CLEF) 2020. BioASQ is a series of challenges aiming at the promotion of systems and methodologies for large-scale biomedical semantic indexing and question answering. To this end, shared tasks are organized yearly since 2012, where different teams develop systems that compete on the same demanding benchmark datasets that represent the real information needs of experts in the biomedical domain. This year, the challenge has been extended with the introduction of a new task on medical semantic indexing in Spanish. In total, 34 teams with more than 100 systems participated in the three tasks of the challenge. As in previous years, the results of the evaluation reveal that the top-performing systems managed to outperform the strong baselines, which suggests that state-of-the-art systems keep pushing the frontier of research through continuous improvements.
Key facts. Cited by 13 papers in the map (data through 7 Oct 2026). Builds on 23 of its 53 references that are in the map. First posted on arXiv 28 Jun 2021.
Builds on
23 of 53 references.
References · 23
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2017Proximal Policy Optimization Algorithmscited by 14,441
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
- 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,874
- 2016SQuAD: 100,000+ Questions for Machine Comprehension of Textcited by 4,115
- 2019XLNet: Generalized Autoregressive Pretraining for Language Understandingcited by 2,801
- 2017A Broad-Coverage Challenge Corpus for Sentence Understanding through Inferencecited by 2,665
- 2018Deep contextualized word representationscited by 2,285
- 2018SentencePiece: A simple and language independent subword tokenizer and detokenizer for Neural Text Processingcited by 1,973
- 2019BioBERT: a pre-trained biomedical language representation model for biomedical text miningcited by 1,935
- 2015A large annotated corpus for learning natural language inferencecited by 1,837
- 2020Don't Stop Pretraining: Adapt Language Models to Domains and Taskscited by 1,548
11 more
- 2019PubMedQA: A Dataset for Biomedical Research Question Answeringcited by 1,271
- 2019SpanBERT: Improving Pre-training by Representing and Predicting Spanscited by 832
- 2017Supervised Learning of Universal Sentence Representations from Natural Language Inference Datacited by 428
- 2019ScispaCy: Fast and Robust Models for Biomedical Natural Language Processingcited by 244
- 2018AttentionXML: Label Tree-based Attention-Aware Deep Model for High-Performance Extreme Multi-Label Text Classificationcited by 101
- 2013Evaluation Measures for Hierarchical Classification: a unified view and novel approachescited by 46
- 2019Pre-trained Language Model for Biomedical Question Answeringcited by 31
- 2020Results of the seventh edition of the BioASQ Challengecited by 28
- 2017DeepRank: A New Deep Architecture for Relevance Ranking in Information Retrievalcited by 21
- 2020Zero-shot Neural Passage Retrieval via Domain-targeted Synthetic Question Generationcited by 8
- 2019Classification Betters Regression in Query-based Multi-document Summarisation Techniques for Question Answering: Macquarie University at BioASQ7bcited by 4
Built on by
Citing papers per year: 2021: 1; 2022: 4; 2023: 6; 2024: 0; 2025: 2.
13 papers.
Sort:
- 2023LIQUID: A Framework for List Question Answering Dataset Generationcited by 19
- 2023Chain-of-Skills: A Configurable Model for Open-domain Question Answeringcited by 19
- 2023Overview of BioASQ 2023: The eleventh BioASQ challenge on Large-Scale Biomedical Semantic Indexing and Question Answeringcited by 18
- 2021Mixture-of-Partitions: Infusing Large Biomedical Knowledge Graphs into BERTcited by 14
- 2022Overview of BioASQ 2022: The tenth BioASQ challenge on Large-Scale Biomedical Semantic Indexing and Question Answeringcited by 9
- 2022UKP-SQUARE: An Online Platform for Question Answering Researchcited by 6
- 2023Explanatory Argument Extraction of Correct Answers in Resident Medical Examscited by 6
- 2022Establishing Strong Baselines for TripClick Health Retrievalcited by 4
- 2025Overview of BioASQ 2024: The twelfth BioASQ challenge on Large-Scale Biomedical Semantic Indexing and Question Answeringcited by 4
- 2022Neural Retriever and Go Beyond: A Thesis Proposalcited by 1
- 2023Empowering Language Model with Guided Knowledge Fusion for Biomedical Document Re-rankingcited by 0
- 2023Question-Answering Model for Schizophrenia Symptoms and Their Impact on Daily Life using Mental Health Forums Datacited by 0
1 more
- 2025IMB: An Italian Medical Benchmark for Question Answeringcited by 0
- 2025IMB: An Italian Medical Benchmark for Question Answering21 Oct 2025
- 2025Overview of BioASQ 2024: The twelfth BioASQ challenge on Large-Scale Biomedical Semantic Indexing and Question Answering28 Aug 2025
- 2023Explanatory Argument Extraction of Correct Answers in Resident Medical Exams1 Dec 2023
- 2023Question-Answering Model for Schizophrenia Symptoms and Their Impact on Daily Life using Mental Health Forums Data30 Sep 2023
- 2023Overview of BioASQ 2023: The eleventh BioASQ challenge on Large-Scale Biomedical Semantic Indexing and Question Answering11 Jul 2023
- 2023Empowering Language Model with Guided Knowledge Fusion for Biomedical Document Re-ranking7 May 2023
- 2023Chain-of-Skills: A Configurable Model for Open-domain Question Answering4 May 2023
- 2023LIQUID: A Framework for List Question Answering Dataset Generation3 Feb 2023
- 2022Overview of BioASQ 2022: The tenth BioASQ challenge on Large-Scale Biomedical Semantic Indexing and Question Answering13 Oct 2022
- 2022Neural Retriever and Go Beyond: A Thesis Proposal31 May 2022
- 2022UKP-SQUARE: An Online Platform for Question Answering Research25 Mar 2022
- 2022Establishing Strong Baselines for TripClick Health Retrieval2 Jan 2022
1 more
- 2023LIQUID: A Framework for List Question Answering Dataset Generationcited by 19
- 2023Chain-of-Skills: A Configurable Model for Open-domain Question Answeringcited by 19
- 2023Overview of BioASQ 2023: The eleventh BioASQ challenge on Large-Scale Biomedical Semantic Indexing and Question Answeringcited by 18
- 2021Mixture-of-Partitions: Infusing Large Biomedical Knowledge Graphs into BERTcited by 14
- 2022Overview of BioASQ 2022: The tenth BioASQ challenge on Large-Scale Biomedical Semantic Indexing and Question Answeringcited by 9
- 2022UKP-SQUARE: An Online Platform for Question Answering Researchcited by 6
- 2023Explanatory Argument Extraction of Correct Answers in Resident Medical Examscited by 6
- 2022Establishing Strong Baselines for TripClick Health Retrievalcited by 4
- 2025Overview of BioASQ 2024: The twelfth BioASQ challenge on Large-Scale Biomedical Semantic Indexing and Question Answeringcited by 4
- 2022Neural Retriever and Go Beyond: A Thesis Proposalcited by 1
- 2023Empowering Language Model with Guided Knowledge Fusion for Biomedical Document Re-rankingcited by 0
- 2023Question-Answering Model for Schizophrenia Symptoms and Their Impact on Daily Life using Mental Health Forums Datacited by 0
12 most cited of 13 All 13 (JSON)
- 2025IMB: An Italian Medical Benchmark for Question Answering21 Oct 2025
- 2025Overview of BioASQ 2024: The twelfth BioASQ challenge on Large-Scale Biomedical Semantic Indexing and Question Answering28 Aug 2025
- 2023Explanatory Argument Extraction of Correct Answers in Resident Medical Exams1 Dec 2023
- 2023Question-Answering Model for Schizophrenia Symptoms and Their Impact on Daily Life using Mental Health Forums Data30 Sep 2023
- 2023Overview of BioASQ 2023: The eleventh BioASQ challenge on Large-Scale Biomedical Semantic Indexing and Question Answering11 Jul 2023
- 2023Empowering Language Model with Guided Knowledge Fusion for Biomedical Document Re-ranking7 May 2023
- 2023Chain-of-Skills: A Configurable Model for Open-domain Question Answering4 May 2023
- 2023LIQUID: A Framework for List Question Answering Dataset Generation3 Feb 2023
- 2022Overview of BioASQ 2022: The tenth BioASQ challenge on Large-Scale Biomedical Semantic Indexing and Question Answering13 Oct 2022
- 2022Neural Retriever and Go Beyond: A Thesis Proposal31 May 2022
- 2022UKP-SQUARE: An Online Platform for Question Answering Research25 Mar 2022
- 2022Establishing Strong Baselines for TripClick Health Retrieval2 Jan 2022
12 newest of 13 All 13 (JSON)