A Search Engine for Discovery of Scientific Challenges and Directions
Not on the map. Why?
Abstract (arXiv)
Keeping track of scientific challenges, advances and emerging directions is a fundamental part of research. However, researchers face a flood of papers that hinders discovery of important knowledge. In biomedicine, this directly impacts human lives. To address this problem, we present a novel task of extraction and search of scientific challenges and directions, to facilitate rapid knowledge discovery. We construct and release an expert-annotated corpus of texts sampled from full-length papers, labeled with novel semantic categories that generalize across many types of challenges and directions. We focus on a large corpus of interdisciplinary work relating to the COVID-19 pandemic, ranging from biomedicine to areas such as AI and economics. We apply a model trained on our data to identify challenges and directions across the corpus and build a dedicated search engine. In experiments with 19 researchers and clinicians using our system, we outperform a popular scientific search engine in assisting knowledge discovery. Finally, we show that models trained on our resource generalize to the wider biomedical domain and to AI papers, highlighting its broad utility. We make our data, model and search engine publicly available. https://challenges.apps.allenai.org/
Key facts. Cited by 12 papers in the map (data through 14 Oct 2026). Builds on 16 of its 45 references that are in the map. First posted on arXiv 31 Aug 2021.
Builds on
16 of 45 references.
References · 16
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,893
- 2020Don't Stop Pretraining: Adapt Language Models to Domains and Taskscited by 1,565
- 2019SciBERT: A Pretrained Language Model for Scientific Textcited by 1,414
- 2019Benchmarking Zero-shot Text Classification: Datasets, Evaluation and Entailment Approachcited by 308
- 2019ScispaCy: Fast and Robust Models for Biomedical Natural Language Processingcited by 244
- 2020CORD-19: The COVID-19 Open Research Datasetcited by 180
- 2020With Little Power Comes Great Responsibilitycited by 142
- 2017PubMed 200k RCT: a Dataset for Sequential Sentence Classification in Medical Abstractscited by 124
- 2020SciREX: A Challenge Dataset for Document-Level Information Extractioncited by 113
- 2019MedMentions: A Large Biomedical Corpus Annotated with UMLS Conceptscited by 80
- 2017Accelerating Innovation Through Analogy Miningcited by 32
4 more
- 2020Syntactic Search by Examplecited by 20
- 2020SciSight: Combining faceted navigation and research group detection for COVID-19 exploratory scientific searchcited by 17
- 2020Extracting a Knowledge Base of Mechanisms from COVID-19 Paperscited by 13
- 2020Interactive Extractive Search over Biomedical Corporacited by 10
Built on by
Citing papers per year: 2021: 2; 2022: 1; 2023: 6; 2024: 2; 2025: 1.
12 papers.
- 2021Multi-Vector Models with Textual Guidance for Fine-Grained Scientific Document Similaritycited by 35
- 2022A Computational Inflection for Scientific Discoverycited by 23
- 2023PubMed and Beyond: Biomedical Literature Search in the Age of Artificial Intelligencecited by 16
- 2024A Survey on Human-Centric LLMscited by 13
- 2024DiscipLink: Unfolding Interdisciplinary Information Seeking Process via Human-AI Co-Explorationcited by 10
- 2023Exploring and Verbalizing Academic Ideas by Concept Co-occurrencecited by 8
- 2023Beyond Good Intentions: Reporting the Research Landscape of NLP for Social Goodcited by 6
- 2021Clinical Evidence Engine: Proof-of-Concept For A Clinical-Domain-Agnostic Decision Support Infrastructurecited by 3
- 2023Good Data, Large Data, or No Data? Comparing Three Approaches in Developing Research Aspect Classifiers for Biomedical Paperscited by 2
- 2023Low-Resource Multi-Granularity Academic Function Recognition Based on Multiple Prompt Knowledgecited by 1
- 2023Speculative Exploration on the Concept of Artificial Agents Conducting Autonomous Researchcited by 1
- 2025GAPMAP: Mapping Scientific Knowledge Gaps in Biomedical Literature Using Large Language Modelscited by 0
- 2025GAPMAP: Mapping Scientific Knowledge Gaps in Biomedical Literature Using Large Language Models29 Oct 2025
- 2024A Survey on Human-Centric LLMs20 Nov 2024
- 2024DiscipLink: Unfolding Interdisciplinary Information Seeking Process via Human-AI Co-Exploration1 Aug 2024
- 2023Speculative Exploration on the Concept of Artificial Agents Conducting Autonomous Research6 Dec 2023
- 2023PubMed and Beyond: Biomedical Literature Search in the Age of Artificial Intelligence18 Jul 2023
- 2023Good Data, Large Data, or No Data? Comparing Three Approaches in Developing Research Aspect Classifiers for Biomedical Papers7 Jun 2023
- 2023Exploring and Verbalizing Academic Ideas by Concept Co-occurrence4 Jun 2023
- 2023Beyond Good Intentions: Reporting the Research Landscape of NLP for Social Good9 May 2023
- 2023Low-Resource Multi-Granularity Academic Function Recognition Based on Multiple Prompt Knowledge5 May 2023
- 2022A Computational Inflection for Scientific Discovery4 May 2022
- 2021Multi-Vector Models with Textual Guidance for Fine-Grained Scientific Document Similarity16 Nov 2021
- 2021Clinical Evidence Engine: Proof-of-Concept For A Clinical-Domain-Agnostic Decision Support Infrastructure31 Oct 2021