mlsanityData to 14 Oct 2026

A Search Engine for Discovery of Scientific Challenges and Directions

arXiv 2108.13751 ↗First posted 31 Aug 2021cs.CL cs.HC cs.IRcited by 12

Not on the map. Why?

Abstract (arXiv)

Keeping track of scientific challenges, advances and emerging directions is a fundamental part of research. However, researchers face a flood of papers that hinders discovery of important knowledge. In biomedicine, this directly impacts human lives. To address this problem, we present a novel task of extraction and search of scientific challenges and directions, to facilitate rapid knowledge discovery. We construct and release an expert-annotated corpus of texts sampled from full-length papers, labeled with novel semantic categories that generalize across many types of challenges and directions. We focus on a large corpus of interdisciplinary work relating to the COVID-19 pandemic, ranging from biomedicine to areas such as AI and economics. We apply a model trained on our data to identify challenges and directions across the corpus and build a dedicated search engine. In experiments with 19 researchers and clinicians using our system, we outperform a popular scientific search engine in assisting knowledge discovery. Finally, we show that models trained on our resource generalize to the wider biomedical domain and to AI papers, highlighting its broad utility. We make our data, model and search engine publicly available. https://challenges.apps.allenai.org/

Key facts. Cited by 12 papers in the map (data through 14 Oct 2026). Builds on 16 of its 45 references that are in the map. First posted on arXiv 31 Aug 2021.

Builds on

16 of 45 references.

References · 16

  1. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  2. 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,893
  3. 2020Don't Stop Pretraining: Adapt Language Models to Domains and Taskscited by 1,565
  4. 2019SciBERT: A Pretrained Language Model for Scientific Textcited by 1,414
  5. 2019Benchmarking Zero-shot Text Classification: Datasets, Evaluation and Entailment Approachcited by 308
  6. 2019ScispaCy: Fast and Robust Models for Biomedical Natural Language Processingcited by 244
  7. 2020CORD-19: The COVID-19 Open Research Datasetcited by 180
  8. 2020With Little Power Comes Great Responsibilitycited by 142
  9. 2017PubMed 200k RCT: a Dataset for Sequential Sentence Classification in Medical Abstractscited by 124
  10. 2020SciREX: A Challenge Dataset for Document-Level Information Extractioncited by 113
  11. 2019MedMentions: A Large Biomedical Corpus Annotated with UMLS Conceptscited by 80
  12. 2017Accelerating Innovation Through Analogy Miningcited by 32
4 more
  1. 2020Syntactic Search by Examplecited by 20
  2. 2020SciSight: Combining faceted navigation and research group detection for COVID-19 exploratory scientific searchcited by 17
  3. 2020Extracting a Knowledge Base of Mechanisms from COVID-19 Paperscited by 13
  4. 2020Interactive Extractive Search over Biomedical Corporacited by 10

Built on by

Cited by year

Citing papers per year: 2021: 2; 2022: 1; 2023: 6; 2024: 2; 2025: 1.

12 papers.