mlsanityData to 14 Oct 2026

DMDD: A Large-Scale Dataset for Dataset Mentions Detection

arXiv 2305.11779 ↗First posted 19 May 2023cs.CL cs.AIcited by 11

Not on the map. Why?

Abstract (arXiv)

The recognition of dataset names is a critical task for automatic information extraction in scientific literature, enabling researchers to understand and identify research opportunities. However, existing corpora for dataset mention detection are limited in size and naming diversity. In this paper, we introduce the Dataset Mentions Detection Dataset (DMDD), the largest publicly available corpus for this task. DMDD consists of the DMDD main corpus, comprising 31,219 scientific articles with over 449,000 dataset mentions weakly annotated in the format of in-text spans, and an evaluation set, which comprises of 450 scientific articles manually annotated for evaluation purposes. We use DMDD to establish baseline performance for dataset mention detection and linking. By analyzing the performance of various models on DMDD, we are able to identify open problems in dataset mention detection. We invite the community to use our dataset as a challenge to develop novel dataset mention detection models.

Key facts. Cited by 11 papers in the map (data through 14 Oct 2026). Builds on 13 of its 32 references that are in the map. First posted on arXiv 19 May 2023.

Builds on

13 of 32 references.

References · 13

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2013Efficient Estimation of Word Representations in Vector Spacecited by 4,375
  3. 2020Longformer: The Long-Document Transformercited by 3,413
  4. 2018Deep contextualized word representationscited by 2,290
  5. 2019SciBERT: A Pretrained Language Model for Scientific Textcited by 1,414
  6. 2021ColBERTv2: Effective and Efficient Retrieval via Lightweight Late Interactioncited by 476
  7. 2018Multi-Task Identification of Entities, Relations, and Coreference for Scientific Knowledge Graph Constructioncited by 322
  8. 2016Data Programming: Creating Large Training Sets, Quicklycited by 246
  9. 2020SciREX: A Challenge Dataset for Document-Level Information Extractioncited by 113
  10. 2017SemEval 2017 Task 10: ScienceIE - Extracting Keyphrases and Relations from Scientific Publicationscited by 102
  11. 2019Identification of Tasks, Datasets, Evaluation Metrics, and Numeric Scores for Scientific Leaderboards Constructioncited by 50
  12. 2021TDMSci: A Specialized Corpus for Scientific Literature Entity Tagging of Tasks Datasets and Metricscited by 30
1 more
  1. 2019Method and Dataset Mining in Scientific Paperscited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 4; 2025: 5; 2026: 2.

11 papers.

  1. 2024SciER: An Entity and Relation Extraction Dataset for Datasets, Methods, and Tasks in Scientific Documentscited by 21
  2. 2025ChatPD: An LLM-driven Paper-Dataset Networking Systemcited by 7
  3. 2024SciDMT: A Large-Scale Corpus for Detecting Scientific Mentionscited by 6
  4. 2025SciNLP: A Domain-Specific Benchmark for Full-Text Scientific Entity and Relation Extraction in NLPcited by 4
  5. 2026Multi-Disciplinary Dataset Discovery from Citation-Verified Literature Contextscited by 4
  6. 2025A Position Paper on the Automatic Generation of Machine Learning Leaderboardscited by 3
  7. 2025DynClean: Training Dynamics-based Label Cleaning for Distantly-Supervised Named Entity Recognitioncited by 2
  8. 2024Extracting Information in a Low-resource Setting: Case Study on Bioinformatics Workflowscited by 1
  9. 2025Efficient Scientific Full Text Classification: The Case of EICAT Impact Assessmentscited by 1
  10. 2024Enriching Social Science Research via Survey Item Linkingcited by 0
  11. 2026Scaling Performance and Low-Resource Annotation with Many-Shot In-Context Learning for Named Entity Recognitioncited by 0