mlsanityData to 7 Oct 2026

SemEval 2017 Task 10: ScienceIE - Extracting Keyphrases and Relations from Scientific Publications

arXiv 1704.02853 ↗First posted 10 Apr 2017cs.CL cs.AI stat.MLcited by 101

Not on the map. Why?

Abstract (arXiv)

We describe the SemEval task of extracting keyphrases and relations between them from scientific documents, which is crucial for understanding which publications describe which processes, tasks and materials. Although this was a new task, we had a total of 26 submissions across 3 evaluation scenarios. We expect the task and the findings reported in this paper to be relevant for researchers working on understanding scientific content, as well as the broader knowledge base population and information extraction communities.

Key facts. Cited by 101 papers in the map (data through 7 Oct 2026). First posted on arXiv 10 Apr 2017.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2020: 1; 2021: 29; 2022: 28; 2023: 15; 2024: 13; 2025: 11; 2026: 4.

101 papers.

Sort:

By area:

  1. 2021RadGraph: Extracting Clinical Entities and Relations from Radiology Reportscited by 310
  2. 2021Lifelong Pretraining: Continually Adapting Language Models to Emerging Corporacited by 114
  3. 2021Learning Rich Representation of Keyphrases from Textcited by 36
  4. 2021TDMSci: A Specialized Corpus for Scientific Literature Entity Tagging of Tasks Datasets and Metricscited by 29
  5. 2024LLMs Are Biased Towards Output Formats! Systematically Evaluating and Mitigating Output Format Bias of LLMscited by 24
  6. 2021End-to-End NLP Knowledge Graph Constructioncited by 21
  7. 2022Norm of Word Embedding Encodes Information Gaincited by 21
  8. 2023A Comprehensive Survey on Relation Extraction: Recent Advances and New Frontierscited by 21
  9. 2021MDERank: A Masked Document Embedding Rank Approach for Unsupervised Keyphrase Extractioncited by 20
  10. 2024SciER: An Entity and Relation Extraction Dataset for Datasets, Methods, and Tasks in Scientific Documentscited by 20
  11. 2021CitationIE: Leveraging the Citation Graph for Scientific Information Extractioncited by 19
  12. 2022PatternRank: Leveraging Pretrained Language Models and Part of Speech for Unsupervised Keyphrase Extractioncited by 19
38 more
  1. 2021CiteWorth: Cite-Worthiness Detection for Improved Scientific Document Understandingcited by 17
  2. 2022What do You Mean by Relation Extraction? A Survey on Datasets and Study on Scientific Relation Classificationcited by 17
  3. 2021Automated Mining of Leaderboards for Empirical AI Researchcited by 16
  4. 2020Active Imitation Learning with Noisy Guidancecited by 15
  5. 2025PaperArena: An Evaluation Benchmark for Tool-Augmented Agentic Reasoning on Scientific Literaturecited by 15
  6. 2022LDKP: A Dataset for Identifying Keyphrases from Long Scientific Documentscited by 13
  7. 2021Transformers: "The End of History" for NLP?cited by 12
  8. 2021Keyphrase Generation Beyond the Boundaries of Title and Abstractcited by 12
  9. 2023ChatGPT vs State-of-the-Art Models: A Benchmarking Study in Keyphrase Generation Taskcited by 12
  10. 2021Cross-Domain Multi-Task Learning for Sequential Sentence Classification in Research Paperscited by 11
  11. 2021Redefining Absent Keyphrases and their Effect on Retrieval Effectivenesscited by 11
  12. 2023ORKG-Leaderboards: A Systematic Workflow for Mining Leaderboards as a Knowledge Graphcited by 11
  13. 2023DMDD: A Large-Scale Dataset for Dataset Mentions Detectioncited by 11
  14. 2024Can LLMs be Good Graph Judge for Knowledge Graph Construction?cited by 11
  15. 2021Extracting Fine-Grained Knowledge Graphs of Scientific Claims: Dataset and Transformer-Based Resultscited by 10
  16. 2022ReSel: N-ary Relation Extraction from Scientific Text and Tables by Learning to Retrieve and Selectcited by 10
  17. 2022Computer Science Named Entity Recognition in the Open Research Knowledge Graphcited by 9
  18. 2023Data Augmentation for Low-Resource Keyphrase Generationcited by 8
  19. 2021Scaling Creative Inspiration with Fine-Grained Functional Aspects of Ideascited by 7
  20. 2022Applying Transformer-based Text Summarization for Keyphrase Generationcited by 6
  21. 2022PcMSP: A Dataset for Scientific Action Graphs Extraction from Polycrystalline Materials Synthesis Procedure Textcited by 6
  22. 2022A Large-Scale Dataset for Biomedical Keyphrase Generationcited by 6
  23. 2024SciDMT: A Large-Scale Corpus for Detecting Scientific Mentionscited by 6
  24. 2022Extracting Mathematical Concepts from Textcited by 5
  25. 2021Determining the Credibility of Science Communicationcited by 4
  26. 2021Phraseformer: Multimodal Key-phrase Extraction using Transformer and Graph Embeddingcited by 4
  27. 2021Pattern-based Acquisition of Scientific Entities from Scholarly Article Titlescited by 4
  28. 2022A Review on Method Entities in the Academic Literature: Extraction, Evaluation, and Applicationcited by 4
  29. 2025Mining for Species, Locations, Habitats, and Ecosystems from Scientific Papers in Invasion Biology: A Large-Scale Exploratory Study with Large Language Modelscited by 4
  30. 2025SciNLP: A Domain-Specific Benchmark for Full-Text Scientific Entity and Relation Extraction in NLPcited by 4
  31. 2021A New Entity Extraction Method Based on Machine Reading Comprehensioncited by 3
  32. 2021Easy Semantification of Bioassayscited by 3
  33. 2022Sequence-Based Extractive Summarisation for Scientific Articlescited by 3
  34. 2022Unsupervised Knowledge Graph Construction and Event-centric Knowledge Infusion for Scientific NLIcited by 3
  35. 2023Theme-driven Keyphrase Extraction to Analyze Social Media Discoursecited by 3
  36. 2024A Preliminary Empirical Study on Prompt-based Unsupervised Keyphrase Extractioncited by 3
  37. 2024Pre-Trained Language Models for Keyphrase Prediction: A Reviewcited by 3
  38. 2025A Position Paper on the Automatic Generation of Machine Learning Leaderboardscited by 3

50 most cited of 101 All 101 (JSON)