Computer Science Named Entity Recognition in the Open Research Knowledge Graph
Not on the map. Why?
Abstract (arXiv)
Domain-specific named entity recognition (NER) on Computer Science (CS) scholarly articles is an information extraction task that is arguably more challenging for the various annotation aims that can beset the task and has been less studied than NER in the general domain. Given that significant progress has been made on NER, we believe that scholarly domain-specific NER will receive increasing attention in the years to come. Currently, progress on CS NER -- the focus of this work -- is hampered in part by its recency and the lack of a standardized annotation aim for scientific entities/terms. This work proposes a standardized task by defining a set of seven contribution-centric scholarly entities for CS NER viz., research problem, solution, resource, language, tool, method, and dataset. Following which, its main contributions are: combines existing CS NER resources that maintain their annotation focus on the set or subset of contribution-centric scholarly entities we consider; further, noting the need for big data to train neural NER models, this work additionally supplies thousands of contribution-centric entity annotations from article titles and abstracts, thus releasing a cumulative large novel resource for CS NER; and, finally, trains a sequence labeling CS NER model inspired after state-of-the-art neural architectures from the general domain NER task. Throughout the work, several practical considerations are made which can be useful to information technology designers of the digital libraries.
Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Builds on 25 of its 94 references that are in the map. First posted on arXiv 28 Mar 2022.
Builds on
25 of 94 references.
References · 25
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2019SciBERT: A Pretrained Language Model for Scientific Textcited by 1,404
- 2016Neural Architectures for Named Entity Recognitioncited by 548
- 2016End-to-end Sequence Labeling via Bi-directional LSTM-CNNs-CRFcited by 341
- 2018Multi-Task Identification of Entities, Relations, and Coreference for Scientific Knowledge Graph Constructioncited by 321
- 2015Named Entity Recognition with Bidirectional LSTM-CNNscited by 201
- 2015Character-Aware Neural Language Modelscited by 129
- 2020SciREX: A Challenge Dataset for Document-Level Information Extractioncited by 111
- 2017SemEval 2017 Task 10: ScienceIE - Extracting Keyphrases and Relations from Scientific Publicationscited by 101
- 2017Semi-supervised sequence tagging with bidirectional language modelscited by 86
- 2019MedMentions: A Large Biomedical Corpus Annotated with UMLS Conceptscited by 79
- 2014Growth rates of modern science: A bibliometric analysis based on the number of publications and cited referencescited by 63
13 more
- 2019Identification of Tasks, Datasets, Evaluation Metrics, and Numeric Scores for Scientific Leaderboards Constructioncited by 50
- 2019The Materials Science Procedural Text Corpus: Annotating Materials Synthesis Procedures with Shallow Semantic Structurescited by 48
- 2017Transfer Learning for Sequence Tagging with Hierarchical Recurrent Networkscited by 30
- 2018NCRF++: An Open-source Neural Sequence Labeling Toolkitcited by 29
- 2017NeuroNER: an easy-to-use program for named-entity recognition based on neural networkscited by 25
- 2021End-to-End NLP Knowledge Graph Constructioncited by 21
- 2018An Annotated Corpus for Machine Reading of Instructions in Wet Lab Protocolscited by 18
- 2021SemEval-2021 Task 11: NLPContributionGraph -- Structuring Scholarly NLP Contributions for a Research Knowledge Graphcited by 16
- 2021Automated Mining of Leaderboards for Empirical AI Researchcited by 16
- 2020Annotating and Extracting Synthesis Process of All-Solid-State Batteries from Scientific Literaturecited by 15
- 2020The STEM-ECR Dataset: Grounding Scientific Entity References in STEM Scholarly Content to Authoritative Encyclopedic and Lexicographic Sourcescited by 9
- 2016An Investigation of Recurrent Neural Architectures for Drug Name Recognitioncited by 4
- 2021Pattern-based Acquisition of Scientific Entities from Scholarly Article Titlescited by 4
Built on by
Citing papers per year: 2022: 2; 2023: 2; 2024: 2; 2025: 2; 2026: 1.
9 papers.
- 2023GSAP-NER: A Novel Task, Corpus, and Baseline for Scholarly Entity Extraction Focused on Machine Learning Models and Datasetscited by 12
- 2023ORKG-Leaderboards: A Systematic Workflow for Mining Leaderboards as a Knowledge Graphcited by 11
- 2025Mining for Species, Locations, Habitats, and Ecosystems from Scientific Papers in Invasion Biology: A Large-Scale Exploratory Study with Large Language Modelscited by 4
- 2022Clustering Semantic Predicates in the Open Research Knowledge Graphcited by 1
- 2024Astro-NER -- Astronomy Named Entity Recognition: Is GPT a Good Domain Expert Annotator?cited by 1
- 2022Overview of STEM Science as Process, Method, Material, and Data Named Entitiescited by 0
- 2024Instruction Finetuning for Leaderboard Generation from Empirical AI Researchcited by 0
- 2025Charting the Future of Scholarly Knowledge with AI: A Community Perspectivecited by 0
- 2026Nested Named Entity Recognition in Plasma Physics Research Articlescited by 0
- 2026Nested Named Entity Recognition in Plasma Physics Research Articles17 Jan 2026
- 2025Charting the Future of Scholarly Knowledge with AI: A Community Perspective27 Aug 2025
- 2025Mining for Species, Locations, Habitats, and Ecosystems from Scientific Papers in Invasion Biology: A Large-Scale Exploratory Study with Large Language Models30 Jan 2025
- 2024Instruction Finetuning for Leaderboard Generation from Empirical AI Research19 Aug 2024
- 2024Astro-NER -- Astronomy Named Entity Recognition: Is GPT a Good Domain Expert Annotator?4 May 2024
- 2023GSAP-NER: A Novel Task, Corpus, and Baseline for Scholarly Entity Extraction Focused on Machine Learning Models and Datasets16 Nov 2023
- 2023ORKG-Leaderboards: A Systematic Workflow for Mining Leaderboards as a Knowledge Graph10 May 2023
- 2022Clustering Semantic Predicates in the Open Research Knowledge Graph5 Oct 2022
- 2022Overview of STEM Science as Process, Method, Material, and Data Named Entities24 May 2022