mlsanityData to 7 Oct 2026

End-to-End NLP Knowledge Graph Construction

arXiv 2106.01167 ↗First posted 2 Jun 2021cs.CLcited by 21

Not on the map. Why?

Abstract (arXiv)

This paper studies the end-to-end construction of an NLP Knowledge Graph (KG) from scientific papers. We focus on extracting four types of relations: evaluatedOn between tasks and datasets, evaluatedBy between tasks and evaluation metrics, as well as coreferent and related relations between the same type of entities. For instance, F1-score is coreferent with F-measure. We introduce novel methods for each of these relation types and apply our final framework (SciNLP-KG) to 30,000 NLP papers from ACL Anthology to build a large-scale KG, which can facilitate automatically constructing scientific leaderboards for the NLP community. The results of our experiments indicate that the resulting KG contains high-quality information.

Key facts. Cited by 21 papers in the map (data through 7 Oct 2026). Builds on 17 of its 33 references that are in the map. First posted on arXiv 2 Jun 2021.

Builds on

17 of 33 references.

References · 17

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
  3. 2013Distributed Representations of Words and Phrases and their Compositionalitycited by 3,462
  4. 2015A large annotated corpus for learning natural language inferencecited by 1,837
  5. 2019SciBERT: A Pretrained Language Model for Scientific Textcited by 1,404
  6. 2018Multi-Task Identification of Entities, Relations, and Coreference for Scientific Knowledge Graph Constructioncited by 321
  7. 2019Entity, Relation, and Event Extraction with Contextualized Span Representationscited by 261
  8. 2017End-to-end Neural Coreference Resolutioncited by 240
  9. 2016End-to-End Relation Extraction using LSTMs on Sequences and Tree Structurescited by 161
  10. 2018Construction of the Literature Graph in Semantic Scholarcited by 118
  11. 2020SciREX: A Challenge Dataset for Document-Level Information Extractioncited by 111
  12. 2017SemEval 2017 Task 10: ScienceIE - Extracting Keyphrases and Relations from Scientific Publicationscited by 101
5 more
  1. 2019A Re-evaluation of Knowledge Graph Completion Methodscited by 73
  2. 2019Identification of Tasks, Datasets, Evaluation Metrics, and Numeric Scores for Scientific Leaderboards Constructioncited by 50
  3. 2021TDMSci: A Specialized Corpus for Scientific Literature Entity Tagging of Tasks Datasets and Metricscited by 29
  4. 2017Scientific Information Extraction with Semi-supervised Neural Taggingcited by 24
  5. 2017Multi-Task Learning of Keyphrase Boundary Classificationcited by 8

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2022: 3; 2023: 10; 2024: 4; 2025: 2; 2026: 2.

21 papers.

Sort:

By area:

  1. 2024KG-RAG: Bridging the Gap Between Knowledge and Creativitycited by 55
  2. 2023Information Screening whilst Exploiting! Multimodal Relation Extraction with Feature Denoising and Multimodal Topic Modelingcited by 16
  3. 2024SciDoc2Diagrammer-MAF: Towards Generation of Scientific Diagrams from Documents guided by Multi-Aspect Feedback Refinementcited by 15
  4. 2023A Diachronic Analysis of Paradigm Shifts in NLP Research: When, How, and Why?cited by 14
  5. 2022Construction and Applications of Billion-Scale Pre-Trained Multimodal Business Knowledge Graphcited by 13
  6. 2023GSAP-NER: A Novel Task, Corpus, and Baseline for Scholarly Entity Extraction Focused on Machine Learning Models and Datasetscited by 12
  7. 2023ORKG-Leaderboards: A Systematic Workflow for Mining Leaderboards as a Knowledge Graphcited by 11
  8. 2024Efficient Performance Tracking: Leveraging Large Language Models for Automated Construction of Scientific Leaderboardscited by 10
  9. 2022Computer Science Named Entity Recognition in the Open Research Knowledge Graphcited by 9
  10. 2023Zero-shot Entailment of Leaderboards for Empirical AI Researchcited by 6
  11. 2023Beyond Isolation: Multi-Agent Synergy for Improving Knowledge Graph Constructioncited by 5
  12. 2025A Position Paper on the Automatic Generation of Machine Learning Leaderboardscited by 3
9 more
  1. 2023Domain Knowledge Graph Construction Via A Simple Checkercited by 2
  2. 2025TaxoAlign: Scholarly Taxonomy Generation Using Language Modelscited by 2
  3. 2022Overview of STEM Science as Process, Method, Material, and Data Named Entitiescited by 0
  4. 2023'Don't Get Too Technical with Me': A Discourse Structure-Based Framework for Science Journalismcited by 0
  5. 2023Enhancing AI Research Paper Analysis: Methodology Component Extraction using Factored Transformer-based Sequence Modeling Approachcited by 0
  6. 2023Identifying Planetary Names in Astronomy Papers: A Multi-Step Approachcited by 0
  7. 2024Instruction Finetuning for Leaderboard Generation from Empirical AI Researchcited by 0
  8. 2026MetaLead: A Comprehensive Human-Curated Leaderboard Dataset for Transparent Reporting of Machine Learning Experimentscited by 0
  9. 2026The Scientific Contribution Graph: Automated Literature-based Technological Roadmapping at Scalecited by 0