Unsupervised Knowledge Graph Construction and Event-centric Knowledge Infusion for Scientific NLI
Not on the map. Why?
Abstract (arXiv)
With the advance of natural language inference (NLI), a rising demand for NLI is to handle scientific texts. Existing methods depend on pre-trained models (PTM) which lack domain-specific knowledge. To tackle this drawback, we introduce a scientific knowledge graph to generalize PTM to scientific domain. However, existing knowledge graph construction approaches suffer from some drawbacks, i.e., expensive labeled data, failure to apply in other domains, long inference time and difficulty extending to large corpora. Therefore, we propose an unsupervised knowledge graph construction method to build a scientific knowledge graph (SKG) without any labeled data. Moreover, to alleviate noise effect from SKG and complement knowledge in sentences better, we propose an event-centric knowledge infusion method to integrate external knowledge into each event that is a fine-grained semantic unit in sentences. Experimental results show that our method achieves state-of-the-art performance and the effectiveness and reliability of SKG.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 12 of its 19 references that are in the map. First posted on arXiv 27 Oct 2022.
Builds on
12 of 19 references.
References · 12
- 2017Attention Is All You Needcited by 59,932
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
- 2021SimCSE: Simple Contrastive Learning of Sentence Embeddingscited by 2,168
- 2015A large annotated corpus for learning natural language inferencecited by 1,837
- 2019SciBERT: A Pretrained Language Model for Scientific Textcited by 1,404
- 2018Multi-Task Identification of Entities, Relations, and Coreference for Scientific Knowledge Graph Constructioncited by 321
- 2017SemEval 2017 Task 10: ScienceIE - Extracting Keyphrases and Relations from Scientific Publicationscited by 101
- 2022ClarET: Pre-training a Correlation-Aware Context-To-Event Transformer for Event-Centric Generation and Classificationcited by 45
- 2021EventBERT: A Pre-Trained Model for Event Correlation Reasoningcited by 40
- 2020Infusing Disease Knowledge into BERT for Health Question Answering, Medical Inference and Disease Name Recognitioncited by 35
- 2022SciNLI: A Corpus for Natural Language Inference on Scientific Textcited by 27
Built on by
Citing papers per year: 2024: 2; 2025: 0; 2026: 1.
3 papers.