KGSynNet: A Novel Entity Synonyms Discovery Framework with Knowledge Graph
Not on the map. Why?
Abstract (arXiv)
Entity synonyms discovery is crucial for entity-leveraging applications. However, existing studies suffer from several critical issues: (1) the input mentions may be out-of-vocabulary (OOV) and may come from a different semantic space of the entities; (2) the connection between mentions and entities may be hidden and cannot be established by surface matching; and (3) some entities rarely appear due to the long-tail effect. To tackle these challenges, we facilitate knowledge graphs and propose a novel entity synonyms discovery framework, named KGSynNet. Specifically, we pre-train subword embeddings for mentions and entities using a large-scale domain-specific corpus while learning the knowledge embeddings of entities via a joint TransC-TransE model. More importantly, to obtain a comprehensive representation of entities, we employ a specifically designed fusion gate to adaptively absorb the entities' knowledge information into their semantic features. We conduct extensive experiments to demonstrate the effectiveness of our KGSynNet in leveraging the knowledge graph. The experimental results show that the KGSynNet improves the state-of-the-art methods by 14.7% in terms of hits@3 in the offline evaluation and outperforms the BERT model by 8.3% in the positive feedback rate of an online A/B test on the entity linking module of a question answering system.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 14 of its 36 references that are in the map. First posted on arXiv 16 Mar 2021.
Builds on
14 of 36 references.
References · 14
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2013Distributed Representations of Words and Phrases and their Compositionalitycited by 3,462
- 2016Enriching Word Vectors with Subword Informationcited by 1,578
- 2019ERNIE: Enhanced Language Representation with Informative Entitiescited by 525
- 2016Enhanced LSTM for Natural Language Inferencecited by 199
- 2015Training Very Deep Networkscited by 172
- 2020Biomedical Entity Representations with Synonym Marginalizationcited by 59
- 2018Improving Natural Language Inference Using External Knowledge in the Science Questions Domaincited by 48
- 2015Natural Language Inference by Tree-Based Convolution and Heuristic Matchingcited by 42
- 2018Differentiating Concepts and Instances for Knowledge Graph Embeddingcited by 27
- 2020Medical Entity Linking using Triplet Networkcited by 10
- 2015Medical Synonym Extraction with Concept Space Modelscited by 3
2 more
Built on by
Citing papers per year: 2021: 2; 2022: 0; 2023: 1; 2024: 1.
4 papers.
- 2021Differentially Private Federated Knowledge Graphs Embeddingcited by 45
- 2021Reinforced Neighborhood Selection Guided Multi-Relational Graph Neural Networkscited by 38
- 2024Large Language Models for Medicine: A Surveycited by 38
- 2023Natural Language Interfaces for Tabular Data Querying and Visualization: A Surveycited by 27
- 2024Large Language Models for Medicine: A Survey20 May 2024
- 2023Natural Language Interfaces for Tabular Data Querying and Visualization: A Survey27 Oct 2023
- 2021Differentially Private Federated Knowledge Graphs Embedding17 May 2021
- 2021Reinforced Neighborhood Selection Guided Multi-Relational Graph Neural Networks16 Apr 2021