From Discrimination to Generation: Knowledge Graph Completion with Generative Transformer
Not on the map. Why?
Abstract (arXiv)
Knowledge graph completion aims to address the problem of extending a KG with missing triples. In this paper, we provide an approach GenKGC, which converts knowledge graph completion to sequence-to-sequence generation task with the pre-trained language model. We further introduce relation-guided demonstration and entity-aware hierarchical decoding for better representation learning and fast inference. Experimental results on three datasets show that our approach can obtain better or comparable performance than baselines and achieve faster inference speed compared with previous methods with pre-trained language models. We also release a new large-scale Chinese knowledge graph dataset AliopenKG500 for research purpose. Code and datasets are available in https://github.com/zjunlp/PromptKG/tree/main/GenKGC.
Key facts. Cited by 45 papers in the map (data through 13 Oct 2026). Builds on 17 of its 21 references that are in the map. First posted on arXiv 4 Feb 2022.
Builds on
17 of 21 references.
References · 17
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,304
- 2014Embedding Entities and Relations for Learning and Inference in Knowledge Basescited by 930
- 2016Complex Embeddings for Simple Link Predictioncited by 899
- 2019RotatE: Knowledge Graph Embedding by Relational Rotation in Complex Spacecited by 894
- 2017Convolutional 2D Knowledge Graph Embeddingscited by 729
- 2020Autoregressive Entity Retrievalcited by 333
- 2019KG-BERT: BERT for Knowledge Graph Completioncited by 323
- 2019TuckER: Tensor Factorization for Knowledge Graph Completioncited by 290
- 2020Low-Dimensional Hyperbolic Knowledge Graph Embeddingscited by 195
- 2019Learning Attention-based Embeddings for Relation Prediction in Knowledge Graphscited by 125
- 2021Differentiable Prompt Makes Pre-trained Language Models Better Few-shot Learnerscited by 115
- 2021ConE: Cone Embeddings for Multi-Hop Reasoning over Knowledge Graphscited by 78
5 more
- 2022OntoProtein: Protein Pretraining With Gene Ontology Embeddingcited by 70
- 2021GenIE: Generative Information Extractioncited by 53
- 2019Relation Adversarial Network for Low Resource Knowledge Graph Completioncited by 24
- 2022Ontology-enhanced Prompt-tuning for Few-shot Learningcited by 24
- 2022Reasoning Through Memorization: Nearest Neighbor Knowledge Graph Embeddingscited by 12
Built on by
Citing papers per year: 2022: 6; 2023: 13; 2024: 19; 2025: 4; 2026: 3.
45 papers.
Sort:
By area:
- 2023Unifying Large Language Models and Knowledge Graphs: A Roadmapcited by 666
- 2023When Large Language Models Meet Personalization: Perspectives of Challenges and Opportunitiescited by 90
- 2022Generative Knowledge Graph Construction: A Reviewcited by 49
- 2024Graph-constrained Reasoning: Faithful Reasoning on Knowledge Graphs with Large Language Modelscited by 47
- 2023Dipping PLMs Sauce: Bridging Structure and Text for Effective Knowledge Graph Completion via Conditional Soft Promptingcited by 33
- 2022Knowledge Is Flat: A Seq2Seq Generative Framework for Various Knowledge Graph Completioncited by 32
- 2023Editing Language Model-based Knowledge Graph Embeddingscited by 23
- 2024Graph-Based Retriever Captures the Long Tail of Biomedical Knowledgecited by 20
- 2024Contextualization Distillation from Large Language Model for Knowledge Graph Completioncited by 18
- 2024Research Trends for the Interplay between Large Language Models and Knowledge Graphscited by 15
- 2022Construction and Applications of Billion-Scale Pre-Trained Multimodal Business Knowledge Graphcited by 13
- 2023A Review on Knowledge Graphs for Healthcare: Resources, Applications, and Promisescited by 13
33 more
- 2024Socially Aware Synthetic Data Generation for Suicidal Ideation Detection Using Large Language Modelscited by 10
- 2024Hyper-CL: Conditioning Sentence Representations with Hypernetworkscited by 8
- 2022Contrastive Demonstration Tuning for Pre-trained Language Modelscited by 7
- 2023Revisiting Initializing Then Refining: An Incomplete and Missing Graph Imputation Networkcited by 6
- 2024Large language models as oracles for instantiating ontologies with domain-specific knowledgecited by 6
- 2024Large Language Model Enhanced Knowledge Representation Learning: A Surveycited by 6
- 2024SimGRAG: Leveraging Similar Subgraphs for Knowledge Graphs Driven Retrieval-Augmented Generationcited by 6
- 2022LambdaKG: A Library for Pre-trained Language Model-Based Knowledge Graph Embeddingscited by 5
- 2024Finetuning Generative Large Language Models with Discrimination Instructions for Knowledge Graph Completioncited by 5
- 2024KnowFormer: Revisiting Transformers for Knowledge Graph Reasoningcited by 5
- 2022Commonsense Knowledge Salience Evaluation with a Benchmark Dataset in E-commercecited by 4
- 2023MoCoSA: Momentum Contrast for Knowledge Graph Completion with Structure-Augmented Pre-trained Language Modelscited by 4
- 2024Multilingual Knowledge Graph Completion from Pretrained Language Models with Knowledge Constraintscited by 4
- 2023Towards Semantically Enriched Embeddings for Knowledge Graph Completioncited by 3
- 2023Prompting Disentangled Embeddings for Knowledge Graph Completion with Pre-trained Language Modelcited by 3
- 2024Personalized Federated Knowledge Graph Embedding with Client-Wise Relation Graphcited by 3
- 2026NeocorRAG: Less Irrelevant Information, More Explicit Evidence, and More Effective Recall via Evidence Chainscited by 3
- 2023Multi-view Contrastive Learning for Entity Typing over Knowledge Graphscited by 2
- 2024Embedding Ontologies via Incorporating Extensional and Intensional Knowledgecited by 2
- 2024Multi-level Shared Knowledge Guided Learning for Knowledge Graph Completioncited by 2
- 2024Filter-then-Generate: Large Language Models with Structure-Text Adapter for Knowledge Graph Completioncited by 2
- 2025Multilingual Knowledge Graph Completion via Efficient Multilingual Knowledge Sharingcited by 2
- 2023Separate-and-Aggregate: A Transformer-based Patch Refinement Model for Knowledge Graph Completioncited by 1
- 2023Does Pre-trained Language Model Actually Infer Unseen Links in Knowledge Graph Completion?cited by 1
- 2023FedMKGC: Privacy-Preserving Federated Multilingual Knowledge Graph Completioncited by 1
- 2024KC-GenRe: A Knowledge-constrained Generative Re-ranking Method Based on Large Language Models for Knowledge Graph Completioncited by 1
- 2024Predicting from a Different Perspective: A Re-ranking Model for Inductive Knowledge Graph Completioncited by 1
- 2025KG-BiLM: Knowledge Graph Embedding via Bidirectional Language Modelscited by 1
- 2026OMNIA: Closing the Loop by Leveraging LLMs for Knowledge Graph Completioncited by 1
- 2024Unified Interpretation of Smoothing Methods for Negative Sampling Loss Functions in Knowledge Graph Embeddingcited by 0
- 2025GenIC: An LLM-Based Framework for Instance Completion in Knowledge Graphscited by 0
- 2025SLiNT: Structure-aware Language Model with Injection and Contrastive Training for Knowledge Graph Completioncited by 0
- 2026Autoregressive Models for Knowledge Graph Generationcited by 0
- 2026NeocorRAG: Less Irrelevant Information, More Explicit Evidence, and More Effective Recall via Evidence Chains30 Apr 2026
- 2026OMNIA: Closing the Loop by Leveraging LLMs for Knowledge Graph Completion12 Mar 2026
- 2026Autoregressive Models for Knowledge Graph Generation6 Feb 2026
- 2025Multilingual Knowledge Graph Completion via Efficient Multilingual Knowledge Sharing9 Oct 2025
- 2025SLiNT: Structure-aware Language Model with Injection and Contrastive Training for Knowledge Graph Completion8 Sep 2025
- 2025KG-BiLM: Knowledge Graph Embedding via Bidirectional Language Models4 Jun 2025
- 2025GenIC: An LLM-Based Framework for Instance Completion in Knowledge Graphs29 May 2025
- 2024SimGRAG: Leveraging Similar Subgraphs for Knowledge Graphs Driven Retrieval-Augmented Generation17 Dec 2024
- 2024Filter-then-Generate: Large Language Models with Structure-Text Adapter for Knowledge Graph Completion12 Dec 2024
- 2024Graph-constrained Reasoning: Faithful Reasoning on Knowledge Graphs with Large Language Models16 Oct 2024
- 2024KnowFormer: Revisiting Transformers for Knowledge Graph Reasoning19 Sep 2024
- 2024Finetuning Generative Large Language Models with Discrimination Instructions for Knowledge Graph Completion23 Jul 2024
33 more
- 2024Unified Interpretation of Smoothing Methods for Negative Sampling Loss Functions in Knowledge Graph Embedding5 Jul 2024
- 2024Large Language Model Enhanced Knowledge Representation Learning: A Survey1 Jul 2024
- 2024Multilingual Knowledge Graph Completion from Pretrained Language Models with Knowledge Constraints26 Jun 2024
- 2024Personalized Federated Knowledge Graph Embedding with Client-Wise Relation Graph17 Jun 2024
- 2024Research Trends for the Interplay between Large Language Models and Knowledge Graphs12 Jun 2024
- 2024Predicting from a Different Perspective: A Re-ranking Model for Inductive Knowledge Graph Completion27 May 2024
- 2024Multi-level Shared Knowledge Guided Learning for Knowledge Graph Completion8 May 2024
- 2024Large language models as oracles for instantiating ontologies with domain-specific knowledge5 Apr 2024
- 2024KC-GenRe: A Knowledge-constrained Generative Re-ranking Method Based on Large Language Models for Knowledge Graph Completion26 Mar 2024
- 2024Hyper-CL: Conditioning Sentence Representations with Hypernetworks14 Mar 2024
- 2024Graph-Based Retriever Captures the Long Tail of Biomedical Knowledge19 Feb 2024
- 2024Contextualization Distillation from Large Language Model for Knowledge Graph Completion28 Jan 2024
- 2024Socially Aware Synthetic Data Generation for Suicidal Ideation Detection Using Large Language Models25 Jan 2024
- 2024Embedding Ontologies via Incorporating Extensional and Intensional Knowledge20 Jan 2024
- 2023FedMKGC: Privacy-Preserving Federated Multilingual Knowledge Graph Completion17 Dec 2023
- 2023Prompting Disentangled Embeddings for Knowledge Graph Completion with Pre-trained Language Model4 Dec 2023
- 2023Does Pre-trained Language Model Actually Infer Unseen Links in Knowledge Graph Completion?15 Nov 2023
- 2023Multi-view Contrastive Learning for Entity Typing over Knowledge Graphs18 Oct 2023
- 2023MoCoSA: Momentum Contrast for Knowledge Graph Completion with Structure-Augmented Pre-trained Language Models16 Aug 2023
- 2023Towards Semantically Enriched Embeddings for Knowledge Graph Completion31 Jul 2023
- 2023When Large Language Models Meet Personalization: Perspectives of Challenges and Opportunities31 Jul 2023
- 2023Separate-and-Aggregate: A Transformer-based Patch Refinement Model for Knowledge Graph Completion11 Jul 2023
- 2023Dipping PLMs Sauce: Bridging Structure and Text for Effective Knowledge Graph Completion via Conditional Soft Prompting4 Jul 2023
- 2023Unifying Large Language Models and Knowledge Graphs: A Roadmap14 Jun 2023
- 2023A Review on Knowledge Graphs for Healthcare: Resources, Applications, and Promises7 Jun 2023
- 2023Revisiting Initializing Then Refining: An Incomplete and Missing Graph Imputation Network15 Feb 2023
- 2023Editing Language Model-based Knowledge Graph Embeddings25 Jan 2023
- 2022Generative Knowledge Graph Construction: A Review23 Oct 2022
- 2022LambdaKG: A Library for Pre-trained Language Model-Based Knowledge Graph Embeddings1 Oct 2022
- 2022Construction and Applications of Billion-Scale Pre-Trained Multimodal Business Knowledge Graph30 Sep 2022
- 2022Knowledge Is Flat: A Seq2Seq Generative Framework for Various Knowledge Graph Completion15 Sep 2022
- 2022Commonsense Knowledge Salience Evaluation with a Benchmark Dataset in E-commerce22 May 2022
- 2022Contrastive Demonstration Tuning for Pre-trained Language Models9 Apr 2022
- 2024Graph-Based Retriever Captures the Long Tail of Biomedical Knowledgecited by 20
- 2024SimGRAG: Leveraging Similar Subgraphs for Knowledge Graphs Driven Retrieval-Augmented Generationcited by 6
- 2026NeocorRAG: Less Irrelevant Information, More Explicit Evidence, and More Effective Recall via Evidence Chainscited by 3
- 2026NeocorRAG: Less Irrelevant Information, More Explicit Evidence, and More Effective Recall via Evidence Chains30 Apr 2026
- 2024SimGRAG: Leveraging Similar Subgraphs for Knowledge Graphs Driven Retrieval-Augmented Generation17 Dec 2024
- 2024Graph-Based Retriever Captures the Long Tail of Biomedical Knowledge19 Feb 2024
- 2023Unifying Large Language Models and Knowledge Graphs: A Roadmapcited by 666
- 2023When Large Language Models Meet Personalization: Perspectives of Challenges and Opportunitiescited by 90
- 2022Generative Knowledge Graph Construction: A Reviewcited by 49
- 2023Dipping PLMs Sauce: Bridging Structure and Text for Effective Knowledge Graph Completion via Conditional Soft Promptingcited by 33
- 2022Knowledge Is Flat: A Seq2Seq Generative Framework for Various Knowledge Graph Completioncited by 32
- 2023Editing Language Model-based Knowledge Graph Embeddingscited by 23
- 2024Contextualization Distillation from Large Language Model for Knowledge Graph Completioncited by 18
- 2024Research Trends for the Interplay between Large Language Models and Knowledge Graphscited by 15
- 2022Construction and Applications of Billion-Scale Pre-Trained Multimodal Business Knowledge Graphcited by 13
- 2023A Review on Knowledge Graphs for Healthcare: Resources, Applications, and Promisescited by 13
- 2024Socially Aware Synthetic Data Generation for Suicidal Ideation Detection Using Large Language Modelscited by 10
- 2024Hyper-CL: Conditioning Sentence Representations with Hypernetworkscited by 8
12 most cited of 40 All 40 (JSON)
- 2026OMNIA: Closing the Loop by Leveraging LLMs for Knowledge Graph Completion12 Mar 2026
- 2026Autoregressive Models for Knowledge Graph Generation6 Feb 2026
- 2025Multilingual Knowledge Graph Completion via Efficient Multilingual Knowledge Sharing9 Oct 2025
- 2025SLiNT: Structure-aware Language Model with Injection and Contrastive Training for Knowledge Graph Completion8 Sep 2025
- 2025KG-BiLM: Knowledge Graph Embedding via Bidirectional Language Models4 Jun 2025
- 2025GenIC: An LLM-Based Framework for Instance Completion in Knowledge Graphs29 May 2025
- 2024Filter-then-Generate: Large Language Models with Structure-Text Adapter for Knowledge Graph Completion12 Dec 2024
- 2024Finetuning Generative Large Language Models with Discrimination Instructions for Knowledge Graph Completion23 Jul 2024
- 2024Unified Interpretation of Smoothing Methods for Negative Sampling Loss Functions in Knowledge Graph Embedding5 Jul 2024
- 2024Large Language Model Enhanced Knowledge Representation Learning: A Survey1 Jul 2024
- 2024Multilingual Knowledge Graph Completion from Pretrained Language Models with Knowledge Constraints26 Jun 2024
- 2024Personalized Federated Knowledge Graph Embedding with Client-Wise Relation Graph17 Jun 2024
12 newest of 40 All 40 (JSON)