mlsanityData to 7 Oct 2026

Knowledge Is Flat: A Seq2Seq Generative Framework for Various Knowledge Graph Completion

arXiv 2209.07299 ↗First posted 15 Sep 2022cs.CLcited by 32

Not on the map. Why?

Abstract (arXiv)

Knowledge Graph Completion (KGC) has been recently extended to multiple knowledge graph (KG) structures, initiating new research directions, e.g. static KGC, temporal KGC and few-shot KGC. Previous works often design KGC models closely coupled with specific graph structures, which inevitably results in two drawbacks: 1) structure-specific KGC models are mutually incompatible; 2) existing KGC methods are not adaptable to emerging KGs. In this paper, we propose KG-S2S, a Seq2Seq generative framework that could tackle different verbalizable graph structures by unifying the representation of KG facts into "flat" text, regardless of their original form. To remedy the KG structure information loss from the "flat" text, we further improve the input representations of entities and relations, and the inference algorithm in KG-S2S. Experiments on five benchmarks show that KG-S2S outperforms many competitive baselines, setting new state-of-the-art performance. Finally, we analyze KG-S2S's ability on the different relations and the Non-entity Generations.

Key facts. Cited by 32 papers in the map (data through 7 Oct 2026). Builds on 32 of its 56 references that are in the map. First posted on arXiv 15 Sep 2022.

Builds on

32 of 56 references.

References · 32

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  3. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
  4. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  5. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
  6. 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,874
  7. 2021The Power of Scale for Parameter-Efficient Prompt Tuningcited by 3,769
  8. 2019Language Models as Knowledge Bases?cited by 1,922
  9. 2014Embedding Entities and Relations for Learning and Inference in Knowledge Basescited by 929
  10. 2016Complex Embeddings for Simple Link Predictioncited by 897
  11. 2019RotatE: Knowledge Graph Embedding by Relational Rotation in Complex Spacecited by 893
  12. 2017Convolutional 2D Knowledge Graph Embeddingscited by 729
20 more
  1. 2020A Survey on Knowledge Graphs: Representation, Acquisition and Applicationscited by 643
  2. 2019Composition-based Multi-Relational Graph Convolutional Networkscited by 395
  3. 2019MASS: Masked Sequence to Sequence Pre-training for Language Generationcited by 345
  4. 2019KG-BERT: BERT for Knowledge Graph Completioncited by 323
  5. 2022UnifiedSKG: Unifying and Multi-Tasking Structured Knowledge Grounding with Text-to-Text Language Modelscited by 231
  6. 2018Towards Deep Conversational Recommendationscited by 174
  7. 2018Learning Sequence Encoders for Temporal Knowledge Graph Completioncited by 145
  8. 2020Tensor Decompositions for temporal knowledge base completioncited by 115
  9. 2019Diachronic Embedding for Temporal Knowledge Graph Completioncited by 104
  10. 2018One-Shot Relational Learning for Knowledge Graphscited by 78
  11. 2022Sequence-to-Sequence Knowledge Graph Completion and Question Answeringcited by 75
  12. 2019Meta Relational Learning for Few-Shot Link Prediction in Knowledge Graphscited by 73
  13. 2019A Re-evaluation of Knowledge Graph Completion Methodscited by 73
  14. 2022PromDA: Prompt-based Data Augmentation for Low-Resource NLU Taskscited by 51
  15. 2020TeRo: A Time-aware Knowledge Graph Embedding via Temporal Rotationcited by 48
  16. 2022From Discrimination to Generation: Knowledge Graph Completion with Generative Transformercited by 45
  17. 2020Realistic Re-evaluation of Knowledge Graph Completion Methods: An Experimental Studycited by 37
  18. 2021Relational Learning with Gated and Attentive Neighbor Aggregator for Few-Shot Knowledge Graph Completioncited by 32
  19. 2019Temporal Knowledge Graph Embedding Model based on Additive Time Series Decompositioncited by 24
  20. 2021Robust Knowledge Graph Completion with Stacked Convolutions and a Student Re-Ranking Networkcited by 11

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2022: 2; 2023: 11; 2024: 13; 2025: 1; 2026: 5.

32 papers.

Sort:

By area:

  1. 2023Unifying Large Language Models and Knowledge Graphs: A Roadmapcited by 663
  2. 2023GraphCare: Enhancing Healthcare Predictions with Personalized Knowledge Graphscited by 57
  3. 2024Knowledge Graphs Meet Multi-Modal Learning: A Comprehensive Surveycited by 50
  4. 2022Generative Knowledge Graph Construction: A Reviewcited by 49
  5. 2023Making Large Language Models Perform Better in Knowledge Graph Completioncited by 48
  6. 2024Graph-constrained Reasoning: Faithful Reasoning on Knowledge Graphs with Large Language Modelscited by 47
  7. 2023Exploring Large Language Models for Knowledge Graph Completioncited by 43
  8. 2024Threats, Attacks, and Defenses in Machine Unlearning: A Surveycited by 34
  9. 2023Dipping PLMs Sauce: Bridging Structure and Text for Effective Knowledge Graph Completion via Conditional Soft Promptingcited by 33
  10. 2023Editing Language Model-based Knowledge Graph Embeddingscited by 23
  11. 2024KG-FIT: Knowledge Graph Fine-Tuning Upon Open-World Knowledgecited by 16
  12. 2023Enhancing Text-based Knowledge Graph Completion with Zero-Shot Large Language Models: A Focus on Semantic Enhancementcited by 14
20 more
  1. 2024Research Trends for the Interplay between Large Language Models and Knowledge Graphscited by 14
  2. 2024Large language models as oracles for instantiating ontologies with domain-specific knowledgecited by 6
  3. 2024Large Language Model Enhanced Knowledge Representation Learning: A Surveycited by 6
  4. 2022LambdaKG: A Library for Pre-trained Language Model-Based Knowledge Graph Embeddingscited by 5
  5. 2023Unsupervised Pretraining for Fact Verification by Language Model Distillationcited by 5
  6. 2024Finetuning Generative Large Language Models with Discrimination Instructions for Knowledge Graph Completioncited by 5
  7. 2023MoCoSA: Momentum Contrast for Knowledge Graph Completion with Structure-Augmented Pre-trained Language Modelscited by 4
  8. 2023Towards Semantically Enriched Embeddings for Knowledge Graph Completioncited by 3
  9. 2023Prompting Disentangled Embeddings for Knowledge Graph Completion with Pre-trained Language Modelcited by 3
  10. 2024Embedding Ontologies via Incorporating Extensional and Intensional Knowledgecited by 2
  11. 2024Filter-then-Generate: Large Language Models with Structure-Text Adapter for Knowledge Graph Completioncited by 2
  12. 2025KG-BiLM: Knowledge Graph Embedding via Bidirectional Language Modelscited by 1
  13. 2024FLAME: Empowering Frozen LLMs for Knowledge Graph Completioncited by 0
  14. 2024Bridge: A Unified Framework to Knowledge Graph Completion via Language Models and Knowledge Representationcited by 0
  15. 2024Deep Sparse Latent Feature Models for Knowledge Graph Completioncited by 0
  16. 2026SASA: Semantic-Aware Contrastive Learning Framework with Separated Attention for Triple Classificationcited by 0
  17. 2026FactNet: A Billion-Scale Knowledge Graph for Multilingual Factual Groundingcited by 0
  18. 2026RADAR: Reasoning as Discrimination with Aligned Representations for LLM-based Knowledge Graph Reasoningcited by 0
  19. 2026OMNIA: Closing the Loop by Leveraging LLMs for Knowledge Graph Completioncited by 0
  20. 2026Leveraging Graph Structure in Seq2Seq Models for Knowledge Graph Link Predictioncited by 0