mlsanityData to 7 Oct 2026

Deep Sparse Latent Feature Models for Knowledge Graph Completion

arXiv 2411.15694 ↗First posted 24 Nov 2024cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

Recent advances in knowledge graph completion (KGC) have emphasized text-based approaches to navigate the inherent complexities of large-scale knowledge graphs (KGs). While these methods have achieved notable progress, they frequently struggle to fully incorporate the global structural properties of the graph. Stochastic blockmodels (SBMs), especially the latent feature relational model (LFRM), offer robust probabilistic frameworks for identifying latent community structures and improving link prediction. This paper presents a novel probabilistic KGC framework utilizing sparse latent feature models, optimized via a deep variational autoencoder (VAE). Our proposed method dynamically integrates global clustering information with local textual features to effectively complete missing triples, while also providing enhanced interpretability of the underlying latent structures. Extensive experiments on four benchmark datasets with varying scales demonstrate the significant performance gains achieved by our method.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 42 of its 72 references that are in the map. First posted on arXiv 24 Nov 2024.

Builds on

42 of 72 references.

References · 42

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
  3. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
  4. 2020Supervised Contrastive Learningcited by 2,803
  5. 2016Categorical Reparameterization with Gumbel-Softmaxcited by 2,708
  6. 2015Variational Inference with Normalizing Flowscited by 2,161
  7. 2017Modeling Relational Data with Graph Convolutional Networkscited by 1,684
  8. 2018Learning deep representations by mutual information estimation and maximizationcited by 1,265
  9. 2016The Concrete Distribution: A Continuous Relaxation of Discrete Random Variablescited by 1,135
  10. 2014Embedding Entities and Relations for Learning and Inference in Knowledge Basescited by 929
  11. 2019RotatE: Knowledge Graph Embedding by Relational Rotation in Complex Spacecited by 893
  12. 2017Convolutional 2D Knowledge Graph Embeddingscited by 729
30 more
  1. 2015Generating Sentences from a Continuous Spacecited by 607
  2. 2019Composition-based Multi-Relational Graph Convolutional Networkscited by 395
  3. 2019KEPLER: A Unified Model for Knowledge Embedding and Pre-trained Language Representationcited by 356
  4. 2019KG-BERT: BERT for Knowledge Graph Completioncited by 323
  5. 2019TuckER: Tensor Factorization for Knowledge Graph Completioncited by 290
  6. 2019DRUM: End-To-End Differentiable Rule Mining On Knowledge Graphscited by 173
  7. 2014A* Samplingcited by 150
  8. 2019Learning Attention-based Embeddings for Relation Prediction in Knowledge Graphscited by 125
  9. 2022SimKGC: Simple Contrastive Knowledge Graph Completion with Pre-trained Language Modelscited by 90
  10. 2018Implicit Reparameterization Gradientscited by 84
  11. 2020Inductive Entity Representations from Text via Link Predictioncited by 61
  12. 2020HittER: Hierarchical Transformers for Knowledge Graph Embeddingscited by 54
  13. 2023Making Large Language Models Perform Better in Knowledge Graph Completioncited by 48
  14. 2016Stick-Breaking Variational Autoencoderscited by 44
  15. 2023Exploring Large Language Models for Knowledge Graph Completioncited by 43
  16. 2019Stochastic Blockmodels meet Graph Neural Networkscited by 39
  17. 2024KICGPT: Large Language Model with Knowledge in Context for Knowledge Graph Completioncited by 36
  18. 2023Reverse Engineering Self-Supervised Learningcited by 33
  19. 2023Dipping PLMs Sauce: Bridging Structure and Text for Effective Knowledge Graph Completion via Conditional Soft Promptingcited by 33
  20. 2022Knowledge Is Flat: A Seq2Seq Generative Framework for Various Knowledge Graph Completioncited by 32
  21. 2018Von Mises-Fisher Loss for Training Sequence to Sequence Models with Continuous Outputscited by 26
  22. 2024NativE: Multi-modal Knowledge Graph Completion in the Wildcited by 23
  23. 2022Rethinking Graph Convolutional Networks in Knowledge Graph Completioncited by 20
  24. 2022I Know What You Do Not Know: Knowledge Graph Embedding via Co-distillation Learningcited by 15
  25. 2023Enhancing Text-based Knowledge Graph Completion with Zero-Shot Large Language Models: A Focus on Semantic Enhancementcited by 14
  26. 2018Stochastic Block Models with Multiple Continuous Attributescited by 11
  27. 2022KRACL: Contrastive Learning with Graph Context Modeling for Sparse Knowledge Graph Completioncited by 10
  28. 2023Logical Entity Representation in Knowledge-Graphs for Differentiable Rule Learningcited by 8
  29. 2022Are Message Passing Neural Networks Really Helpful for Knowledge Graph Completion?cited by 6
  30. 2023KERMIT: Knowledge Graph Completion of Enhanced Relation Modeling with Inverse Transformationcited by 6

Built on by

Not cited yet.