mlsanityData to 14 Oct 2026

Billion-scale Pre-trained E-commerce Product Knowledge Graph Model

arXiv 2105.00388 ↗First posted 2 May 2021cs.AIcited by 13

Not on the map. Why?

Abstract (arXiv)

In recent years, knowledge graphs have been widely applied to organize data in a uniform way and enhance many tasks that require knowledge, for example, online shopping which has greatly facilitated people's life. As a backbone for online shopping platforms, we built a billion-scale e-commerce product knowledge graph for various item knowledge services such as item recommendation. However, such knowledge services usually include tedious data selection and model design for knowledge infusion, which might bring inappropriate results. Thus, to avoid this problem, we propose a Pre-trained Knowledge Graph Model (PKGM) for our billion-scale e-commerce product knowledge graph, providing item knowledge services in a uniform way for embedding-based models without accessing triple data in the knowledge graph. Notably, PKGM could also complete knowledge graphs during servicing, thereby overcoming the common incompleteness issue in knowledge graphs. We test PKGM in three knowledge-related tasks including item classification, same item identification, and recommendation. Experimental results show PKGM successfully improves the performance of each task.

Key facts. Cited by 13 papers in the map (data through 14 Oct 2026). Builds on 29 of its 49 references that are in the map. First posted on arXiv 2 May 2021.

Builds on

29 of 49 references.

References · 29

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  3. 2020Language Models are Few-Shot Learnerscited by 32,419
  4. 2019XLNet: Generalized Autoregressive Pretraining for Language Understandingcited by 2,811
  5. 2018Deep contextualized word representationscited by 2,290
  6. 2017Neural Collaborative Filteringcited by 1,111
  7. 2014Embedding Entities and Relations for Learning and Inference in Knowledge Basescited by 932
  8. 2016Complex Embeddings for Simple Link Predictioncited by 902
  9. 2017Convolutional 2D Knowledge Graph Embeddingscited by 730
  10. 2020A Survey on Knowledge Graphs: Representation, Acquisition and Applicationscited by 643
  11. 2019ERNIE: Enhanced Language Representation with Informative Entitiescited by 528
  12. 2019KEPLER: A Unified Model for Knowledge Embedding and Pre-trained Language Representationcited by 356
17 more
  1. 2020K-Adapter: Infusing Knowledge into Pre-Trained Models with Adapterscited by 319
  2. 2019K-BERT: Enabling Language Representation with Knowledge Graphcited by 304
  3. 2019Knowledge Enhanced Contextual Word Representationscited by 296
  4. 2020Low-Dimensional Hyperbolic Knowledge Graph Embeddingscited by 195
  5. 2019AliGraph: A Comprehensive Graph Neural Network Platformcited by 153
  6. 2019Multi-relational Poincar'e Graph Embeddingscited by 126
  7. 2018Tensor2Tensor for Neural Machine Translationcited by 85
  8. 2020JAKET: Joint Pre-training of Knowledge Graph and Language Understandingcited by 73
  9. 2019Iteratively Learning Embeddings and Rules for Knowledge Graph Reasoningcited by 63
  10. 2020SKEP: Sentiment Knowledge Enhanced Pre-training for Sentiment Analysiscited by 54
  11. 2018Baseline Needs More Love: On Simple Word-Embedding-Based Models and Associated Pooling Mechanismscited by 53
  12. 2020Knowledge-Aware Language Model Pretrainingcited by 52
  13. 2019Interaction Embeddings for Prediction and Explanation in Knowledge Graphscited by 40
  14. 2019Fine-tuning Pre-Trained Transformer Language Models to Distantly Supervised Relation Extractioncited by 36
  15. 2020Progressively Pretrained Dense Corpus Index for Open-Domain Question Answeringcited by 11
  16. 2020CokeBERT: Contextual Knowledge Selection and Embedding towards Enhanced Pre-Trained Language Modelscited by 11
  17. 2018Character-based Neural Networks for Sentence Pair Modelingcited by 4

Built on by

Cited by year

Citing papers per year: 2021: 2; 2022: 4; 2023: 4; 2024: 3.

13 papers.

Sort:

By area: