Billion-scale Pre-trained E-commerce Product Knowledge Graph Model
Not on the map. Why?
Abstract (arXiv)
In recent years, knowledge graphs have been widely applied to organize data in a uniform way and enhance many tasks that require knowledge, for example, online shopping which has greatly facilitated people's life. As a backbone for online shopping platforms, we built a billion-scale e-commerce product knowledge graph for various item knowledge services such as item recommendation. However, such knowledge services usually include tedious data selection and model design for knowledge infusion, which might bring inappropriate results. Thus, to avoid this problem, we propose a Pre-trained Knowledge Graph Model (PKGM) for our billion-scale e-commerce product knowledge graph, providing item knowledge services in a uniform way for embedding-based models without accessing triple data in the knowledge graph. Notably, PKGM could also complete knowledge graphs during servicing, thereby overcoming the common incompleteness issue in knowledge graphs. We test PKGM in three knowledge-related tasks including item classification, same item identification, and recommendation. Experimental results show PKGM successfully improves the performance of each task.
Key facts. Cited by 13 papers in the map (data through 14 Oct 2026). Builds on 29 of its 49 references that are in the map. First posted on arXiv 2 May 2021.
Builds on
29 of 49 references.
References · 29
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2019XLNet: Generalized Autoregressive Pretraining for Language Understandingcited by 2,811
- 2018Deep contextualized word representationscited by 2,290
- 2017Neural Collaborative Filteringcited by 1,111
- 2014Embedding Entities and Relations for Learning and Inference in Knowledge Basescited by 932
- 2016Complex Embeddings for Simple Link Predictioncited by 902
- 2017Convolutional 2D Knowledge Graph Embeddingscited by 730
- 2020A Survey on Knowledge Graphs: Representation, Acquisition and Applicationscited by 643
- 2019ERNIE: Enhanced Language Representation with Informative Entitiescited by 528
- 2019KEPLER: A Unified Model for Knowledge Embedding and Pre-trained Language Representationcited by 356
17 more
- 2020K-Adapter: Infusing Knowledge into Pre-Trained Models with Adapterscited by 319
- 2019K-BERT: Enabling Language Representation with Knowledge Graphcited by 304
- 2019Knowledge Enhanced Contextual Word Representationscited by 296
- 2020Low-Dimensional Hyperbolic Knowledge Graph Embeddingscited by 195
- 2019AliGraph: A Comprehensive Graph Neural Network Platformcited by 153
- 2019Multi-relational Poincar'e Graph Embeddingscited by 126
- 2018Tensor2Tensor for Neural Machine Translationcited by 85
- 2020JAKET: Joint Pre-training of Knowledge Graph and Language Understandingcited by 73
- 2019Iteratively Learning Embeddings and Rules for Knowledge Graph Reasoningcited by 63
- 2020SKEP: Sentiment Knowledge Enhanced Pre-training for Sentiment Analysiscited by 54
- 2018Baseline Needs More Love: On Simple Word-Embedding-Based Models and Associated Pooling Mechanismscited by 53
- 2020Knowledge-Aware Language Model Pretrainingcited by 52
- 2019Interaction Embeddings for Prediction and Explanation in Knowledge Graphscited by 40
- 2019Fine-tuning Pre-Trained Transformer Language Models to Distantly Supervised Relation Extractioncited by 36
- 2020Progressively Pretrained Dense Corpus Index for Open-Domain Question Answeringcited by 11
- 2020CokeBERT: Contextual Knowledge Selection and Embedding towards Enhanced Pre-Trained Language Modelscited by 11
- 2018Character-based Neural Networks for Sentence Pair Modelingcited by 4
Built on by
Citing papers per year: 2021: 2; 2022: 4; 2023: 4; 2024: 3.
13 papers.
Sort:
By area:
- 2023EcomGPT: Instruction-tuning Large Language Models with Chain-of-Task Tasks for E-commercecited by 49
- 2023Knowledgeable Preference Alignment for LLMs in Domain-specific Question Answeringcited by 29
- 2021Knowledge Perceived Multi-modal Pretraining in E-commercecited by 18
- 2022Knowledge Graph Reasoning with Logics and Embeddings: Survey and Perspectivecited by 18
- 2022Knowledge Graph Completion with Pre-trained Multimodal Transformer and Twins Negative Samplingcited by 18
- 2022Tele-Knowledge Pre-training for Fault Analysiscited by 18
- 2023Structure Pretraining and Prompt Tuning for Knowledge Graph Transfercited by 16
- 2022Construction and Applications of Billion-Scale Pre-Trained Multimodal Business Knowledge Graphcited by 13
- 2024Multi-domain Knowledge Graph Collaborative Pre-training and Prompt Tuning for Diverse Downstream Taskscited by 8
- 2023Modality-Aware Negative Sampling for Multi-modal Knowledge Graph Embeddingcited by 7
- 2024Start from Zero: Triple Set Prediction for Automatic Knowledge Graph Completioncited by 7
- 2021Knowledge Graph Embedding in E-commerce Applications: Attentive Reasoning, Explanations, and Transferable Rulescited by 3
1 more
- 2024Croppable Knowledge Graph Embeddingcited by 0
- 2024Croppable Knowledge Graph Embedding3 Jul 2024
- 2024Start from Zero: Triple Set Prediction for Automatic Knowledge Graph Completion26 Jun 2024
- 2024Multi-domain Knowledge Graph Collaborative Pre-training and Prompt Tuning for Diverse Downstream Tasks21 May 2024
- 2023Knowledgeable Preference Alignment for LLMs in Domain-specific Question Answering11 Nov 2023
- 2023EcomGPT: Instruction-tuning Large Language Models with Chain-of-Task Tasks for E-commerce14 Aug 2023
- 2023Modality-Aware Negative Sampling for Multi-modal Knowledge Graph Embedding23 Apr 2023
- 2023Structure Pretraining and Prompt Tuning for Knowledge Graph Transfer3 Mar 2023
- 2022Tele-Knowledge Pre-training for Fault Analysis20 Oct 2022
- 2022Construction and Applications of Billion-Scale Pre-Trained Multimodal Business Knowledge Graph30 Sep 2022
- 2022Knowledge Graph Completion with Pre-trained Multimodal Transformer and Twins Negative Sampling15 Sep 2022
- 2022Knowledge Graph Reasoning with Logics and Embeddings: Survey and Perspective15 Feb 2022
- 2021Knowledge Graph Embedding in E-commerce Applications: Attentive Reasoning, Explanations, and Transferable Rules16 Dec 2021
1 more
- 2021Knowledge Perceived Multi-modal Pretraining in E-commerce20 Aug 2021
- 2023EcomGPT: Instruction-tuning Large Language Models with Chain-of-Task Tasks for E-commercecited by 49
- 2021Knowledge Perceived Multi-modal Pretraining in E-commercecited by 18
- 2022Knowledge Graph Reasoning with Logics and Embeddings: Survey and Perspectivecited by 18
- 2022Knowledge Graph Completion with Pre-trained Multimodal Transformer and Twins Negative Samplingcited by 18
- 2022Tele-Knowledge Pre-training for Fault Analysiscited by 18
- 2023Structure Pretraining and Prompt Tuning for Knowledge Graph Transfercited by 16
- 2022Construction and Applications of Billion-Scale Pre-Trained Multimodal Business Knowledge Graphcited by 13
- 2024Multi-domain Knowledge Graph Collaborative Pre-training and Prompt Tuning for Diverse Downstream Taskscited by 8
- 2023Modality-Aware Negative Sampling for Multi-modal Knowledge Graph Embeddingcited by 7
- 2024Start from Zero: Triple Set Prediction for Automatic Knowledge Graph Completioncited by 7
- 2021Knowledge Graph Embedding in E-commerce Applications: Attentive Reasoning, Explanations, and Transferable Rulescited by 3
- 2024Croppable Knowledge Graph Embeddingcited by 0
- 2024Croppable Knowledge Graph Embedding3 Jul 2024
- 2024Start from Zero: Triple Set Prediction for Automatic Knowledge Graph Completion26 Jun 2024
- 2024Multi-domain Knowledge Graph Collaborative Pre-training and Prompt Tuning for Diverse Downstream Tasks21 May 2024
- 2023EcomGPT: Instruction-tuning Large Language Models with Chain-of-Task Tasks for E-commerce14 Aug 2023
- 2023Modality-Aware Negative Sampling for Multi-modal Knowledge Graph Embedding23 Apr 2023
- 2023Structure Pretraining and Prompt Tuning for Knowledge Graph Transfer3 Mar 2023
- 2022Tele-Knowledge Pre-training for Fault Analysis20 Oct 2022
- 2022Construction and Applications of Billion-Scale Pre-Trained Multimodal Business Knowledge Graph30 Sep 2022
- 2022Knowledge Graph Completion with Pre-trained Multimodal Transformer and Twins Negative Sampling15 Sep 2022
- 2022Knowledge Graph Reasoning with Logics and Embeddings: Survey and Perspective15 Feb 2022
- 2021Knowledge Graph Embedding in E-commerce Applications: Attentive Reasoning, Explanations, and Transferable Rules16 Dec 2021
- 2021Knowledge Perceived Multi-modal Pretraining in E-commerce20 Aug 2021