Hierarchical Knowledge Graph Construction from Images for Scalable E-Commerce
Not on the map. Why?
Abstract (arXiv)
Knowledge Graph (KG) is playing an increasingly important role in various AI systems. For e-commerce, an efficient and low-cost automated knowledge graph construction method is the foundation of enabling various successful downstream applications. In this paper, we propose a novel method for constructing structured product knowledge graphs from raw product images. The method cooperatively leverages recent advances in the vision-language model (VLM) and large language model (LLM), fully automating the process and allowing timely graph updates. We also present a human-annotated e-commerce product dataset for benchmarking product property extraction in knowledge graph construction. Our method outperforms our baseline in all metrics and evaluated properties, demonstrating its effectiveness and bright usage potential.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 19 of its 39 references that are in the map. First posted on arXiv 28 Oct 2024.
Builds on
19 of 39 references.
References · 19
- 2017Attention Is All You Needcited by 59,932
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2022Training language models to follow instructions with human feedbackcited by 15,712
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
- 2024The Llama 3 Herd of Modelscited by 14,192
- 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,534
- 2024How Far Are We to GPT-4V? Closing the Gap to Commercial Multimodal Models with Open-Source Suitescited by 1,033
- 2016Complex Embeddings for Simple Link Predictioncited by 897
- 2020A Survey on Knowledge Graph-Based Recommender Systemscited by 170
- 2023Knowledge Graph Prompting for Multi-Document Question Answeringcited by 150
- 2024Extract, Define, Canonicalize: An LLM-based Framework for Knowledge Graph Constructioncited by 70
- 2019RPC: A Large-Scale Retail Product Checkout Datasetcited by 27
7 more
- 2020RP2K: A Large-Scale Retail Product Dataset for Fine-Grained Image Classificationcited by 27
- 2023Knowledge Graph Completion Models are Few-shot Learners: An Empirical Study of Relation Labeling in E-commerce with LLMscited by 24
- 2019Research Commentary on Recommendations with Side Information: A Survey and Research Directionscited by 23
- 2022FolkScope: Intention Knowledge Graph Construction for E-commerce Commonsense Discoverycited by 23
- 2024Automated Construction of Theme-specific Knowledge Graphscited by 15
- 2024Automatic Knowledge Graph Construction for Judicial Casescited by 3
- 2019AliMe KBQA: Question Answering over Structured Knowledge for E-commerce Customer Servicecited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026AutoPKG: An Automated Framework for Dynamic E-commerce Product-Attribute Knowledge Graph Construction
- 2025AI Agent-Driven Framework for Automated Product Knowledge Graph Construction in E-Commerce
- 2026Adapting Vision-Language Models for E-commerce Understanding at Scale
- 2023PUMGPT: A Large Vision-Language Model for Product Understanding
- 2025LLM-empowered knowledge graph construction: A survey
- 2025MOON: Generative MLLM-based Multimodal Representation Learning for E-commerce Product Understanding
- 2024Graphusion: A RAG Framework for Knowledge Graph Construction with a Global Perspective
- 2026VL-KGE: Vision-Language Models Meet Knowledge Graph Embeddings