mlsanityData to 7 Oct 2026

An Exploratory Study on Utilising the Web of Linked Data for Product Data Mining

arXiv 2109.01411 ↗First posted 3 Sep 2021cs.CL cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

The Linked Open Data practice has led to a significant growth of structured data on the Web in the last decade. Such structured data describe real-world entities in a machine-readable way, and have created an unprecedented opportunity for research in the field of Natural Language Processing. However, there is a lack of studies on how such data can be used, for what kind of tasks, and to what extent they can be useful for these tasks. This work focuses on the e-commerce domain to explore methods of utilising such structured data to create language resources that may be used for product classification and linking. We process billions of structured data points in the form of RDF n-quads, to create multi-million words of product-related corpora that are later used in three different ways for creating of language resources: training word embedding models, continued pre-training of BERT-like language models, and training Machine Translation models that are used as a proxy to generate product-related keywords. Our evaluation on an extensive set of benchmarks shows word embeddings to be the most reliable and consistent method to improve the accuracy on both tasks (with up to 6.9 percentage points in macro-average F1 on some datasets). The other two methods however, are not as useful. Our analysis shows that this could be due to a number of reasons, including the biased domain representation in the structured data and lack of vocabulary coverage. We share our datasets and discuss how our lessons learned could be taken forward to inform future research in this direction.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 18 of its 89 references that are in the map. First posted on arXiv 3 Sep 2021.

Builds on

18 of 89 references.

References · 18

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
  3. 2013Distributed Representations of Words and Phrases and their Compositionalitycited by 3,462
  4. 2019BioBERT: a pre-trained biomedical language representation model for biomedical text miningcited by 1,935
  5. 2016Enriching Word Vectors with Subword Informationcited by 1,578
  6. 2019SciBERT: A Pretrained Language Model for Scientific Textcited by 1,404
  7. 2014Convolutional Neural Networks for Sentence Classificationcited by 1,124
  8. 2019Publicly Available Clinical BERT Embeddingscited by 995
  9. 2014Distributed Representations of Sentences and Documentscited by 677
  10. 2019A Survey on Recent Advances in Named Entity Recognition from Deep Learning modelscited by 117
  11. 2018OpenNMT: Neural Machine Translation Toolkitcited by 27
  12. 2021SMedBERT: A Knowledge-Enhanced Pre-trained Language Model with Structured Semantics for Medical Text Miningcited by 24
6 more
  1. 2020E-BERT: A Phrase and Product Knowledge Enhanced Language Model for E-commercecited by 19
  2. 2016Product Classification in E-Commerce using Distributional Semanticscited by 9
  3. 2018Don't Classify, Translate: Multi-Level E-Commerce Product Categorization Via Machine Translationcited by 3
  4. 2020On using Product-Specific Schema.org from Web Data Commons: An Empirical Set of Best Practicescited by 2
  5. 2017Task-specific Word Identification from Short Texts Using a Convolutional Neural Networkcited by 1
  6. 2017Content Recommendation through Semantic Annotation of User Reviews and Linked Data - An Extended Technical Reportcited by 1

Built on by

Not cited yet.