# Using Large Pretrained Language Models for Answering User Queries from Product Specifications

arXiv: https://arxiv.org/abs/2005.14613 · HTML: https://mlsanity.com/paper/2005.14613/

## Key facts

- Cited by 3 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 29 May 2020.

## Built on by (most cited first, 3 of 3)

- [Product Question Answering in E-Commerce: A Survey](https://mlsanity.com/paper/2302.08092/) (2023)
- [A survey on fairness of large language models in e-commerce: progress, application, and challenge](https://mlsanity.com/paper/2405.13025/) (2024)
- [Intent-based Product Collections for E-commerce using Pretrained Language Models](https://mlsanity.com/paper/2110.08241/) (2021)

## Abstract (arXiv)

While buying a product from the e-commerce websites, customers generally have a plethora of questions. From the perspective of both the e-commerce service provider as well as the customers, there must be an effective question answering system to provide immediate answers to the user queries. While certain questions can only be answered after using the product, there are many questions which can be answered from the product specification itself. Our work takes a first step in this direction by finding out the relevant product specifications, that can help answering the user questions. We propose an approach to automatically create a training dataset for this problem. We utilize recently proposed XLNet and BERT architectures for this problem and find that they provide much better performance than the Siamese model, previously applied for this problem. Our model gives a good performance even when trained on one vertical and tested across different verticals.
