Consistent Text Categorization using Data Augmentation in e-Commerce
Not on the map. Why?
Abstract (arXiv)
The categorization of massive e-Commerce data is a crucial, well-studied task, which is prevalent in industrial settings. In this work, we aim to improve an existing product categorization model that is already in use by a major web company, serving multiple applications. At its core, the product categorization model is a text classification model that takes a product title as an input and outputs the most suitable category out of thousands of available candidates. Upon a closer inspection, we found inconsistencies in the labeling of similar items. For example, minor modifications of the product title pertaining to colors or measurements majorly impacted the model's output. This phenomenon can negatively affect downstream recommendation or search applications, leading to a sub-optimal user experience. To address this issue, we propose a new framework for consistent text categorization. Our goal is to improve the model's consistency while maintaining its production-level performance. We use a semi-supervised approach for data augmentation and presents two different methods for utilizing unlabeled samples. One method relies directly on existing catalogs, while the other uses a generative model. We compare the pros and cons of each approach and present our experimental results.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 13 of its 19 references that are in the map. First posted on arXiv 9 May 2023.
Builds on
13 of 19 references.
References · 13
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
- 2019Invariant Risk Minimizationcited by 1,832
- 2019Unsupervised Data Augmentation for Consistency Trainingcited by 1,057
- 2016Bag of Tricks for Efficient Text Classificationcited by 869
- 2019Is BERT Really Robust? A Strong Baseline for Natural Language Attack on Text Classification and Entailmentcited by 663
- 2019Pseudo-Labeling and Confirmation Bias in Deep Semi-Supervised Learningcited by 507
- 2019Learning the Difference that Makes a Difference with Counterfactually-Augmented Datacited by 428
- 2021Measuring and Improving Consistency in Pretrained Language Modelscited by 361
- 2020Data Augmentation using Pre-trained Transformer Modelscited by 168
- 2021Counterfactual Invariance to Spurious Correlations: Why and How to Pass Stress Testscited by 77
- 2021Identifying and Mitigating Spurious Correlations for Improving Robustness in NLP Modelscited by 76
- 2020CAT-Gen: Improving Robustness in NLP Models via Controlled Adversarial Text Generationcited by 43
Built on by
Citing papers per year: 2024: 1; 2025: 2.
3 papers.