mlsanityData to 7 Oct 2026

BEATS: Bootstrapping E-commerce Attribute Taxonomies for Search through Iterative Human-AI Collaboration

arXiv 2606.04909 ↗First posted 3 Jun 2026cs.IR cs.CLcited by 0

On the map: Synthetic data and self-improvement for LLMs → Self-evolving search agents

Abstract (arXiv)

E-commerce platforms in emerging markets often operate with underdeveloped product catalogs that contain only category taxonomies but lack structured attribute schemas. This absence of fine-grained product attributes limits search capabilities -- preventing faceted filtering, degrading query understanding, and weakening semantic representations used by search systems. We present BEATS, a human-in-the-loop LLM framework for bootstrapping product attribute taxonomies entirely from scratch. Our approach extends a multi-stage LLM generation pipeline with two critical production stages: (1) proactive quality checking by model developers to filter erroneous outputs, and (2) human annotation by domain-expert local staff to validate generated attributes. The framework operates iteratively -- prompts at each generation stage are refined based on quality check observations and annotator feedback across successive rounds, progressively improving attribute quality. Once the attribute taxonomy is established, we employ LLMs to perform structured attribute tagging on individual product items, enriching their contextual representations. The enriched catalog directly benefits multiple components of the search system: enabling granular attribute-based filtering, providing structured features for ranking models, and improving semantic representations for dense retrieval. We validate the generated taxonomy by training dense retrieval models on attribute-enriched product data, demonstrating consistent improvements over baselines using original catalog information. Our system has been deployed at Rakuten Taiwan, enriching 9 major categories spanning 2,694 sub-categories with 67,277 generated attributes, and over 5.4 million products have been tagged with the generated attributes, with plans to enrich the entire product catalog.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Self-evolving search agents, one of 13 directions in Synthetic data and self-improvement for LLMs. Builds on 20 of its 26 references that are in the map. First posted on arXiv 3 Jun 2026.

Builds on

20 of 26 references.

References · 20

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
  3. 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,767
  4. 2020Dense Passage Retrieval for Open-Domain Question Answeringcited by 3,779
  5. 2020Approximate Nearest Neighbor Negative Contrastive Learning for Dense Text Retrievalcited by 846
  6. 2023LLM-Blender: Ensembling Large Language Models with Pairwise Ranking and Generative Fusioncited by 550
  7. 2019Document Expansion by Query Predictioncited by 225
  8. 2021A Survey of Human-in-the-loop for Machine Learningcited by 214
  9. 2023SOLAR 10.7B: Scaling Large Language Models with Simple yet Effective Depth Up-Scalingcited by 172
  10. 2023Does Synthetic Data Generation of LLMs Help Clinical Text Mining?cited by 151
  11. 2023Query2doc: Query Expansion with Large Language Modelscited by 146
  12. 2025Harnessing Multiple Large Language Models: A Survey on LLM Ensemblecited by 86
8 more
  1. 2018OpenTag: Open Attribute Value Extraction from Product Profiles [Deep Learning, Active Learning, Named Entity Recognition]cited by 62
  2. 2020AutoKnow: Self-Driving Knowledge Collection for Products of Thousands of Typescited by 31
  3. 2024BERGEN: A Benchmarking Library for Retrieval-Augmented Generationcited by 31
  4. 2020Octet: Online Catalog Taxonomy Enrichment with Self-Supervisioncited by 22
  5. 2024TaxoLLaMA: WordNet-based Model for Solving Multiple Lexical Semantic Taskscited by 14
  6. 2021Annotation Curricula to Implicitly Train Non-Expert Annotatorscited by 8
  7. 2023Pre-training with Aspect-Content Text Mutual Prediction for Multi-Aspect Dense Retrievalcited by 3
  8. 2023SAGE: Structured Attribute Value Generation for Billion-Scale Product Catalogscited by 3

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026A Chain-of-Thought Approach to Semantic Query Categorization in e-Commerce Taxonomies
  2. 2026Scaling E-Commerce Attribute Extraction with Parallel Decoding
  3. 2026TRACE: Agentic Catalog Enrichment with Multi-source Evidence Grounding
  4. 2026Semantic Retrieval for Product Search in E-Commerce
  5. 2026AutoPKG: An Automated Framework for Dynamic E-commerce Product-Attribute Knowledge Graph Construction
  6. 2025Automated Query-Product Relevance Labeling using Large Language Models for E-commerce Search
  7. 2021AdaTag: Multi-Attribute Value Extraction from Product Profiles with Adaptive Decoding
  8. 2026CatalogAgent: A Supervisor-mediated Self-Learning System Enabling Context Engineering for GenAI Models