mlsanityData to 7 Oct 2026

Unified Vision-Language Representation Modeling for E-Commerce Same-Style Products Retrieval

arXiv 2302.05093 ↗First posted 10 Feb 2023cs.IR cs.AI cs.MMcited by 5

Not on the map. Why?

Abstract (arXiv)

Same-style products retrieval plays an important role in e-commerce platforms, aiming to identify the same products which may have different text descriptions or images. It can be used for similar products retrieval from different suppliers or duplicate products detection of one supplier. Common methods use the image as the detected object, but they only consider the visual features and overlook the attribute information contained in the textual descriptions, and perform weakly for products in image less important industries like machinery, hardware tools and electronic component, even if an additional text matching module is added. In this paper, we propose a unified vision-language modeling method for e-commerce same-style products retrieval, which is designed to represent one product with its textual descriptions and visual contents. It contains one sampling skill to collect positive pairs from user click log with category and relevance constrained, and a novel contrastive loss unit to model the image, text, and image+text representations into one joint embedding space. It is capable of cross-modal product-to-product retrieval, as well as style transfer and user-interactive search. Offline evaluations on annotated data demonstrate its superior retrieval performance, and online testings show it can attract more clicks and conversions. Moreover, this model has already been deployed online for similar products retrieval in alibaba.com, the largest B2B e-commerce platform in the world.

Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 17 of its 19 references that are in the map. First posted on arXiv 10 Feb 2023.

Builds on

17 of 19 references.

References · 17

  1. 2017Attention Is All You Needcited by 59,932
  2. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  3. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  4. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  5. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  6. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
  7. 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,617
  8. 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,310
  9. 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,907
  10. 2019ViLBERT: Pretraining Task-Agnostic Visiolinguistic Representations for Vision-and-Language Taskscited by 2,219
  11. 2021Align before Fuse: Vision and Language Representation Learning with Momentum Distillationcited by 1,612
  12. 2020Oscar: Object-Semantics Aligned Pre-training for Vision-Language Taskscited by 1,213
5 more
  1. 2019VL-BERT: Pre-training of Generic Visual-Linguistic Representationscited by 954
  2. 2019Unicoder-VL: A Universal Encoder for Vision and Language by Cross-modal Pre-trainingcited by 451
  3. 2021Kaleido-BERT: Vision-Language Pre-training on Fashion Domaincited by 67
  4. 2020FashionBERT: Text and Image Matching with Adaptive Loss for Cross-modal Retrievalcited by 55
  5. 2022CommerceMM: Large-Scale Commerce MultiModal Representation Learning with Omni Retrievalcited by 25

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 4; 2026: 1.

5 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2023Query-LIFE: Query-aware Language Image Fusion Embedding for E-Commerce Relevance
  2. 2023MAKE: Vision-Language Pre-training based Product Retrieval in Taobao Search
  3. 2022V2L: Leveraging Vision and Vision-language Models into Large-scale Product Retrieval
  4. 2025Improving Visual Recommendation on E-commerce Platforms Using Vision-Language Models
  5. 2025Turning Adversaries into Allies: Reversing Typographic Attacks for Multimodal E-Commerce Product Retrieval
  6. 2026FashionMV: Product-Level Composed Image Retrieval with Multi-View Fashion Data
  7. 2025PRISM: Product Retrieval In Shopping Carts using Hybrid Matching
  8. 2023Delving into E-Commerce Product Retrieval with Vision-Language Pre-training