VCG: A Multimodal Retrieval Framework for E-Commerce Video Feeds under Extreme Cold-Start Conditions
Not on the map. Why?
Abstract (arXiv)
The digital commerce landscape is shifting from static, search-driven catalogs to dynamic, immersive video feeds. This transition introduces an ``extreme cold-start'' problem: unlike traditional items, new short-form videos lack the dense interaction history required for collaborative filtering. Furthermore, immersive feeds introduce strong position and duration biases that distort standard engagement signals. In this paper, we demonstrate the Video Candidate Generation (VCG) system, a scalable multimodal retrieval engine designed to solve these challenges in a large-scale e-commerce environment. By leveraging a domain-adapted vision-language model (based on CLIP), we map users and videos into a shared semantic space, enabling zero-shot retrieval based on visual content rather than behavioral history. We detail the system's architecture and present a rigorous evaluation comparing generative (LLM) vs. discriminative (CLIP) embeddings. Our results show that while generative models excel at attribute prediction, they suffer from embedding space collapse in retrieval tasks. Online A/B testing demonstrates that VCG effectively mitigates engagement biases, yielding a 50% uplift in deep video completion. To showcase the system's capabilities, we present an interactive demonstration featuring three bi-directional retrieval scenarios: Product-to-Video, Video-to-Product, and Zero-Shot Semantic Search.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 11 of its 26 references that are in the map. First posted on arXiv 17 Jun 2026.
Builds on
11 of 26 references.
References · 11
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
- 2019How Contextual are Contextualized Word Representations? Comparing the Geometry of BERT, ELMo, and GPT-2 Embeddingscited by 784
- 2023Large Language Models are Zero-Shot Rankers for Recommender Systemscited by 309
- 2020PinnerSage: Multi-Modal User Embedding Framework for Recommendations at Pinterestcited by 75
- 2022Contrastive language and vision learning of general fashion conceptscited by 42
- 2022Deconfounding Duration Bias in Watch-time Prediction for Video Recommendationcited by 37
- 2024Retrieve, Annotate, Evaluate, Repeat: Leveraging Multimodal LLMs for Large-Scale Product Retrieval Evaluationcited by 12
- 2016Fashion DNA: Merging Content and Sales Data for Recommendation and Article Mappingcited by 10
- 2025The Consistency Hypothesis in Uncertainty Quantification for Large Language Modelscited by 6
- 2021Business Entity Matching with Siamese Graph Convolutional Networkscited by 4
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Short-Form Video Recommendations with Multimodal Embeddings: Addressing Cold-Start and Bias Challenges
- 2025VL-CLIP: Enhancing Multimodal Recommendations via Visual Grounding and LLM-Augmented CLIP Embeddings
- 2025Factorized Transport Alignment for Multimodal and Multiview E-commerce Representation Learning ↗
- 2026Text-Guided Visual Representation Learning for Robust Multimodal E-Commerce Recommendation ↗
- 2025Zero-Shot Retrieval for Scalable Visual Search in a Two-Sided Marketplace
- 2026Graded-Relevance Composed Multimodal Retrieval for E-commerce Visual Search at Scale
- 2026Beyond Similarity: Foundation Models as an Efficient Backbone for Training-Free Composed Video Retrieval
- 2026MMRM: A Multiplex Multimodal Representation Model for Product Ranking in E-commerce Search