# Video2Shop: Exact Matching Clothes in Videos to Online Shopping Images

arXiv: https://arxiv.org/abs/1804.05287 · HTML: https://mlsanity.com/paper/1804.05287/

## Key facts

- Cited by 26 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 14 Apr 2018.

## Built on by (most cited first, 26 of 26)

- [Emotion-LLaMA: Multimodal Emotion Recognition and Reasoning with Instruction Tuning](https://mlsanity.com/paper/2406.11161/) (2024)
- [Implicit Temporal Modeling with Learnable Alignment for Video Recognition](https://mlsanity.com/paper/2304.10465/) (2023)
- [Multi-task Paired Masking with Alignment Modeling for Medical Vision-Language Pre-training](https://mlsanity.com/paper/2305.07920/) (2023)
- [GSRFormer: Grounded Situation Recognition Transformer with Alternate Semantic Attention Refinement](https://mlsanity.com/paper/2208.08965/) (2022)
- [UniEmo: Unifying Emotional Understanding and Generation with Learnable Expert Queries](https://mlsanity.com/paper/2507.23372/) (2025)
- [WordArt Designer: User-Driven Artistic Typography Synthesis using Large Language Models](https://mlsanity.com/paper/2310.18332/) (2023)
- [ProContEXT: Exploring Progressive Context Transformer for Tracking](https://mlsanity.com/paper/2210.15511/) (2022)
- [DAMO-StreamNet: Optimizing Streaming Perception in Autonomous Driving](https://mlsanity.com/paper/2303.17144/) (2023)
- [PoSynDA: Multi-Hypothesis Pose Synthesis Domain Adaptation for Robust 3D Human Pose Estimation](https://mlsanity.com/paper/2308.09678/) (2023)
- [MetaDesigner: Advancing Artistic Typography Through AI-Driven, User-Centric, and Multilingual WordArt Synthesis](https://mlsanity.com/paper/2406.19859/) (2024)
- [Long-term Leap Attention, Short-term Periodic Shift for Video Classification](https://mlsanity.com/paper/2207.05526/) (2022)
- [Multi-queue Momentum Contrast for Microvideo-Product Retrieval](https://mlsanity.com/paper/2212.11471/) (2022)
- [Fashion Focus: Multi-modal Retrieval System for Video Commodity Localization in E-commerce](https://mlsanity.com/paper/2102.04727/) (2021)
- [MovingFashion: a Benchmark for the Video-to-Shop Challenge](https://mlsanity.com/paper/2110.02627/) (2021)
- [Smart Fashion: A Review of AI Applications in the Fashion & Apparel Industry](https://mlsanity.com/paper/2111.00905/) (2021)
- [KeyPosS: Plug-and-Play Facial Landmark Detection through GPS-Inspired True-Range Multilateration](https://mlsanity.com/paper/2305.16437/) (2023)
- [Cross-view Semantic Alignment for Livestreaming Product Recognition](https://mlsanity.com/paper/2308.04912/) (2023)
- [FashionSearchNet-v2: Learning Attribute Representations with Localization for Image Retrieval with Attribute Manipulation](https://mlsanity.com/paper/2111.14145/) (2021)
- [WordArt Designer API: User-Driven Artistic Typography Synthesis with Large Language Models on ModelScope](https://mlsanity.com/paper/2401.01699/) (2024)
- [POPoS: Improving Efficient and Robust Facial Landmark Detection with Parallel Optimal Position Search](https://mlsanity.com/paper/2410.09583/) (2024)
- [fAshIon after fashion: A Report of AI in Fashion](https://mlsanity.com/paper/2105.03050/) (2021)
- [Spatiotemporal Graph Guided Multi-modal Network for Livestreaming Product Retrieval](https://mlsanity.com/paper/2407.16248/) (2024)
- [ASR-enhanced Multimodal Representation Learning for Cross-Domain Product Retrieval](https://mlsanity.com/paper/2408.02978/) (2024)
- [UCDR-Adapter: Exploring Adaptation of Pre-Trained Vision-Language Models for Universal Cross-Domain Retrieval](https://mlsanity.com/paper/2412.10680/) (2024)
- [ICAR: Image-based Complementary Auto Reasoning](https://mlsanity.com/paper/2308.09119/) (2023)
- [Grounded Product Understanding in Livestream Videos](https://mlsanity.com/paper/2609.20508/) (2026)

## Abstract (arXiv)

In recent years, both online retail and video hosting service are exponentially growing. In this paper, we explore a new cross-domain task, Video2Shop, targeting for matching clothes appeared in videos to the exact same items in online shops. A novel deep neural network, called AsymNet, is proposed to explore this problem. For the image side, well-established methods are used to detect and extract features for clothing patches with arbitrary sizes. For the video side, deep visual features are extracted from detected object regions in each frame, and further fed into a Long Short-Term Memory (LSTM) framework for sequence modeling, which captures the temporal dynamics in videos. To conduct exact matching between videos and online shopping images, LSTM hidden states, representing the video, and image features, which represent static object images, are jointly modeled under the similarity network with reconfigurable deep tree structure. Moreover, an approximate training method is proposed to achieve the efficiency when training. Extensive experiments conducted on a large cross-domain dataset have demonstrated the effectiveness and efficiency of the proposed AsymNet, which outperforms the state-of-the-art methods.