OneVision: An End-to-End Generative Framework for Multi-view E-commerce Vision Search
Not on the map. Why?
Abstract (arXiv)
Traditional vision search, similar to search and recommendation systems, follows the multi-stage cascading architecture (MCA) paradigm to balance efficiency and conversion. Specifically, the query image undergoes feature extraction, recall, pre-ranking, and ranking stages, ultimately presenting the user with semantically similar products that meet their preferences. This multi-view representation discrepancy of the same object in the query and the optimization objective collide across these stages, making it difficult to achieve Pareto optimality in both user experience and conversion. In this paper, an end-to-end generative framework, OneVision, is proposed to address these problems. OneVision builds on VRQ, a vision-aligned residual quantization encoding, which can align the vastly different representations of an object across multiple viewpoints while preserving the distinctive features of each product as much as possible. Then a multi-stage semantic alignment scheme is adopted to maintain strong visual similarity priors while effectively incorporating user-specific information for personalized preference generation. In offline evaluations, OneVision performs on par with online MCA, while improving inference efficiency by 21% through dynamic pruning. In A/B tests, it achieves significant online improvements: +2.15% item CTR, +2.27% CVR, and +3.12% order volume. These results demonstrate that a semantic ID centric, generative architecture can unify retrieval and personalization while simplifying the serving pathway.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 36 of its 52 references that are in the map. First posted on arXiv 7 Oct 2025.
Builds on
36 of 52 references.
References · 36
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
- 2025Qwen3 Technical Reportcited by 8,195
- 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,874
- 2020mT5: A massively multilingual pre-trained text-to-text transformercited by 1,813
- 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiencycited by 1,419
- 2019Generating Diverse High-Fidelity Images with VQ-VAE-2cited by 1,376
- 2025DINOv3cited by 1,297
- 2022Autoregressive Image Generation using Residual Quantizationcited by 706
- 2024YOLO-World: Real-Time Open-Vocabulary Object Detectioncited by 498
- 2023Finite Scalar Quantization: VQ-VAE Made Simplecited by 425
- 2020RocketQA: An Optimized Training Approach to Dense Passage Retrieval for Open-Domain Question Answeringcited by 410
- 2020Circle Loss: A Unified Perspective of Pair Similarity Optimizationcited by 402
24 more
- 2020Autoregressive Entity Retrievalcited by 333
- 2025YOLOv12: Attention-Centric Real-Time Object Detectorscited by 300
- 2022Transformer Memory as a Differentiable Search Indexcited by 242
- 2023Recommender Systems with Generative Retrievalcited by 191
- 2023Adapting Large Language Models by Integrating Collaborative Semantics for Recommendationcited by 171
- 2025OneRec: Unifying Retrieve and Rank with Generative Recommender and Iterative Preference Alignmentcited by 167
- 2024On Softmax Direct Preference Optimization for Recommendationcited by 64
- 2023Composed Image Retrieval using Contrastive Learning and Task-oriented CLIP-based Featurescited by 52
- 2022Correlation Verification for Image Retrievalcited by 47
- 2023Global Features are All You Need for Image Retrieval and Rerankingcited by 41
- 2025YOLOE: Real-Time Seeing Anythingcited by 36
- 2021Visual Search at Alibabacited by 27
- 2017Visual Search at eBaycited by 25
- 2019Learning a Unified Embedding for Visual Search at Pinterestcited by 25
- 2025OneSearch: A Preliminary Exploration of the Unified End-to-End Generative Framework for E-commerce Searchcited by 24
- 2023IRGen: Generative Modeling for Image Retrievalcited by 18
- 2019The Design and Implementation of a Real Time Visual Search System on JD E-commerce Platformcited by 16
- 2020Shop The Look: Building a Large Scale Visual Shopping System at Pinterestcited by 12
- 2025UniECS: Unified Multimodal E-Commerce Search Framework with Gated Cross-modal Fusioncited by 10
- 2025MMQ: Multimodal Mixture-of-Quantization Tokenization for Semantic ID Generation and User Behavioral Adaptationcited by 10
- 2025Token Sequence Compression for Efficient Multimodal Computingcited by 6
- 2023Unified Vision-Language Representation Modeling for E-Commerce Same-Style Products Retrievalcited by 5
- 2025GENIUS: A Generative Framework for Universal Multimodal Searchcited by 5
- 2022Visually Similar Products Retrieval for Shopsycited by 1
Built on by
Citing papers per year: 2026: 2.
2 papers.
- 2026Kelix Technical Reportcited by 1
- 2026PailitaoGR: Latent Think-with-Images for Generative Image Retrievalcited by 0
- 2026PailitaoGR: Latent Think-with-Images for Generative Image Retrieval27 Aug 2026
- 2026Kelix Technical Report10 Feb 2026