The Design and Implementation of a Real Time Visual Search System on JD E-commerce Platform
Not on the map. Why?
Abstract (arXiv)
We present the design and implementation of a visual search system for real time image retrieval on JD.com, the world's third largest and China's largest e-commerce site. We demonstrate that our system can support real time visual search with hundreds of billions of product images at sub-second timescales and handle frequent image updates through distributed hierarchical architecture and efficient indexing methods. We hope that sharing our practice with our real production system will inspire the middleware community's interest and appreciation for building practical large scale systems for emerging applications, such as ecommerce visual search.
Key facts. Cited by 16 papers in the map (data through 13 Oct 2026). First posted on arXiv 19 Aug 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 1; 2022: 1; 2023: 1; 2024: 1; 2025: 7; 2026: 5.
16 papers.
Sort:
By area:
- 2023High-Throughput Vector Similarity Search in Knowledge Graphscited by 19
- 2022Navigable Proximity Graph-Driven Native Hybrid Queries with Structured and Unstructured Constraintscited by 7
- 2025Cloud-Native Vector Search: A Comprehensive Performance Analysiscited by 3
- 2021Product Re-identification System in Fully Automated Defect Detectioncited by 2
- 2024AddrLLM: Address Rewriting via Large Language Model on Nationwide Logistics Datacited by 2
- 2025Benchmarking Filtered Approximate Nearest Neighbor Search Algorithms on Transformer-based Embedding Vectorscited by 2
- 2025Scalable Disk-Based Approximate Nearest Neighbor Search with Page-Aligned Graphcited by 2
- 2025OneVision: An End-to-End Generative Framework for Multi-view E-commerce Vision Searchcited by 2
- 2025CRINN: Contrastive Reinforcement Learning for Approximate Nearest Neighbor Searchcited by 0
- 2025Optimizing Product Deduplication in E-Commerce with Multimodal Embeddingscited by 0
- 2025All-in-one Graph-based Indexing for Hybrid Search on GPUscited by 0
- 2026Filtered Approximate Nearest Neighbor Search in Vector Databases: System Design and Performance Analysiscited by 0
4 more
- 2026Efficient K-generalizable Learned Searchcited by 0
- 2026Cardinality Estimation for High Dimensional Similarity Queries with Adaptive Bucket Probingcited by 0
- 2026FAVOR: Efficient Filter-Agnostic Vector ANNS Based on Selectivity-Aware Exclusion Distancescited by 0
- 2026ANNLib: A Development Framework for Efficient Approximate Nearest Neighbor Searchcited by 0
- 2026ANNLib: A Development Framework for Efficient Approximate Nearest Neighbor Search20 Jul 2026
- 2026FAVOR: Efficient Filter-Agnostic Vector ANNS Based on Selectivity-Aware Exclusion Distances8 May 2026
- 2026Cardinality Estimation for High Dimensional Similarity Queries with Adaptive Bucket Probing6 Apr 2026
- 2026Efficient K-generalizable Learned Search6 Mar 2026
- 2026Filtered Approximate Nearest Neighbor Search in Vector Databases: System Design and Performance Analysis11 Feb 2026
- 2025Cloud-Native Vector Search: A Comprehensive Performance Analysis18 Nov 2025
- 2025All-in-one Graph-based Indexing for Hybrid Search on GPUs2 Nov 2025
- 2025OneVision: An End-to-End Generative Framework for Multi-view E-commerce Vision Search7 Oct 2025
- 2025Scalable Disk-Based Approximate Nearest Neighbor Search with Page-Aligned Graph29 Sep 2025
- 2025Optimizing Product Deduplication in E-Commerce with Multimodal Embeddings19 Sep 2025
- 2025CRINN: Contrastive Reinforcement Learning for Approximate Nearest Neighbor Search4 Aug 2025
- 2025Benchmarking Filtered Approximate Nearest Neighbor Search Algorithms on Transformer-based Embedding Vectors29 Jul 2025
4 more
- 2024AddrLLM: Address Rewriting via Large Language Model on Nationwide Logistics Data17 Nov 2024
- 2023High-Throughput Vector Similarity Search in Knowledge Graphs4 Apr 2023
- 2022Navigable Proximity Graph-Driven Native Hybrid Queries with Structured and Unstructured Constraints25 Mar 2022
- 2021Product Re-identification System in Fully Automated Defect Detection20 Dec 2021
- 2025Cloud-Native Vector Search: A Comprehensive Performance Analysiscited by 3
- 2024AddrLLM: Address Rewriting via Large Language Model on Nationwide Logistics Datacited by 2
- 2025Benchmarking Filtered Approximate Nearest Neighbor Search Algorithms on Transformer-based Embedding Vectorscited by 2
- 2025CRINN: Contrastive Reinforcement Learning for Approximate Nearest Neighbor Searchcited by 0
- 2025All-in-one Graph-based Indexing for Hybrid Search on GPUscited by 0
- 2026Filtered Approximate Nearest Neighbor Search in Vector Databases: System Design and Performance Analysiscited by 0
- 2026FAVOR: Efficient Filter-Agnostic Vector ANNS Based on Selectivity-Aware Exclusion Distancescited by 0
- 2026FAVOR: Efficient Filter-Agnostic Vector ANNS Based on Selectivity-Aware Exclusion Distances8 May 2026
- 2026Filtered Approximate Nearest Neighbor Search in Vector Databases: System Design and Performance Analysis11 Feb 2026
- 2025Cloud-Native Vector Search: A Comprehensive Performance Analysis18 Nov 2025
- 2025All-in-one Graph-based Indexing for Hybrid Search on GPUs2 Nov 2025
- 2025CRINN: Contrastive Reinforcement Learning for Approximate Nearest Neighbor Search4 Aug 2025
- 2025Benchmarking Filtered Approximate Nearest Neighbor Search Algorithms on Transformer-based Embedding Vectors29 Jul 2025
- 2024AddrLLM: Address Rewriting via Large Language Model on Nationwide Logistics Data17 Nov 2024
- 2023High-Throughput Vector Similarity Search in Knowledge Graphscited by 19
- 2022Navigable Proximity Graph-Driven Native Hybrid Queries with Structured and Unstructured Constraintscited by 7
- 2021Product Re-identification System in Fully Automated Defect Detectioncited by 2
- 2025Scalable Disk-Based Approximate Nearest Neighbor Search with Page-Aligned Graphcited by 2
- 2025OneVision: An End-to-End Generative Framework for Multi-view E-commerce Vision Searchcited by 2
- 2025Optimizing Product Deduplication in E-Commerce with Multimodal Embeddingscited by 0
- 2026Efficient K-generalizable Learned Searchcited by 0
- 2026Cardinality Estimation for High Dimensional Similarity Queries with Adaptive Bucket Probingcited by 0
- 2026ANNLib: A Development Framework for Efficient Approximate Nearest Neighbor Searchcited by 0
- 2026ANNLib: A Development Framework for Efficient Approximate Nearest Neighbor Search20 Jul 2026
- 2026Cardinality Estimation for High Dimensional Similarity Queries with Adaptive Bucket Probing6 Apr 2026
- 2026Efficient K-generalizable Learned Search6 Mar 2026
- 2025OneVision: An End-to-End Generative Framework for Multi-view E-commerce Vision Search7 Oct 2025
- 2025Scalable Disk-Based Approximate Nearest Neighbor Search with Page-Aligned Graph29 Sep 2025
- 2025Optimizing Product Deduplication in E-Commerce with Multimodal Embeddings19 Sep 2025
- 2023High-Throughput Vector Similarity Search in Knowledge Graphs4 Apr 2023
- 2022Navigable Proximity Graph-Driven Native Hybrid Queries with Structured and Unstructured Constraints25 Mar 2022
- 2021Product Re-identification System in Fully Automated Defect Detection20 Dec 2021