# Collaborative Quantization for Cross-Modal Similarity Search

arXiv: https://arxiv.org/abs/1902.00623 · HTML: https://mlsanity.com/paper/1902.00623/

## Key facts

- Cited by 3 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 2 Feb 2019.

## Built on by (most cited first, 3 of 3)

- [Efficient Cross-Modal Retrieval via Deep Binary Hashing and Quantization](https://mlsanity.com/paper/2202.10232/) (2022)
- [Distilling Vision-Language Pretraining for Efficient Cross-Modal Retrieval](https://mlsanity.com/paper/2405.14726/) (2024)
- [Multi-Modality Transformer for E-Commerce: Inferring User Purchase Intention to Bridge the Query-Product Gap](https://mlsanity.com/paper/2501.14826/) (2025)

## Abstract (arXiv)

Cross-modal similarity search is a problem about designing a search system supporting querying across content modalities, e.g., using an image to search for texts or using a text to search for images. This paper presents a compact coding solution for efficient search, with a focus on the quantization approach which has already shown the superior performance over the hashing solutions in the single-modal similarity search. We propose a cross-modal quantization approach, which is among the early attempts to introduce quantization into cross-modal search. The major contribution lies in jointly learning the quantizers for both modalities through aligning the quantized representations for each pair of image and text belonging to a document. In addition, our approach simultaneously learns the common space for both modalities in which quantization is conducted to enable efficient and effective search using the Euclidean distance computed in the common space with fast distance table lookup. Experimental results compared with several competitive algorithms over three benchmark datasets demonstrate that the proposed approach achieves the state-of-the-art performance.