mlsanityData to 14 Oct 2026

General Image Descriptors for Open World Image Retrieval using ViT CLIP

arXiv 2210.11141 ↗First posted 20 Oct 2022cs.CV cs.AIcited by 2

Not on the map. Why?

Abstract (arXiv)

The Google Universal Image Embedding (GUIE) Challenge is one of the first competitions in multi-domain image representations in the wild, covering a wide distribution of objects: landmarks, artwork, food, etc. This is a fundamental computer vision problem with notable applications in image retrieval, search engines and e-commerce. In this work, we explain our 4th place solution to the GUIE Challenge, and our "bag of tricks" to fine-tune zero-shot Vision Transformers (ViT) pre-trained using CLIP.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 18 of its 25 references that are in the map. First posted on arXiv 20 Oct 2022.

Builds on

18 of 25 references.

References · 18

  1. 2017Attention Is All You Needcited by 60,361
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  3. 2020Language Models are Few-Shot Learnerscited by 32,419
  4. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  5. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
  6. 2017Improved Regularization of Convolutional Neural Networks with Cutoutcited by 1,628
  7. 2022Model soups: averaging weights of multiple fine-tuned models improves accuracy without increasing inference timecited by 1,396
  8. 2021Robust fine-tuning of zero-shot modelscited by 797
  9. 2018AutoAugment: Learning Augmentation Policies from Datacited by 730
  10. 2017Fine-tuning CNN Image Retrieval with No Human Annotationcited by 499
  11. 2020Google Landmarks Dataset v2 -- A Large-Scale Benchmark for Instance-Level Recognition and Retrievalcited by 309
  12. 2016Large-Scale Image Retrieval with Attentive Deep Local Featurescited by 238
6 more
  1. 2021Training Vision Transformers for Image Retrievalcited by 90
  2. 2022CLIP-Art: Contrastive Pre-training for Fine-Grained Art Classificationcited by 65
  3. 2021The 2021 Image Similarity Dataset and Challengecited by 44
  4. 2022Results and findings of the 2021 Image Similarity Challengecited by 10
  5. 2020Supporting large-scale image recognition with out-of-domain samplescited by 9
  6. 2021Exploring Vision Transformers for Fine-grained Classificationcited by 7

Built on by

Cited by year

Citing papers per year: 2022: 1; 2023: 1.

2 papers.

  1. 2023Towards Universal Image Embeddings: A Large-Scale Dataset and Challenge for Generic Image Representationscited by 28
  2. 2022A Brief Overview of AI Governance for Responsible Machine Learning Systemscited by 0