FIGROTD: A Friendly-to-Handle Dataset for Image Guided Retrieval with Optional Text
Not on the map. Why?
Abstract (arXiv)
Image-Guided Retrieval with Optional Text (IGROT) unifies visual retrieval (without text) and composed retrieval (with text). Despite its relevance in applications like Google Image and Bing, progress has been limited by the lack of an accessible benchmark and methods that balance performance across subtasks. Large-scale datasets such as MagicLens are comprehensive but computationally prohibitive, while existing models often favor either visual or compositional queries. We introduce FIGROTD, a lightweight yet high-quality IGROT dataset with 16,474 training triplets and 1,262 test triplets across CIR, SBIR, and CSTBIR. To reduce redundancy, we propose the Variance Guided Feature Mask (VaGFeM), which selectively enhances discriminative dimensions based on variance statistics. We further adopt a dual-loss design (InfoNCE + Triplet) to improve compositional reasoning. Trained on FIGROTD, VaGFeM achieves competitive results on nine benchmarks, reaching 34.8 mAP@10 on CIRCO and 75.7 mAP@200 on Sketchy, outperforming stronger baselines despite fewer triplets.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 21 of its 29 references that are in the map. First posted on arXiv 27 Nov 2025.
Builds on
21 of 29 references.
References · 21
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,322
- 2024LLaVA-NeXT-Interleave: Tackling Multi-image, Video, and 3D in Large Multimodal Modelscited by 584
- 2021Image Retrieval on Real-life Images with Pre-trained Vision-and-Language Modelscited by 251
- 2018Composing Text and Image for Image Retrieval - An Empirical Odysseycited by 236
- 2024MagicLens: Self-Supervised Image Retrieval with Open-Ended Instructionscited by 119
- 2019Doodle to Search: Practical Zero-Shot Sketch-based Image Retrievalcited by 79
- 2023CLIP for All Things Zero-Shot Sketch-Based Image Retrieval, Fine-Grained or Notcited by 79
- 2018A Zero-Shot Framework for Sketch-based Image Retrievalcited by 71
- 2017Deep Sketch Hashing: Fast Free-hand Sketch-Based Image Retrievalcited by 68
- 2023Data Roaming and Quality Assessment for Composed Image Retrievalcited by 46
- 2019Fashion IQ: A New Dataset Towards Retrieving Images by Natural Language Feedbackcited by 43
9 more
- 2023Zero-shot Composed Text-Image Retrievalcited by 32
- 2023Zero-Shot Everything Sketch-Based Image Retrieval, and in Explainable Stylecited by 25
- 2024iSEARLE: Improving Textual Inversion for Zero-Shot Composed Image Retrievalcited by 24
- 2024EgoCVR: An Egocentric Benchmark for Fine-Grained Composed Video Retrievalcited by 21
- 2025CoLLM: A Large Language Model for Composed Image Retrievalcited by 21
- 2025The CASTLE 2024 Dataset: Advancing the Art of Multimodal Understandingcited by 16
- 2024Composed Image Retrieval for Remote Sensingcited by 14
- 2025Composite Sketch+Text Queries for Retrieving Objects with Elusive Names and Complex Interactionscited by 5
- 2025Quizzard@INOVA Challenge 2025 -- Track A: Plug-and-Play Technique in Interleaved Multi-Image Modelcited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.