TIGER-FG: Text-Guided Implicit Fine-Grained Grounding for E-commerce Retrieval
Not on the map. Why?
Abstract (arXiv)
E-commerce image search often takes a cropped image as the query, while each candidate is represented by full item images and structured text. This image-to-multimodal retrieval setting presents two asymmetries: a modality disparity -- a visual query must match image--text items, and a granularity disparity -- a cropped query must be compared with full images containing background context and possible distractors. Detection-based pipelines handle the granularity disparity through explicit localization but incur extra cost and error propagation, whereas CLIP-style encoders avoid detection, but are vulnerable to backgrounds or irrelevant items. To address these limitations, we propose TIGER-FG, a text-guided implicit fine-grained grounding framework for image-to-multimodal e-commerce retrieval. TIGER-FG uses item text as semantic guidance to produce target-focused item representations without object detection for retrieval. We further introduce dual distillation objectives that preserve target-region spatial consistency and query--item similarity structure, yielding more stable and discriminative multimodal representations. In addition, we construct ECom-RF-IMMR, a realistic benchmark suite with a 10M-pair training set and two evaluation benchmarks covering standard and cluttered item layouts. TIGER-FG improves Recall@1 over the strongest baseline by 6.1 and 34.4 percentage points on the two evaluation benchmarks, respectively, with only 85.7M query-side parameters and 256-dim embeddings. Results on public e-commerce benchmarks further demonstrate its generalization to noisy and one-to-many retrieval scenarios. Code and data will be released.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 35 of its 36 references that are in the map. First posted on arXiv 18 May 2026.
Builds on
35 of 36 references.
References · 35
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2020End-to-End Object Detection with Transformerscited by 7,414
- 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,137
- 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,322
- 2021Scaling Up Visual and Vision-Language Representation Learning With Noisy Text Supervisioncited by 3,864
- 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,332
- 2021Align before Fuse: Vision and Language Representation Learning with Momentum Distillationcited by 1,619
- 2025DINOv3cited by 1,414
- 2022DINO: DETR with Improved DeNoising Anchor Boxes for End-to-End Object Detectioncited by 1,319
- 2021Grounded Language-Image Pre-trainingcited by 1,156
- 2023Vision Transformers Need Registerscited by 871
23 more
- 2021MDETR -- Modulated Detection for End-to-End Multi-Modal Understandingcited by 819
- 2021FILIP: Fine-grained Interactive Language-Image Pre-Trainingcited by 627
- 2024YOLO-World: Real-Time Open-Vocabulary Object Detectioncited by 503
- 2024The Faiss librarycited by 376
- 2026Qwen3-VL-Embedding and Qwen3-VL-Reranker: A Unified Framework for State-of-the-Art Multimodal Retrieval and Rankingcited by 230
- 2024GME: Improving Universal Multimodal Retrieval by Multimodal LLMscited by 170
- 2023UniIR: Training and Benchmarking Universal Multimodal Information Retrieverscited by 166
- 2024MM-Embed: Universal Multimodal Retrieval with Multimodal LLMscited by 161
- 2022Chinese CLIP: Contrastive Vision-Language Pretraining in Chinesecited by 109
- 2024MegaPairs: Massive Data Synthesis For Universal Multimodal Retrievalcited by 84
- 2025jina-embeddings-v4: Universal Embeddings for Multimodal Multilingual Retrievalcited by 76
- 2021Product1M: Towards Weakly Supervised Instance-Level Product Retrieval via Cross-modal Pretrainingcited by 42
- 2025DeCLIP: Decoupled Learning for Open-Vocabulary Dense Perceptioncited by 33
- 2021M5Product: Self-harmonized Contrastive Learning for E-commercial Multi-modal Pretrainingcited by 26
- 2022CommerceMM: Large-Scale Commerce MultiModal Representation Learning with Omni Retrievalcited by 25
- 2025SmartCLIP: Modular Vision-language Alignment with Identification Guaranteescited by 14
- 2023Rethinking Benchmarks for Cross-modal Image-text Retrievalcited by 10
- 2025UniECS: Unified Multimodal E-Commerce Search Framework with Gated Cross-modal Fusioncited by 10
- 2023Learning Instance-Level Representation for Large-Scale Multi-Modal Pretraining in E-commercecited by 8
- 2026LookBench: A Live and Holistic Open Benchmark for Fashion Image Retrievalcited by 7
- 2023Unified Vision-Language Representation Modeling for E-Commerce Same-Style Products Retrievalcited by 5
- 2023Category-Oriented Representation Learning for Image to Multi-Modal Retrievalcited by 5
- 2025UniDGF: A Unified Detection-to-Generation Framework for Hierarchical Object Visual Recognitioncited by 1
Built on by
Not cited yet.