Search and Detect: Training-Free Long Tail Object Detection via Web-Image Retrieval
Not on the map. Why?
Abstract (arXiv)
In this paper, we introduce SearchDet, a training-free long-tail object detection framework that significantly enhances open-vocabulary object detection performance. SearchDet retrieves a set of positive and negative images of an object to ground, embeds these images, and computes an input image-weighted query which is used to detect the desired concept in the image. Our proposed method is simple and training-free, yet achieves over 48.7% mAP improvement on ODinW and 59.1% mAP improvement on LVIS compared to state-of-the-art models such as GroundingDINO. We further show that our approach of basing object detection on a set of Web-retrieved exemplars is stable with respect to variations in the exemplars, suggesting a path towards eliminating costly data annotation and training procedures.
Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 30 of its 36 references that are in the map. First posted on arXiv 26 Sep 2024.
Builds on
30 of 36 references.
References · 30
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2014Microsoft COCO: Common Objects in Contextcited by 17,498
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
- 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,617
- 2023Segment Anythingcited by 8,158
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
- 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,861
- 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,274
- 2017Prototypical Networks for Few-shot Learningcited by 3,001
- 2015Fast R-CNNcited by 2,930
- 2024SAM 2: Segment Anything in Images and Videoscited by 2,784
- 2024Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phonecited by 1,883
18 more
- 2019LVIS: A Dataset for Large Vocabulary Instance Segmentationcited by 1,215
- 2021Grounded Language-Image Pre-trainingcited by 1,147
- 2023Segment Anything in High Qualitycited by 373
- 2020Frustratingly Simple Few-Shot Object Detectioncited by 280
- 2018Few-shot Object Detection via Feature Reweightingcited by 265
- 2019Few-Shot Object Detection with Attention-RPN and Multi-Relation Detectorcited by 206
- 2023Semantic-SAM: Segment and Recognize Anything at Any Granularitycited by 185
- 2019Meta R-CNN : Towards General Solver for Instance-level Few-shot Learningcited by 182
- 2021FSCE: Few-Shot Object Detection via Contrastive Proposal Encodingcited by 168
- 2024T-Rex2: Towards Generic Object Detection via Text-Visual Prompt Synergycited by 94
- 2021Generalized Few-Shot Object Detection without Forgettingcited by 88
- 2022Few-Shot Object Detection with Fully Cross-Transformercited by 64
- 2021Meta Faster R-CNN: Towards Accurate Few-Shot Object Detection with Attentive Feature Alignmentcited by 57
- 2021Query Adaptive Few-Shot Object Detection with Heterogeneous Graph Convolutional Networkscited by 55
- 2023Visual In-Context Promptingcited by 52
- 2021Label, Verify, Correct: A Simple Few Shot Object Detection Methodcited by 43
- 2023DiGeo: Discriminative Geometry-Aware Learning for Generalized Few-Shot Object Detectioncited by 21
- 2024Region-Based Representations Revisitedcited by 18
Built on by
Citing papers per year: 2025: 1; 2026: 4.
5 papers.
- 2025TextRegion: Text-Aligned Region Tokens from Frozen Image-Text Modelscited by 7
- 2026Pixel-Grounded Retrieval for Knowledgeable Large Multimodal Modelscited by 2
- 2026Autonomous Drift Learning in Data Streams: A Unified Perspectivecited by 0
- 2026Gen2Balance: Generative Balancing for Long-Tailed Video Action Recognitioncited by 0
- 2026IMPRINT: Image-Conditioned Query Enrichment for Long-Tail Object Goal Navigationcited by 0
- 2026IMPRINT: Image-Conditioned Query Enrichment for Long-Tail Object Goal Navigation27 Jul 2026
- 2026Gen2Balance: Generative Balancing for Long-Tailed Video Action Recognition21 Jun 2026
- 2026Autonomous Drift Learning in Data Streams: A Unified Perspective2 May 2026
- 2026Pixel-Grounded Retrieval for Knowledgeable Large Multimodal Models27 Jan 2026
- 2025TextRegion: Text-Aligned Region Tokens from Frozen Image-Text Models29 May 2025