PCLM: Small-target localization with frozen CLIP via prototype contrast and local magnification
Not on the map. Why?
Abstract (arXiv)
Small targets occupy few patches in a vision-language encoder, so spatial features often mix object appearance with surrounding content. We propose Prototype Contrast and Local Magnification (PCLM), a support-conditioned localization method that uses a frozen CLIP encoder. Five masked support images per class define foreground and background prototypes through equally weighted regional features. Their difference provides a shared scoring direction for query patches, explicitly comparing target evidence with the demonstrated background. Nine overlapping query windows are enlarged and encoded independently to sample small targets more densely. Reprojection and coverage averaging combine their scores into a continuous localization map. The class direction occupies 2 KiB regardless of support count and transfers unchanged across datasets with mapped categories. On 5,047 small-target queries from VOC, COCO, ADE20K and Oxford-IIIT Pets, PCLM achieves higher mean pixel AP than every evaluated text-conditioned localization baseline on each dataset under our evaluation protocol. Gains over the strongest scene-dataset baselines range from 5.63 to 13.23 percentage points. At comparable measured latency, local magnification improves scene small-target AP by 4.51 to 5.68 points over whole-canvas enlargement. Factorial experiments show that prototype contrast increases the benefit of local observation, including under matched image-coordinate filtering. Support-budget experiments show that additional examples refine category estimation without increasing representation size or query-time scoring cost.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 24 of its 35 references that are in the map. First posted on arXiv 4 Oct 2026.
Builds on
24 of 35 references.
References · 24
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2014Microsoft COCO: Common Objects in Contextcited by 17,608
- 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,733
- 2016Feature Pyramid Networks for Object Detectioncited by 5,036
- 2017Prototypical Networks for Few-shot Learningcited by 3,015
- 2021Learning to Prompt for Vision-Language Modelscited by 2,281
- 2016Matching Networks for One Shot Learningcited by 2,255
- 2022Conditional Prompt Learning for Vision-Language Modelscited by 1,433
- 2017Learning to Compare: Relation Network for Few-Shot Learningcited by 1,143
- 2016Semantic Understanding of Scenes through the ADE20K Datasetcited by 1,069
- 2021CLIP-Adapter: Better Vision-Language Models with Feature Adapterscited by 1,026
12 more
- 2020Quantifying Attention Flow in Transformerscited by 775
- 2020Transformer Interpretability Beyond Attention Visualizationcited by 627
- 2022Tip-Adapter: Training-free Adaption of CLIP for Few-shot Classificationcited by 362
- 2022Visual Classification via Description from Large Language Modelscited by 336
- 2024FeatUp: A Model-Agnostic Framework for Features at Any Resolutioncited by 116
- 2022Slicing Aided Hyper Inference and Fine-tuning for Small Object Detectioncited by 105
- 2023A Closer Look at the Explainability of Contrastive Language-Image Pre-trainingcited by 96
- 2024When Do We Not Need Larger Vision Models?cited by 67
- 2024LeGrad: An Explainability Method for Vision Transformers via Feature Formation Sensitivitycited by 33
- 2025Grad-ECLIP: Gradient-based Visual and Textual Explanations for CLIPcited by 8
- 2025Concept Regions Matter: Benchmarking CLIP with a New Cluster-Importance Approachcited by 3
- 2021Weakly Supervised Foreground Learning for Weakly Supervised Localization and Detectioncited by 2
Built on by
Not cited yet.