Referring Expression Comprehension for Small Objects
Not on the map. Why?
Abstract (arXiv)
Referring expression comprehension (REC) aims to localize the target object described by a natural language expression. Recent advances in vision-language learning have led to significant performance improvements in REC tasks. However, localizing extremely small objects remains a considerable challenge despite its importance in real-world applications such as autonomous driving. To address this issue, we introduce a novel dataset and method for REC targeting small objects. First, we present the small object REC (SOREC) dataset, which consists of 100,000 pairs of referring expressions and corresponding bounding boxes for small objects in driving scenarios. Second, we propose the progressive-iterative zooming adapter (PIZA), an adapter module for parameter-efficient fine-tuning that enables models to progressively zoom in and localize small objects. In a series of experiments, we apply PIZA to GroundingDINO and demonstrate a significant improvement in accuracy on the SOREC dataset. Our dataset, codes and pre-trained models are publicly available on the project page.
Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Builds on 79 of its 95 references that are in the map. First posted on arXiv 4 Oct 2025.
Builds on
79 of 95 references.
References · 79
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2014Microsoft COCO: Common Objects in Contextcited by 17,498
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
- 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,617
- 2020End-to-End Object Detection with Transformerscited by 7,384
- 2017Mask R-CNNcited by 7,259
- 2019Parameter-Efficient Transfer Learning for NLPcited by 4,195
- 2020Deformable DETR: Deformable Transformers for End-to-End Object Detectioncited by 3,410
- 2023QLoRA: Efficient Finetuning of Quantized LLMscited by 3,355
38 more
- 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,274
- 2015Fast R-CNNcited by 2,930
- 2021Learning to Prompt for Vision-Language Modelscited by 2,269
- 2013Rich feature hierarchies for accurate object detection and semantic segmentationcited by 2,160
- 2022Visual Prompt Tuningcited by 1,674
- 2022Conditional Prompt Learning for Vision-Language Modelscited by 1,427
- 2015Flickr30k Entities: Collecting Region-to-Phrase Correspondences for Richer Image-to-Sentence Modelscited by 1,352
- 2022DINO: DETR with Improved DeNoising Anchor Boxes for End-to-End Object Detectioncited by 1,306
- 2021Grounded Language-Image Pre-trainingcited by 1,147
- 2023Kosmos-2: Grounding Multimodal Large Language Models to the Worldcited by 1,075
- 2016Modeling Context in Referring Expressionscited by 1,054
- 2019How Can We Know What Language Models Know?cited by 953
- 2015Generation and Comprehension of Unambiguous Object Descriptionscited by 897
- 2021MDETR -- Modulated Detection for End-to-End Multi-Modal Understandingcited by 811
- 2022OFA: Unifying Architectures, Tasks, and Modalities Through a Simple Sequence-to-Sequence Learning Frameworkcited by 742
- 2022AdaptFormer: Adapting Vision Transformers for Scalable Visual Recognitioncited by 714
- 2022MaPLe: Multi-modal Prompt Learningcited by 685
- 2022DAB-DETR: Dynamic Anchor Boxes are Better Queries for DETRcited by 569
- 2022Vision Transformer Adapter for Dense Predictionscited by 564
- 2023DETRs Beat YOLOs on Real-time Object Detectioncited by 526
- 2018MAttNet: Modular Attention Network for Referring Expression Comprehensioncited by 427
- 2022Prompt-aligned Gradient for Prompt Tuningcited by 339
- 2019REVERIE: Remote Embodied Visual Referring Expression in Real Indoor Environmentscited by 330
- 2023Visual-Language Prompt Tuning with Knowledge-guided Context Optimizationcited by 307
- 2015WIDER FACE: A Face Detection Benchmarkcited by 297
- 2022GLIPv2: Unifying Localization and Vision-Language Understandingcited by 275
- 2022DETRs with Collaborative Hybrid Assignments Trainingcited by 273
- 2023Self-regulating Prompts: Foundational Model Adaptation without Forgettingcited by 272
- 2020Detection and Tracking Meet Drones Challengecited by 261
- 2016Modeling Context Between Objects for Referring Expression Understandingcited by 250
- 2022Prompt Distribution Learningcited by 235
- 2020Multi-task Collaborative Network for Joint Referring Expression Comprehension and Segmentationcited by 204
- 2021Object Detection in Aerial Images: A Large-Scale Benchmark and Challengescited by 202
- 2019A Fast and Accurate One-Stage Approach to Visual Groundingcited by 194
- 2023Universal Instance Perception as Object Discovery and Retrievalcited by 190
- 2023Semantic-SAM: Segment and Recognize Anything at Any Granularitycited by 185
- 2023QA-LoRA: Quantization-Aware Low-Rank Adaptation of Large Language Modelscited by 154
- 2022FacT: Factor-Tuning for Lightweight Adaptation on Vision Transformercited by 133
50 most cited of 79 All 79 (JSON)
Built on by
Citing papers per year: 2025: 1; 2026: 5.
6 papers.
- 2025Towards Cross-View Point Correspondence in Vision-Language Modelscited by 12
- 2026Towards Open-World Referring Expression Comprehension: A Benchmark with Training-free Multi-task Consistency Checkercited by 0
- 2026FindIt: A Format-Informed Visual Detection Benchmark for Generalist Multimodal LLMscited by 0
- 2026GrabVG: Graph-Attentive Binding for Visual Grounding in UAV Imagerycited by 0
- 2026A-PAIR: A Benchmark and Identity-Consistent Grounding Framework for Air-Ground Cross-View Referring Person Detectioncited by 0
- 2026EviRover: Reinforcing Agentic Perception Beyond a Glancecited by 0
- 2026EviRover: Reinforcing Agentic Perception Beyond a Glance30 Sep 2026
- 2026A-PAIR: A Benchmark and Identity-Consistent Grounding Framework for Air-Ground Cross-View Referring Person Detection28 Aug 2026
- 2026GrabVG: Graph-Attentive Binding for Visual Grounding in UAV Imagery19 Aug 2026
- 2026FindIt: A Format-Informed Visual Detection Benchmark for Generalist Multimodal LLMs2 Jun 2026
- 2026Towards Open-World Referring Expression Comprehension: A Benchmark with Training-free Multi-task Consistency Checker25 May 2026
- 2025Towards Cross-View Point Correspondence in Vision-Language Models4 Dec 2025