URECA: Unique Region Caption Anything
Not on the map. Why?
Abstract (arXiv)
Region-level captioning aims to generate natural language descriptions for specific image regions while highlighting their distinguishing features. However, existing methods struggle to produce unique captions across multi-granularity, limiting their real-world applicability. To address the need for detailed region-level understanding, we introduce URECA dataset, a large-scale dataset tailored for multi-granularity region captioning. Unlike prior datasets that focus primarily on salient objects, URECA dataset ensures a unique and consistent mapping between regions and captions by incorporating a diverse set of objects, parts, and background elements. Central to this is a stage-wise data curation pipeline, where each stage incrementally refines region selection and caption generation. By leveraging Multimodal Large Language Models (MLLMs) at each stage, our pipeline produces distinctive and contextually grounded captions with improved accuracy and semantic diversity. Building upon this dataset, we present URECA, a novel captioning model designed to effectively encode multi-granularity regions. URECA maintains essential spatial properties such as position and shape through simple yet impactful modifications to existing MLLMs, enabling fine-grained and semantically rich region descriptions. Our approach introduces dynamic mask modeling and a high-resolution mask encoder to enhance caption uniqueness. Experiments show that URECA achieves state-of-the-art performance on URECA dataset and generalizes well to existing region-level captioning benchmarks.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 52 of its 64 references that are in the map. First posted on arXiv 7 Apr 2025.
Builds on
52 of 64 references.
References · 52
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2023Segment Anythingcited by 8,234
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2023Visual Instruction Tuningcited by 7,869
- 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,137
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2019BERTScore: Evaluating Text Generation with BERTcited by 5,512
- 2023Improved Baselines with Visual Instruction Tuningcited by 4,418
- 2022Flamingo: a Visual Language Model for Few-Shot Learningcited by 4,386
- 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,234
- 2022OPT: Open Pre-trained Transformer Language Modelscited by 3,512
- 2016Visual Genome: Connecting Language and Vision Using Crowdsourced Dense Image Annotationscited by 2,656
38 more
- 2014CIDEr: Consensus-based Image Description Evaluationcited by 2,046
- 2024Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time Scalingcited by 1,599
- 2015Flickr30k Entities: Collecting Region-to-Phrase Correspondences for Richer Image-to-Sentence Modelscited by 1,362
- 2023Kosmos-2: Grounding Multimodal Large Language Models to the Worldcited by 1,089
- 2023LISA: Reasoning Segmentation via Large Language Modelcited by 776
- 2023MiniGPT-v2: large language model as a unified interface for vision-language multi-task learningcited by 625
- 2023GLaMM: Pixel Grounding Large Multimodal Modelcited by 455
- 2024InternLM-XComposer2: Mastering Free-form Text-Image Composition and Comprehension in Vision-Language Large Modelcited by 326
- 2023GPT4RoI: Instruction Tuning Large Language Model on Region-of-Interestcited by 302
- 2023Set-of-Mark Prompting Unleashes Extraordinary Visual Grounding in GPT-4Vcited by 299
- 2014Detect What You Can: Detecting and Representing Objects using Holistic Models and Body Partscited by 232
- 2023PixelLM: Pixel Reasoning with Large Multimodal Modelcited by 222
- 2023What does CLIP know about a red circle? Visual prompt engineering for VLMscited by 218
- 2015DenseCap: Fully Convolutional Localization Networks for Dense Captioningcited by 176
- 2023ViP-LLaVA: Making Large Multimodal Models Understand Arbitrary Visual Promptscited by 161
- 2023Osprey: Pixel Understanding with Visual Instruction Tuningcited by 159
- 2025Sa2VA: Marrying SAM2 with MLLM for Dense Grounded Understanding of Images and Videoscited by 159
- 2023Alpha-CLIP: A CLIP Model Focusing on Wherever You Wantcited by 151
- 2023PACO: Parts and Attributes of Common Objectscited by 146
- 2024LLaVA-Critic: Learning to Evaluate Multimodal Modelscited by 134
- 2024Prometheus-Vision: Vision-Language Model as a Judge for Fine-Grained Evaluationcited by 125
- 2022GRiT: A Generative Region-to-text Transformer for Object Understandingcited by 121
- 2024Groma: Localized Visual Tokenization for Grounding Multimodal Large Language Modelscited by 119
- 2021PartImageNet: A Large, High-Quality Dataset of Partscited by 107
- 2023Fine-Grained Visual Promptingcited by 82
- 2016A Joint Speaker-Listener-Reinforcer Model for Referring Expressionscited by 74
- 2024Contrastive Region Guidance: Improving Grounding in Vision-Language Models without Trainingcited by 64
- 2023Segment and Caption Anythingcited by 30
- 2020Compare and Reweight: Distinctive Image Captioning Using Similar Images Setscited by 27
- 2023MLLM-Bench: Evaluating Multimodal LLMs with Per-sample Criteriacited by 27
- 2024FINECAPTION: Compositional Image Captioning Focusing on Wherever You Want at Any Granularitycited by 27
- 2025Omni-RGPT: Unifying Image and Video Region-level Understanding via Token Markscited by 17
- 2024USE: Universal Segment Embeddings for Open-Vocabulary Image Segmentationcited by 14
- 2024ControlCap: Controllable Region-level Captioningcited by 13
- 2024Pseudo-RIS: Distinctive Pseudo-supervision Generation for Referring Image Segmentationcited by 13
- 2024PRIMA: Multi-Image Vision-Language Models for Reasoning Segmentationcited by 13
- 2024FullAnno: A Data Engine for Enhancing Image Comprehension of MLLMscited by 12
- 2024Instruction-guided Multi-Granularity Segmentation and Captioning with Large Multimodal Modelcited by 8
50 most cited of 52 All 52 (JSON)
Built on by
Citing papers per year: 2025: 1; 2026: 1.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2026Brazilian Portuguese Image Captioning with Transformers: A Study on Cross-Native-Translated Dataset
- 2024RegionGPT: Towards Region Understanding Vision Language Model
- 2025DenseWorld-1M: Towards Detailed Dense Grounded Caption in the Real World
- 2023Sieve: Multimodal Dataset Pruning Using Image Captioning Models
- 2025Attention-based transformer models for image captioning across languages: An in-depth survey and evaluation
- 2025A Benchmark for Multi-Lingual Vision-Language Learning in Remote Sensing Image Captioning
- 2024BLIP3-KALE: Knowledge Augmented Large-Scale Dense Captions
- 2025OmniDiff: A Comprehensive Benchmark for Fine-grained Image Difference Captioning