mlsanityData to 14 Oct 2026

URECA: Unique Region Caption Anything

arXiv 2504.05305 ↗First posted 7 Apr 2025cs.CV cs.AIcited by 2

Not on the map. Why?

Abstract (arXiv)

Region-level captioning aims to generate natural language descriptions for specific image regions while highlighting their distinguishing features. However, existing methods struggle to produce unique captions across multi-granularity, limiting their real-world applicability. To address the need for detailed region-level understanding, we introduce URECA dataset, a large-scale dataset tailored for multi-granularity region captioning. Unlike prior datasets that focus primarily on salient objects, URECA dataset ensures a unique and consistent mapping between regions and captions by incorporating a diverse set of objects, parts, and background elements. Central to this is a stage-wise data curation pipeline, where each stage incrementally refines region selection and caption generation. By leveraging Multimodal Large Language Models (MLLMs) at each stage, our pipeline produces distinctive and contextually grounded captions with improved accuracy and semantic diversity. Building upon this dataset, we present URECA, a novel captioning model designed to effectively encode multi-granularity regions. URECA maintains essential spatial properties such as position and shape through simple yet impactful modifications to existing MLLMs, enabling fine-grained and semantically rich region descriptions. Our approach introduces dynamic mask modeling and a high-resolution mask encoder to enhance caption uniqueness. Experiments show that URECA achieves state-of-the-art performance on URECA dataset and generalizes well to existing region-level captioning benchmarks.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 52 of its 64 references that are in the map. First posted on arXiv 7 Apr 2025.

Builds on

52 of 64 references.

References · 52

  1. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  2. 2023Segment Anythingcited by 8,234
  3. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
  4. 2023Visual Instruction Tuningcited by 7,869
  5. 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,137
  6. 2025Qwen2.5-VL Technical Reportcited by 5,587
  7. 2019BERTScore: Evaluating Text Generation with BERTcited by 5,512
  8. 2023Improved Baselines with Visual Instruction Tuningcited by 4,418
  9. 2022Flamingo: a Visual Language Model for Few-Shot Learningcited by 4,386
  10. 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,234
  11. 2022OPT: Open Pre-trained Transformer Language Modelscited by 3,512
  12. 2016Visual Genome: Connecting Language and Vision Using Crowdsourced Dense Image Annotationscited by 2,656
38 more
  1. 2014CIDEr: Consensus-based Image Description Evaluationcited by 2,046
  2. 2024Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time Scalingcited by 1,599
  3. 2015Flickr30k Entities: Collecting Region-to-Phrase Correspondences for Richer Image-to-Sentence Modelscited by 1,362
  4. 2023Kosmos-2: Grounding Multimodal Large Language Models to the Worldcited by 1,089
  5. 2023LISA: Reasoning Segmentation via Large Language Modelcited by 776
  6. 2023MiniGPT-v2: large language model as a unified interface for vision-language multi-task learningcited by 625
  7. 2023GLaMM: Pixel Grounding Large Multimodal Modelcited by 455
  8. 2024InternLM-XComposer2: Mastering Free-form Text-Image Composition and Comprehension in Vision-Language Large Modelcited by 326
  9. 2023GPT4RoI: Instruction Tuning Large Language Model on Region-of-Interestcited by 302
  10. 2023Set-of-Mark Prompting Unleashes Extraordinary Visual Grounding in GPT-4Vcited by 299
  11. 2014Detect What You Can: Detecting and Representing Objects using Holistic Models and Body Partscited by 232
  12. 2023PixelLM: Pixel Reasoning with Large Multimodal Modelcited by 222
  13. 2023What does CLIP know about a red circle? Visual prompt engineering for VLMscited by 218
  14. 2015DenseCap: Fully Convolutional Localization Networks for Dense Captioningcited by 176
  15. 2023ViP-LLaVA: Making Large Multimodal Models Understand Arbitrary Visual Promptscited by 161
  16. 2023Osprey: Pixel Understanding with Visual Instruction Tuningcited by 159
  17. 2025Sa2VA: Marrying SAM2 with MLLM for Dense Grounded Understanding of Images and Videoscited by 159
  18. 2023Alpha-CLIP: A CLIP Model Focusing on Wherever You Wantcited by 151
  19. 2023PACO: Parts and Attributes of Common Objectscited by 146
  20. 2024LLaVA-Critic: Learning to Evaluate Multimodal Modelscited by 134
  21. 2024Prometheus-Vision: Vision-Language Model as a Judge for Fine-Grained Evaluationcited by 125
  22. 2022GRiT: A Generative Region-to-text Transformer for Object Understandingcited by 121
  23. 2024Groma: Localized Visual Tokenization for Grounding Multimodal Large Language Modelscited by 119
  24. 2021PartImageNet: A Large, High-Quality Dataset of Partscited by 107
  25. 2023Fine-Grained Visual Promptingcited by 82
  26. 2016A Joint Speaker-Listener-Reinforcer Model for Referring Expressionscited by 74
  27. 2024Contrastive Region Guidance: Improving Grounding in Vision-Language Models without Trainingcited by 64
  28. 2023Segment and Caption Anythingcited by 30
  29. 2020Compare and Reweight: Distinctive Image Captioning Using Similar Images Setscited by 27
  30. 2023MLLM-Bench: Evaluating Multimodal LLMs with Per-sample Criteriacited by 27
  31. 2024FINECAPTION: Compositional Image Captioning Focusing on Wherever You Want at Any Granularitycited by 27
  32. 2025Omni-RGPT: Unifying Image and Video Region-level Understanding via Token Markscited by 17
  33. 2024USE: Universal Segment Embeddings for Open-Vocabulary Image Segmentationcited by 14
  34. 2024ControlCap: Controllable Region-level Captioningcited by 13
  35. 2024Pseudo-RIS: Distinctive Pseudo-supervision Generation for Referring Image Segmentationcited by 13
  36. 2024PRIMA: Multi-Image Vision-Language Models for Reasoning Segmentationcited by 13
  37. 2024FullAnno: A Data Engine for Enhancing Image Comprehension of MLLMscited by 12
  38. 2024Instruction-guided Multi-Granularity Segmentation and Captioning with Large Multimodal Modelcited by 8

50 most cited of 52 All 52 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 1.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Brazilian Portuguese Image Captioning with Transformers: A Study on Cross-Native-Translated Dataset
  2. 2024RegionGPT: Towards Region Understanding Vision Language Model
  3. 2025DenseWorld-1M: Towards Detailed Dense Grounded Caption in the Real World
  4. 2023Sieve: Multimodal Dataset Pruning Using Image Captioning Models
  5. 2025Attention-based transformer models for image captioning across languages: An in-depth survey and evaluation
  6. 2025A Benchmark for Multi-Lingual Vision-Language Learning in Remote Sensing Image Captioning
  7. 2024BLIP3-KALE: Knowledge Augmented Large-Scale Dense Captions
  8. 2025OmniDiff: A Comprehensive Benchmark for Fine-grained Image Difference Captioning