ReCap: Event-Aware Image Captioning with Article Retrieval and Semantic Gaussian Normalization
Not on the map. Why?
Abstract (arXiv)
Image captioning systems often produce generic descriptions that fail to capture event-level semantics which are crucial for applications like news reporting and digital archiving. We present ReCap, a novel pipeline for event-enriched image retrieval and captioning that incorporates broader contextual information from relevant articles to generate narrative-rich, factually grounded captions. Our approach addresses the limitations of standard vision-language models that typically focus on visible content while missing temporal, social, and historical contexts. ReCap comprises three integrated components: (1) a robust two-stage article retrieval system using DINOv2 embeddings with global feature similarity for initial candidate selection followed by patch-level mutual nearest neighbor similarity re-ranking; (2) a context extraction framework that synthesizes information from article summaries, generic captions, and original source metadata; and (3) a large language model-based caption generation system with Semantic Gaussian Normalization to enhance fluency and relevance. Evaluated on the OpenEvents V1 dataset as part of Track 1 in the EVENTA 2025 Grand Challenge, ReCap achieved a strong overall score of 0.54666, ranking 2nd on the private test set. These results highlight ReCap's effectiveness in bridging visual perception with real-world knowledge, offering a practical solution for context-aware image understanding in high-stakes domains. The code is available at https://github.com/Noridom1/EVENTA2025-Event-Enriched-Image-Captioning.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 26 of its 38 references that are in the map. First posted on arXiv 1 Sep 2025.
Builds on
26 of 38 references.
References · 26
- 2025Qwen3 Technical Reportcited by 8,820
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2014CIDEr: Consensus-based Image Description Evaluationcited by 2,046
- 2020TextCaps: a Dataset for Image Captioning with Reading Comprehensioncited by 400
- 2016Image Captioning with Semantic Attentioncited by 260
- 2018A Comprehensive Survey of Deep Learning for Image Captioningcited by 214
- 2019Image Captioning: Transforming Objects into Wordscited by 171
- 2020Visual News: Benchmark and Challenges in News Image Captioningcited by 121
- 2016Show and Tell: Lessons learned from the 2015 MSCOCO Image Captioning Challengecited by 116
- 2019Iterative Answer Prediction with Pointer-Augmented Multimodal Transformers for TextVQAcited by 107
- 2024DINOv2 Meets Text: A Unified Framework for Image- and Pixel-Level Vision-Language Alignmentcited by 79
- 2019Good News, Everyone! Context driven entity-aware captioning for news imagescited by 66
14 more
- 2021Instance-level Image Retrieval using Reranking Transformerscited by 63
- 2017Convolutional Image Captioningcited by 52
- 2020Transform and Tell: Entity-Aware News Image Captioningcited by 52
- 2023Information Retrieval: Recent Advances and Beyondcited by 49
- 2023Global Features are All You Need for Image Retrieval and Rerankingcited by 41
- 2024MeaCap: Memory-Augmented Zero-shot Image Captioningcited by 35
- 2021Boosting Entity-aware Image Captioning with Multi-modal Knowledge Graphcited by 31
- 2020Understanding Image Retrieval Re-Ranking: A Graph Neural Network Perspectivecited by 24
- 2019Informative Image Captioning with External Sources of Informationcited by 14
- 2023Visually-Aware Context Modeling for News Image Captioningcited by 12
- 2024Image Captioning in news report scenariocited by 12
- 2021ICECAP: Information Concentrated Entity-aware Image Captioningcited by 11
- 2023Beyond Generic: Enhancing Image Captioning with Real-World Knowledge using Vision-Language Pre-Training Modelcited by 10
- 2025OpenEvents V1: Large-Scale Benchmark Dataset for Multimodal Event Groundingcited by 8
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026CIAN: Multi-Stage Framework for Event-Enriched Image Captioning via Retrieval-Augmented Generation
- 2026Hierarchical Multi-Modal Retrieval for Knowledge-Grounded News Image Captioning
- 2025Leveraging Lightweight Entity Extraction for Scalable Event-Based Image Retrieval
- 2022CLIP-Event: Connecting Text and Images with Event Structures
- 2025Knowledge Completes the Vision: A Multimodal Entity-aware Retrieval-Augmented Generation Framework for News Image Captioning
- 2023Linear Alignment of Vision-language Models for Image Captioning
- 2023"Let's not Quote out of Context": Unified Vision-Language Pretraining for Context Assisted Image Captioning
- 2024No Detail Left Behind: Revisiting Self-Retrieval for Fine-Grained Image Captioning