mlsanityData to 14 Oct 2026

ReCap: Event-Aware Image Captioning with Article Retrieval and Semantic Gaussian Normalization

arXiv 2509.01259 ↗First posted 1 Sep 2025cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Image captioning systems often produce generic descriptions that fail to capture event-level semantics which are crucial for applications like news reporting and digital archiving. We present ReCap, a novel pipeline for event-enriched image retrieval and captioning that incorporates broader contextual information from relevant articles to generate narrative-rich, factually grounded captions. Our approach addresses the limitations of standard vision-language models that typically focus on visible content while missing temporal, social, and historical contexts. ReCap comprises three integrated components: (1) a robust two-stage article retrieval system using DINOv2 embeddings with global feature similarity for initial candidate selection followed by patch-level mutual nearest neighbor similarity re-ranking; (2) a context extraction framework that synthesizes information from article summaries, generic captions, and original source metadata; and (3) a large language model-based caption generation system with Semantic Gaussian Normalization to enhance fluency and relevance. Evaluated on the OpenEvents V1 dataset as part of Track 1 in the EVENTA 2025 Grand Challenge, ReCap achieved a strong overall score of 0.54666, ranking 2nd on the private test set. These results highlight ReCap's effectiveness in bridging visual perception with real-world knowledge, offering a practical solution for context-aware image understanding in high-stakes domains. The code is available at https://github.com/Noridom1/EVENTA2025-Event-Enriched-Image-Captioning.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 26 of its 38 references that are in the map. First posted on arXiv 1 Sep 2025.

Builds on

26 of 38 references.

References · 26

  1. 2025Qwen3 Technical Reportcited by 8,820
  2. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
  3. 2014CIDEr: Consensus-based Image Description Evaluationcited by 2,046
  4. 2020TextCaps: a Dataset for Image Captioning with Reading Comprehensioncited by 400
  5. 2016Image Captioning with Semantic Attentioncited by 260
  6. 2018A Comprehensive Survey of Deep Learning for Image Captioningcited by 214
  7. 2019Image Captioning: Transforming Objects into Wordscited by 171
  8. 2020Visual News: Benchmark and Challenges in News Image Captioningcited by 121
  9. 2016Show and Tell: Lessons learned from the 2015 MSCOCO Image Captioning Challengecited by 116
  10. 2019Iterative Answer Prediction with Pointer-Augmented Multimodal Transformers for TextVQAcited by 107
  11. 2024DINOv2 Meets Text: A Unified Framework for Image- and Pixel-Level Vision-Language Alignmentcited by 79
  12. 2019Good News, Everyone! Context driven entity-aware captioning for news imagescited by 66
14 more
  1. 2021Instance-level Image Retrieval using Reranking Transformerscited by 63
  2. 2017Convolutional Image Captioningcited by 52
  3. 2020Transform and Tell: Entity-Aware News Image Captioningcited by 52
  4. 2023Information Retrieval: Recent Advances and Beyondcited by 49
  5. 2023Global Features are All You Need for Image Retrieval and Rerankingcited by 41
  6. 2024MeaCap: Memory-Augmented Zero-shot Image Captioningcited by 35
  7. 2021Boosting Entity-aware Image Captioning with Multi-modal Knowledge Graphcited by 31
  8. 2020Understanding Image Retrieval Re-Ranking: A Graph Neural Network Perspectivecited by 24
  9. 2019Informative Image Captioning with External Sources of Informationcited by 14
  10. 2023Visually-Aware Context Modeling for News Image Captioningcited by 12
  11. 2024Image Captioning in news report scenariocited by 12
  12. 2021ICECAP: Information Concentrated Entity-aware Image Captioningcited by 11
  13. 2023Beyond Generic: Enhancing Image Captioning with Real-World Knowledge using Vision-Language Pre-Training Modelcited by 10
  14. 2025OpenEvents V1: Large-Scale Benchmark Dataset for Multimodal Event Groundingcited by 8

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026CIAN: Multi-Stage Framework for Event-Enriched Image Captioning via Retrieval-Augmented Generation
  2. 2026Hierarchical Multi-Modal Retrieval for Knowledge-Grounded News Image Captioning
  3. 2025Leveraging Lightweight Entity Extraction for Scalable Event-Based Image Retrieval
  4. 2022CLIP-Event: Connecting Text and Images with Event Structures
  5. 2025Knowledge Completes the Vision: A Multimodal Entity-aware Retrieval-Augmented Generation Framework for News Image Captioning
  6. 2023Linear Alignment of Vision-language Models for Image Captioning
  7. 2023"Let's not Quote out of Context": Unified Vision-Language Pretraining for Context Assisted Image Captioning
  8. 2024No Detail Left Behind: Revisiting Self-Retrieval for Fine-Grained Image Captioning