mlsanityData to 14 Oct 2026

ZSE-Cap: A Zero-Shot Ensemble for Image Retrieval and Prompt-Guided Captioning

arXiv 2507.20564 ↗First posted 28 Jul 2025cs.CL cs.IRcited by 0

Not on the map. Why?

Abstract (arXiv)

We present ZSE-Cap (Zero-Shot Ensemble for Captioning), our 4th place system in Event-Enriched Image Analysis (EVENTA) shared task on article-grounded image retrieval and captioning. Our zero-shot approach requires no finetuning on the competition's data. For retrieval, we ensemble similarity scores from CLIP, SigLIP, and DINOv2. For captioning, we leverage a carefully engineered prompt to guide the Gemma 3 model, enabling it to link high-level events from the article to the visual content in the image. Our system achieved a final score of 0.42002, securing a top-4 position on the private test set, demonstrating the effectiveness of combining foundation models through ensembling and prompting. Our code is available at https://github.com/ductai05/ZSE-Cap.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 7 of its 8 references that are in the map. First posted on arXiv 28 Jul 2025.

Builds on

7 of 8 references.

References · 7

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2014Microsoft COCO: Common Objects in Contextcited by 17,608
  3. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
  4. 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,109
  5. 2025Gemma 3 Technical Reportcited by 1,824
  6. 2015Flickr30k Entities: Collecting Region-to-Phrase Correspondences for Richer Image-to-Sentence Modelscited by 1,362
  7. 2025OpenEvents V1: Large-Scale Benchmark Dataset for Multimodal Event Groundingcited by 8

Built on by

Not cited yet.