EVENT-Retriever: Event-Aware Multimodal Image Retrieval for Realistic Captions
Not on the map. Why?
Abstract (arXiv)
Event-based image retrieval from free-form captions presents a significant challenge: models must understand not only visual features but also latent event semantics, context, and real-world knowledge. Conventional vision-language retrieval approaches often fall short when captions describe abstract events, implicit causality, temporal context, or contain long, complex narratives. To tackle these issues, we introduce a multi-stage retrieval framework combining dense article retrieval, event-aware language model reranking, and efficient image collection, followed by caption-guided semantic matching and rank-aware selection. We leverage Qwen3 for article search, Qwen3-Reranker for contextual alignment, and Qwen2-VL for precise image scoring. To further enhance performance and robustness, we fuse outputs from multiple configurations using Reciprocal Rank Fusion (RRF). Our system achieves the top-1 score on the private test set of Track 2 in the EVENTA 2025 Grand Challenge, demonstrating the effectiveness of combining language-based reasoning and multimodal retrieval for complex, real-world image understanding. The code is available at https://github.com/vdkhoi20/EVENT-Retriever.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 17 of its 34 references that are in the map. First posted on arXiv 31 Aug 2025.
Builds on
17 of 34 references.
References · 17
- 2023GPT-4 Technical Reportcited by 18,132
- 2014Microsoft COCO: Common Objects in Contextcited by 17,498
- 2025Qwen3 Technical Reportcited by 8,195
- 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,151
- 2021Scaling Up Visual and Vision-Language Representation Learning With Noisy Text Supervisioncited by 3,848
- 2023Qwen Technical Reportcited by 3,273
- 2019LXMERT: Learning Cross-Modality Encoder Representations from Transformerscited by 1,548
- 2015Flickr30k Entities: Collecting Region-to-Phrase Correspondences for Richer Image-to-Sentence Modelscited by 1,352
- 2025Qwen3 Embedding: Advancing Text Embedding and Reranking Through Foundation Modelscited by 1,175
- 2024MiniCPM-V: A GPT-4V Level MLLM on Your Phonecited by 1,061
- 2024How Far Are We to GPT-4V? Closing the Gap to Commercial Multimodal Models with Open-Source Suitescited by 1,033
- 2022GIT: A Generative Image-to-text Transformer for Vision and Languagecited by 536
5 more
- 2024Multilingual E5 Text Embeddings: A Technical Reportcited by 357
- 2021Image Retrieval on Real-life Images with Pre-trained Vision-and-Language Modelscited by 244
- 2024GME: Improving Universal Multimodal Retrieval by Multimodal LLMscited by 166
- 2021EventBERT: A Pre-Trained Model for Event Correlation Reasoningcited by 40
- 2025OpenEvents V1: Large-Scale Benchmark Dataset for Multimodal Event Groundingcited by 8
Built on by
Not cited yet.