Quantifying and Narrowing the Unknown: Interactive Text-to-Video Retrieval via Uncertainty Minimization
Not on the map. Why?
Abstract (arXiv)
Despite recent advances, Text-to-video retrieval (TVR) is still hindered by multiple inherent uncertainties, such as ambiguous textual queries, indistinct text-video mappings, and low-quality video frames. Although interactive systems have emerged to address these challenges by refining user intent through clarifying questions, current methods typically rely on heuristic or ad-hoc strategies without explicitly quantifying these uncertainties, limiting their effectiveness. Motivated by this gap, we propose UMIVR, an Uncertainty-Minimizing Interactive Text-to-Video Retrieval framework that explicitly quantifies three critical uncertainties-text ambiguity, mapping uncertainty, and frame uncertainty-via principled, training-free metrics: semantic entropy-based Text Ambiguity Score (TAS), Jensen-Shannon divergence-based Mapping Uncertainty Score (MUS), and a Temporal Quality-based Frame Sampler (TQFS). By adaptively generating targeted clarifying questions guided by these uncertainty measures, UMIVR iteratively refines user queries, significantly reducing retrieval ambiguity. Extensive experiments on multiple benchmarks validate UMIVR's effectiveness, achieving notable gains in Recall@1 (69.2% after 10 interactive rounds) on the MSR-VTT-1k dataset, thereby establishing an uncertainty-minimizing foundation for interactive TVR.
Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Builds on 48 of its 64 references that are in the map. First posted on arXiv 21 Jul 2025.
Builds on
48 of 64 references.
References · 48
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2014Microsoft COCO: Common Objects in Contextcited by 17,608
- 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,893
- 2024GPT-4o System Cardcited by 4,588
- 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,322
- 2021Multitask Prompted Training Enables Zero-Shot Task Generalizationcited by 1,470
- 2023Video-LLaVA: Learning United Visual Representation by Alignment Before Projectioncited by 1,402
- 2019Aleatoric and Epistemic Uncertainty in Machine Learning: An Introduction to Concepts and Methodscited by 913
- 2023Semantic Uncertainty: Linguistic Invariances for Uncertainty Estimation in Natural Language Generationcited by 819
- 2021CLIP4Clip: An Empirical Study of CLIP for End to End Video Clip Retrievalcited by 651
- 2020Multi-modal Transformer for Video Retrievalcited by 395
- 2023LanguageBind: Extending Video-Language Pretraining to N-modality by Language-based Semantic Alignmentcited by 370
36 more
- 2022X-CLIP: End-to-End Multi-grained Contrastive Learning for Video-Text Retrievalcited by 280
- 2019Use What You Have: Video Retrieval Using Representations From Collaborative Expertscited by 214
- 2017Flow-Guided Feature Aggregation for Video Object Detectioncited by 177
- 2020Support-set bottlenecks for video-text representation learningcited by 170
- 2022X-Pool: Cross-Modal Language-Video Attention for Text-Video Retrievalcited by 128
- 2019Audio-Visual Scene-Aware Dialogcited by 123
- 2022TS2-Net: Token Shift and Selection Transformer for Text-Video Retrievalcited by 104
- 2018Cross-Modal and Hierarchical Modeling of Video and Textcited by 103
- 2022CenterCLIP: Token Clustering for Efficient Text-Video Retrievalcited by 86
- 2021TEACHTEXT: CrossModal Generalized Distillation for Text-Video Retrievalcited by 81
- 2022CLIP-ViP: Adapting Pre-trained Image-Text Model to Video-Language Representation Alignmentcited by 74
- 2017Learning Cooperative Visual Dialog Agents with Deep Reinforcement Learningcited by 71
- 2021Semantics Disentangling for Generalized Zero-Shot Learningcited by 56
- 2023UATVR: Uncertainty-Adaptive Text-Video Retrievalcited by 55
- 2024A Survey on Deep Active Learning: Recent Advances and New Frontierscited by 54
- 2023Unified Coarse-to-Fine Alignment for Video-Text Retrievalcited by 49
- 2023Chatting Makes Perfect: Chat-based Image Retrievalcited by 25
- 2024Interactive Text-to-Image Retrieval with Large Language Models: A Plug-and-Play Approachcited by 25
- 2023Prototype-based Aleatoric Uncertainty Quantification for Cross-modal Retrievalcited by 23
- 2021Towards Diverse Paragraph Captioning for Untrimmed Videoscited by 22
- 2022Text-Adaptive Multiple Visual Prototype Matching for Video-Text Retrievalcited by 20
- 2022Tencent Text-Video Retrieval: Hierarchical Cross-Modal Interactions with Multi-Level Representationscited by 19
- 2022Learning to Retrieve Videos by Asking Questionscited by 18
- 2023Simple Baselines for Interactive Video Retrieval with Questions and Answerscited by 12
- 2024Towards Efficient and Effective Text-to-Video Retrieval with Coarse-to-Fine Visual Representation Learningcited by 12
- 2025Continual Text-to-Video Retrieval with Frame Fusion and Task-Aware Routingcited by 12
- 2021Ask&Confirm: Active Detail Enriching for Cross-Modal Retrieval with Partial Querycited by 9
- 2024MERLIN: Multimodal Embedding Refinement via LLM-based Iterative Navigation for Text-Video Retrieval-Rerank Pipelinecited by 9
- 2024TokenBinder: Text-Video Retrieval with One-to-Many Alignment Paradigmcited by 6
- 2025SVIP: Semantically Contextualized Visual Patches for Zero-Shot Learningcited by 6
- 2023Mask to reconstruct: Cooperative Semantics Completion for Video-text Retrievalcited by 5
- 2025Are Synthetic Videos Useful? A Benchmark for Retrieval-Centric Evaluation of Synthetic Videoscited by 5
- 2024Clarifying the Path to User Satisfaction: An Investigation into Clarification Usefulnesscited by 4
- 2019Granular Multimodal Attention Networks for Visual Dialogcited by 1
- 2023Dialogue-to-Video Retrievalcited by 1
- 2023Object Detection Difficulty: Suppressing Over-aggregation for Faster and Better Video Object Detectioncited by 1
Built on by
Citing papers per year: 2025: 1; 2026: 4.
5 papers.
- 2025When One Moment Isn't Enough: Multi-Moment Retrieval with Cross-Moment Interactionscited by 3
- 2026Imagine Before Concentration: Diffusion-Guided Registers Enhance Partially Relevant Video Retrievalcited by 3
- 2026ARGOS: Who, Where, and When in Agentic Multi-Camera Person Searchcited by 0
- 2026Robust Test-time Video-Text Retrieval: Benchmarking and Adapting for Query Shiftscited by 0
- 2026Understanding the Performance Plateau in Text-to-Video Retrieval: A Comprehensive Empirical and Linguistic Analysiscited by 0
- 2026ARGOS: Who, Where, and When in Agentic Multi-Camera Person Search14 Apr 2026
- 2026Imagine Before Concentration: Diffusion-Guided Registers Enhance Partially Relevant Video Retrieval4 Apr 2026
- 2026Understanding the Performance Plateau in Text-to-Video Retrieval: A Comprehensive Empirical and Linguistic Analysis7 Mar 2026
- 2026Robust Test-time Video-Text Retrieval: Benchmarking and Adapting for Query Shifts15 Feb 2026
- 2025When One Moment Isn't Enough: Multi-Moment Retrieval with Cross-Moment Interactions20 Oct 2025