mlsanityData to 14 Oct 2026

Quantifying and Narrowing the Unknown: Interactive Text-to-Video Retrieval via Uncertainty Minimization

arXiv 2507.15504 ↗First posted 21 Jul 2025cs.CVcited by 5

Not on the map. Why?

Abstract (arXiv)

Despite recent advances, Text-to-video retrieval (TVR) is still hindered by multiple inherent uncertainties, such as ambiguous textual queries, indistinct text-video mappings, and low-quality video frames. Although interactive systems have emerged to address these challenges by refining user intent through clarifying questions, current methods typically rely on heuristic or ad-hoc strategies without explicitly quantifying these uncertainties, limiting their effectiveness. Motivated by this gap, we propose UMIVR, an Uncertainty-Minimizing Interactive Text-to-Video Retrieval framework that explicitly quantifies three critical uncertainties-text ambiguity, mapping uncertainty, and frame uncertainty-via principled, training-free metrics: semantic entropy-based Text Ambiguity Score (TAS), Jensen-Shannon divergence-based Mapping Uncertainty Score (MUS), and a Temporal Quality-based Frame Sampler (TQFS). By adaptively generating targeted clarifying questions guided by these uncertainty measures, UMIVR iteratively refines user queries, significantly reducing retrieval ambiguity. Extensive experiments on multiple benchmarks validate UMIVR's effectiveness, achieving notable gains in Recall@1 (69.2% after 10 interactive rounds) on the MSR-VTT-1k dataset, thereby establishing an uncertainty-minimizing foundation for interactive TVR.

Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Builds on 48 of its 64 references that are in the map. First posted on arXiv 21 Jul 2025.

Builds on

48 of 64 references.

References · 48

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2014Microsoft COCO: Common Objects in Contextcited by 17,608
  3. 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,893
  4. 2024GPT-4o System Cardcited by 4,588
  5. 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,322
  6. 2021Multitask Prompted Training Enables Zero-Shot Task Generalizationcited by 1,470
  7. 2023Video-LLaVA: Learning United Visual Representation by Alignment Before Projectioncited by 1,402
  8. 2019Aleatoric and Epistemic Uncertainty in Machine Learning: An Introduction to Concepts and Methodscited by 913
  9. 2023Semantic Uncertainty: Linguistic Invariances for Uncertainty Estimation in Natural Language Generationcited by 819
  10. 2021CLIP4Clip: An Empirical Study of CLIP for End to End Video Clip Retrievalcited by 651
  11. 2020Multi-modal Transformer for Video Retrievalcited by 395
  12. 2023LanguageBind: Extending Video-Language Pretraining to N-modality by Language-based Semantic Alignmentcited by 370
36 more
  1. 2022X-CLIP: End-to-End Multi-grained Contrastive Learning for Video-Text Retrievalcited by 280
  2. 2019Use What You Have: Video Retrieval Using Representations From Collaborative Expertscited by 214
  3. 2017Flow-Guided Feature Aggregation for Video Object Detectioncited by 177
  4. 2020Support-set bottlenecks for video-text representation learningcited by 170
  5. 2022X-Pool: Cross-Modal Language-Video Attention for Text-Video Retrievalcited by 128
  6. 2019Audio-Visual Scene-Aware Dialogcited by 123
  7. 2022TS2-Net: Token Shift and Selection Transformer for Text-Video Retrievalcited by 104
  8. 2018Cross-Modal and Hierarchical Modeling of Video and Textcited by 103
  9. 2022CenterCLIP: Token Clustering for Efficient Text-Video Retrievalcited by 86
  10. 2021TEACHTEXT: CrossModal Generalized Distillation for Text-Video Retrievalcited by 81
  11. 2022CLIP-ViP: Adapting Pre-trained Image-Text Model to Video-Language Representation Alignmentcited by 74
  12. 2017Learning Cooperative Visual Dialog Agents with Deep Reinforcement Learningcited by 71
  13. 2021Semantics Disentangling for Generalized Zero-Shot Learningcited by 56
  14. 2023UATVR: Uncertainty-Adaptive Text-Video Retrievalcited by 55
  15. 2024A Survey on Deep Active Learning: Recent Advances and New Frontierscited by 54
  16. 2023Unified Coarse-to-Fine Alignment for Video-Text Retrievalcited by 49
  17. 2023Chatting Makes Perfect: Chat-based Image Retrievalcited by 25
  18. 2024Interactive Text-to-Image Retrieval with Large Language Models: A Plug-and-Play Approachcited by 25
  19. 2023Prototype-based Aleatoric Uncertainty Quantification for Cross-modal Retrievalcited by 23
  20. 2021Towards Diverse Paragraph Captioning for Untrimmed Videoscited by 22
  21. 2022Text-Adaptive Multiple Visual Prototype Matching for Video-Text Retrievalcited by 20
  22. 2022Tencent Text-Video Retrieval: Hierarchical Cross-Modal Interactions with Multi-Level Representationscited by 19
  23. 2022Learning to Retrieve Videos by Asking Questionscited by 18
  24. 2023Simple Baselines for Interactive Video Retrieval with Questions and Answerscited by 12
  25. 2024Towards Efficient and Effective Text-to-Video Retrieval with Coarse-to-Fine Visual Representation Learningcited by 12
  26. 2025Continual Text-to-Video Retrieval with Frame Fusion and Task-Aware Routingcited by 12
  27. 2021Ask&Confirm: Active Detail Enriching for Cross-Modal Retrieval with Partial Querycited by 9
  28. 2024MERLIN: Multimodal Embedding Refinement via LLM-based Iterative Navigation for Text-Video Retrieval-Rerank Pipelinecited by 9
  29. 2024TokenBinder: Text-Video Retrieval with One-to-Many Alignment Paradigmcited by 6
  30. 2025SVIP: Semantically Contextualized Visual Patches for Zero-Shot Learningcited by 6
  31. 2023Mask to reconstruct: Cooperative Semantics Completion for Video-text Retrievalcited by 5
  32. 2025Are Synthetic Videos Useful? A Benchmark for Retrieval-Centric Evaluation of Synthetic Videoscited by 5
  33. 2024Clarifying the Path to User Satisfaction: An Investigation into Clarification Usefulnesscited by 4
  34. 2019Granular Multimodal Attention Networks for Visual Dialogcited by 1
  35. 2023Dialogue-to-Video Retrievalcited by 1
  36. 2023Object Detection Difficulty: Suppressing Over-aggregation for Faster and Better Video Object Detectioncited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 4.

5 papers.