mlsanityData to 14 Oct 2026

A Straightforward Framework For Video Retrieval Using CLIP

arXiv 2102.12443 ↗First posted 24 Feb 2021cs.CVcited by 66

Not on the map. Why?

Abstract (arXiv)

Video Retrieval is a challenging task where a text query is matched to a video or vice versa. Most of the existing approaches for addressing such a problem rely on annotations made by the users. Although simple, this approach is not always feasible in practice. In this work, we explore the application of the language-image model, CLIP, to obtain video representations without the need for said annotations. This model was explicitly trained to learn a common space where images and text can be compared. Using various techniques described in this document, we extended its application to videos, obtaining state-of-the-art results on the MSR-VTT and MSVD benchmarks.

Key facts. Cited by 66 papers in the map (data through 14 Oct 2026). Builds on 14 of its 21 references that are in the map. First posted on arXiv 24 Feb 2021.

Builds on

14 of 21 references.

References · 14

  1. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
  2. 2019HowTo100M: Learning a Text-Video Embedding by Watching Hundred Million Narrated Video Clipscited by 950
  3. 2019VideoBERT: A Joint Model for Video and Language Representation Learningcited by 703
  4. 2019End-to-End Learning of Visual Representations from Uncurated Instructional Videoscited by 507
  5. 2020Multi-modal Transformer for Video Retrievalcited by 395
  6. 2019Use What You Have: Video Retrieval Using Representations From Collaborative Expertscited by 214
  7. 2018A Joint Sequence Fusion Model for Video Question Answering and Retrievalcited by 208
  8. 2015A Dataset for Movie Descriptioncited by 195
  9. 2020Support-set bottlenecks for video-text representation learningcited by 170
  10. 2020AVLnet: Learning Audio-Visual Language Representations from Instructional Videoscited by 111
  11. 2018Learning a Text-Video Embedding from Incomplete and Heterogeneous Datacited by 103
  12. 2018Dual Encoding for Zero-Example Video Retrievalcited by 85
2 more
  1. 2017Predicting Visual Features from Text for Image and Video Caption Retrievalcited by 53
  2. 2019Hierarchical Video Frame Sequence Representation with Deep Convolutional Graph Networkcited by 6

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2021: 13; 2022: 18; 2023: 21; 2024: 6; 2025: 5; 2026: 3.

66 papers.

Sort:

By area:

  1. 2022CoCa: Contrastive Captioners are Image-Text Foundation Modelscited by 1,274
  2. 2021CLIP4Clip: An Empirical Study of CLIP for End to End Video Clip Retrievalcited by 651
  3. 2021VideoCLIP: Contrastive Pre-training for Zero-shot Video-Text Understandingcited by 602
  4. 2022Socratic Models: Composing Zero-Shot Multimodal Reasoning with Languagecited by 513
  5. 2023LanguageBind: Extending Video-Language Pretraining to N-modality by Language-based Semantic Alignmentcited by 370
  6. 2022X-CLIP: End-to-End Multi-grained Contrastive Learning for Video-Text Retrievalcited by 280
  7. 2021CLIP2Video: Mastering Video-Text Retrieval via Image CLIPcited by 225
  8. 2021Simple but Effective: CLIP Embeddings for Embodied AIcited by 191
  9. 2021Evaluating CLIP: Towards Characterization of Broader Capabilities and Downstream Implicationscited by 128
  10. 2022X-Pool: Cross-Modal Language-Video Attention for Text-Video Retrievalcited by 128
  11. 2022Bridging Video-text Retrieval with Multiple Choice Questionscited by 79
  12. 2021MDMMT: Multidomain Multimodal Transformer for Video Retrievalcited by 78
38 more
  1. 2022Disentangled Representation Learning for Text-Video Retrievalcited by 77
  2. 2023Verbs in Action: Improving verb understanding in video-language modelscited by 76
  3. 2021CrossCLR: Cross-modal Contrastive Learning For Multi-modal Video Representationscited by 72
  4. 2022VideoCoCa: Video-Text Modeling with Zero-Shot Transfer from Contrastive Captionerscited by 70
  5. 2023UATVR: Uncertainty-Adaptive Text-Video Retrievalcited by 55
  6. 2023Open-VCLIP: Transforming CLIP to an Open-vocabulary Video Model via Interpolated Weight Optimizationcited by 55
  7. 2023Unified Coarse-to-Fine Alignment for Video-Text Retrievalcited by 49
  8. 2022ECLIPSE: Efficient Long-range Video Retrieval using Sight and Soundcited by 39
  9. 2021EMScore: Evaluating Video Captioning via Coarse-Grained and Fine-Grained Embedding Matchingcited by 36
  10. 2023HowToCaption: Prompting LLMs to Transform Video Annotations at Scalecited by 34
  11. 2024Text Is MASS: Modeling as Stochastic Embedding for Text-Video Retrievalcited by 33
  12. 2022Geodesic Multi-Modal Mixup for Robust Fine-Tuningcited by 29
  13. 2022MILES: Visual BERT Pre-training with Injected Language Semantics for Video-text Retrievalcited by 29
  14. 2022I Can't Believe There's No Images! Learning Visual Tasks Using only Language Supervisioncited by 26
  15. 2021Masking Modalities for Cross-modal Video Retrievalcited by 23
  16. 2021Lightweight Attentional Feature Fusion: A New Baseline for Text-to-Video Retrievalcited by 23
  17. 2023Prototype-based Aleatoric Uncertainty Quantification for Cross-modal Retrievalcited by 23
  18. 2023Building an Open-Vocabulary Video CLIP Model with Better Architectures, Optimization and Datacited by 22
  19. 2021Video-Text Pre-training with Learned Regionscited by 20
  20. 2022GEB+: A Benchmark for Generic Event Boundary Captioning, Grounding and Retrievalcited by 19
  21. 2022Tencent Text-Video Retrieval: Hierarchical Cross-Modal Interactions with Multi-Level Representationscited by 19
  22. 2023Tagging before Alignment: Integrating Multi-Modal Tags for Video-Text Retrievalcited by 18
  23. 2023Accommodating Audio Modality in CLIP for Multimodal Processingcited by 18
  24. 2022FitCLIP: Refining Large-Scale Pretrained Image-Text Models for Zero-Shot Video Understanding Taskscited by 16
  25. 2023Multi-event Video-Text Retrievalcited by 15
  26. 2023TVTSv2: Learning Out-of-the-box Spatiotemporal Visual Representations at Scalecited by 14
  27. 2021Induce, Edit, Retrieve: Language Grounded Multimodal Schema for Instructional Video Retrievalcited by 13
  28. 2022Multi-Query Video Retrievalcited by 11
  29. 2022MDMMT-2: Multidomain Multimodal Transformer for Video Retrieval, One More Step Towards Generalizationcited by 10
  30. 2022Boosting Video-Text Retrieval with Explicit High-Level Semanticscited by 8
  31. 2021A CLIP-Enhanced Method for Video-Language Understandingcited by 6
  32. 2024TokenBinder: Text-Video Retrieval with One-to-Many Alignment Paradigmcited by 6
  33. 2023Mask to reconstruct: Cooperative Semantics Completion for Video-text Retrievalcited by 5
  34. 2023In-Style: Bridging Text and Uncurated Videos with Style Transfer for Text-Video Retrievalcited by 5
  35. 2023Videoprompter: an ensemble of foundational models for zero-shot video understandingcited by 5
  36. 2024Bridging Information Asymmetry in Text-video Retrieval: A Data-centric Approachcited by 5
  37. 2023MSVD-Indonesian: A Benchmark for Multimodal Video-Text Tasks in Indonesiancited by 3
  38. 2023Mug-STAN: Adapting Image-Language Pretrained Models for General Video Understandingcited by 3

50 most cited of 66 All 66 (JSON)