mlsanityData to 7 Oct 2026

Dual Encoding for Zero-Example Video Retrieval

arXiv 1809.06181 ↗First posted 17 Sep 2018cs.CVcited by 85

Not on the map. Why?

Abstract (arXiv)

This paper attacks the challenging problem of zero-example video retrieval. In such a retrieval paradigm, an end user searches for unlabeled videos by ad-hoc queries described in natural language text with no visual example provided. Given videos as sequences of frames and queries as sequences of words, an effective sequence-to-sequence cross-modal matching is required. The majority of existing methods are concept based, extracting relevant concepts from queries and videos and accordingly establishing associations between the two modalities. In contrast, this paper takes a concept-free approach, proposing a dual deep encoding network that encodes videos and queries into powerful dense representations of their own. Dual encoding is conceptually simple, practically effective and end-to-end. As experiments on three benchmarks, i.e. MSR-VTT, TRECVID 2016 and 2017 Ad-hoc Video Search show, the proposed solution establishes a new state-of-the-art for zero-example video retrieval.

Key facts. Cited by 85 papers in the map (data through 7 Oct 2026). First posted on arXiv 17 Sep 2018.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 25; 2022: 22; 2023: 14; 2024: 9; 2025: 12; 2026: 3.

85 papers.

Sort:

By area:

  1. 2022Socratic Models: Composing Zero-Shot Multimodal Reasoning with Languagecited by 513
  2. 2024Retrieval-Augmented Generation for AI-Generated Content: A Surveycited by 352
  3. 2022X-CLIP: End-to-End Multi-grained Contrastive Learning for Video-Text Retrievalcited by 279
  4. 2021CLIP2Video: Mastering Video-Text Retrieval via Image CLIPcited by 223
  5. 2022TS2-Net: Token Shift and Selection Transformer for Text-Video Retrievalcited by 104
  6. 2021T2VLAD: Global-Local Sequence Alignment for Text-Video Retrievalcited by 103
  7. 2021TACo: Token-aware Cascade Contrastive Learning for Video-Text Alignmentcited by 102
  8. 2021Thinking Fast and Slow: Efficient Text-to-Visual Retrieval with Transformerscited by 93
  9. 2021HiT: Hierarchical Transformer with Momentum Contrast for Video-Text Retrievalcited by 87
  10. 2022Temporal Alignment Networks for Long-term Videocited by 84
  11. 2021MDMMT: Multidomain Multimodal Transformer for Video Retrievalcited by 78
  12. 2021CrossCLR: Cross-modal Contrastive Learning For Multi-modal Video Representationscited by 72
38 more
  1. 2021A Straightforward Framework For Video Retrieval Using CLIPcited by 66
  2. 2021Video Corpus Moment Retrieval with Contrastive Learningcited by 60
  3. 2021Efficient Video Transformers with Spatial-Temporal Token Selectioncited by 58
  4. 2021Open-book Video Captioning with Retrieve-Copy-Generate Networkcited by 43
  5. 2021Adaptive Proposal Generation Network for Temporal Sentence Localization in Videoscited by 42
  6. 2021Multilingual Multimodal Pre-training for Zero-Shot Cross-Lingual Transfer of Vision-Language Modelscited by 41
  7. 2022Look for the Change: Learning Object States and State-Modifying Actions from Untrimmed Web Videoscited by 39
  8. 2022Reading-strategy Inspired Visual Representation Learning for Text-to-Video Retrievalcited by 34
  9. 2021CONQUER: Contextual Query-aware Ranking for Video Corpus Moment Retrievalcited by 33
  10. 2021HANet: Hierarchical Alignment Networks for Video-Text Retrievalcited by 31
  11. 2023Zero-shot Composed Text-Image Retrievalcited by 31
  12. 2023A Review of Deep Learning for Video Captioningcited by 28
  13. 2021Relation-aware Video Reading Comprehension for Temporal Language Groundingcited by 27
  14. 2022Cross-Lingual Cross-Modal Retrieval with Noise-Robust Learningcited by 22
  15. 2023Cross-modal Active Complementary Learning with Self-refining Correspondencecited by 22
  16. 2023GMMFormer: Gaussian-Mixture-Model Based Transformer for Efficient Partially Relevant Video Retrievalcited by 20
  17. 2023Rethinking the Video Sampling and Reasoning Strategies for Temporal Sentence Groundingcited by 19
  18. 2022Localized Vision-Language Matching for Open-vocabulary Object Detectioncited by 17
  19. 2025Towards Efficient Partially Relevant Video Retrieval with Active Moment Discoveringcited by 17
  20. 2025HLFormer: Enhancing Partially Relevant Video Retrieval with Hyperbolic Learningcited by 17
  21. 2022Video Question Answering with Iterative Video-Text Co-Tokenizationcited by 16
  22. 2023Vision-Language Models can Identify Distracted Driver Behavior from Naturalistic Videoscited by 16
  23. 2023Deep Learning for Video-Text Retrieval: a Reviewcited by 15
  24. 2021Induce, Edit, Retrieve: Language Grounded Multimodal Schema for Instructional Video Retrievalcited by 13
  25. 2021Fine-Grained Fashion Similarity Prediction by Attribute-Specific Embedding Learningcited by 12
  26. 2021Connecting Language and Vision for Natural Language-Based Vehicle Retrievalcited by 12
  27. 2022RoME: Role-aware Mixture-of-Expert Transformer for Text-to-Video Retrievalcited by 11
  28. 2021Video and Text Matching with Conditioned Embeddingscited by 10
  29. 2022MDMMT-2: Multidomain Multimodal Transformer for Video Retrieval, One More Step Towards Generalizationcited by 10
  30. 2023Efficient Token-Guided Image-Text Retrieval with Consistent Multimodal Contrastive Trainingcited by 10
  31. 2023CL2CM: Improving Cross-Lingual Cross-Modal Retrieval via Cross-Lingual Knowledge Transfercited by 10
  32. 2023Gaussian Mixture Proposals with Pull-Push Learning Scheme to Capture Diverse Events for Weakly Supervised Temporal Video Groundingcited by 10
  33. 2021BiC-Net: Learning Efficient Spatio-Temporal Relation for Text-Video Retrievalcited by 8
  34. 2022Hybrid Contrastive Quantization for Efficient Cross-View Video Retrievalcited by 8
  35. 2023Learning Action Changes by Measuring Verb-Adverb Textual Relationshipscited by 8
  36. 2025Prototypes are Balanced Units for Efficient and Effective Partially Relevant Video Retrievalcited by 8
  37. 2022PRVR: Partially Relevant Video Retrievalcited by 7
  38. 2023Video-Text Retrieval by Supervised Sparse Multi-Grained Learningcited by 7

50 most cited of 85 All 85 (JSON)