A CLIP-Enhanced Method for Video-Language Understanding
Not on the map. Why?
Abstract (arXiv)
This technical report summarizes our method for the Video-And-Language Understanding Evaluation (VALUE) challenge (https://value-benchmark.github.io/challenge2021.html). We propose a CLIP-Enhanced method to incorporate the image-text pretrained knowledge into downstream video-text tasks. Combined with several other improved designs, our method outperforms the state-of-the-art by 2.4% (57.58 to 60.00) Meta-Ave score on VALUE benchmark.
Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Builds on 13 of its 13 references that are in the map. First posted on arXiv 14 Oct 2021.
Builds on
13 of 13 references.
References · 13
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
- 2021Frozen in Time: A Joint Video and Image Encoder for End-to-End Retrievalcited by 1,175
- 2019HowTo100M: Learning a Text-Video Embedding by Watching Hundred Million Narrated Video Clipscited by 946
- 2019VideoBERT: A Joint Model for Video and Language Representation Learningcited by 702
- 2021CLIP4Clip: An Empirical Study of CLIP for End to End Video Clip Retrievalcited by 645
- 2021Less is More: ClipBERT for Video-and-Language Learning via Sparse Samplingcited by 484
- 2020HERO: Hierarchical Encoder for Video+Language Omni-representation Pre-trainingcited by 362
- 2020ActBERT: Learning Global-Local Video-Text Representationscited by 267
- 2020UniVL: A Unified Video and Language Pre-Training Model for Multimodal Understanding and Generationcited by 258
- 2021CLIP2Video: Mastering Video-Text Retrieval via Image CLIPcited by 223
- 2021VALUE: A Multi-Task Benchmark for Video-and-Language Understanding Evaluationcited by 95
1 more
- 2021A Straightforward Framework For Video Retrieval Using CLIPcited by 66
Built on by
Citing papers per year: 2022: 4; 2023: 1; 2024: 0; 2025: 1.
6 papers.
- 2022i-Code: An Integrative and Composable Multimodal Learning Frameworkcited by 24
- 2022Phone2Proc: Bringing Robust Robots Into Our Chaotic Worldcited by 24
- 2022Vote'n'Rank: Revision of Benchmarking with Social Choice Theorycited by 15
- 2023Multimodal Subtask Graph Generation from Instructional Videoscited by 13
- 2022Multi-Query Video Retrievalcited by 11
- 2025CLIP-Optimized Multimodal Image Enhancement via ISP-CNN Fusion for Coal Mine IoVT under Uneven Illuminationcited by 0
- 2025CLIP-Optimized Multimodal Image Enhancement via ISP-CNN Fusion for Coal Mine IoVT under Uneven Illumination26 Feb 2025
- 2023Multimodal Subtask Graph Generation from Instructional Videos17 Feb 2023
- 2022Phone2Proc: Bringing Robust Robots Into Our Chaotic World8 Dec 2022
- 2022Vote'n'Rank: Revision of Benchmarking with Social Choice Theory11 Oct 2022
- 2022i-Code: An Integrative and Composable Multimodal Learning Framework3 May 2022
- 2022Multi-Query Video Retrieval10 Jan 2022