mlsanityData to 14 Oct 2026

Egocentric Video-Language Pretraining @ Ego4D Challenge 2022

arXiv 2207.01622 ↗First posted 4 Jul 2022cs.CVcited by 6

Not on the map. Why?

Abstract (arXiv)

In this report, we propose a video-language pretraining (VLP) based solution citekevin2022egovlp for four Ego4D challenge tasks, including Natural Language Query (NLQ), Moment Query (MQ), Object State Change Classification (OSCC), and PNR Localization (PNR). Especially, we exploit the recently released Ego4D dataset citegrauman2021ego4d to pioneer Egocentric VLP from pretraining dataset, pretraining objective, and development set. Based on the above three designs, we develop a pretrained video-language model that is able to transfer its egocentric video-text representation or video-only representation to several video downstream tasks. Our Egocentric VLP achieves 10.46R@1&IoU @0.3 on NLQ, 10.33 mAP on MQ, 74% Acc on OSCC, 0.67 sec error on PNR. The code is available at https://github.com/showlab/EgoVLP.

Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Builds on 11 of its 11 references that are in the map. First posted on arXiv 4 Jul 2022.

Builds on

11 of 11 references.

References · 11

  1. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  2. 2019DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lightercited by 4,307
  3. 2021Is Space-Time Attention All You Need for Video Understanding?cited by 1,620
  4. 2021Ego4D: Around the World in 3,000 Hours of Egocentric Videocited by 1,556
  5. 2021Frozen in Time: A Joint Video and Image Encoder for End-to-End Retrievalcited by 1,177
  6. 2019HowTo100M: Learning a Text-Video Embedding by Watching Hundred Million Narrated Video Clipscited by 950
  7. 2020Rescaling Egocentric Visioncited by 540
  8. 2019Learning 2D Temporal Adjacent Networks for Moment Localization with Natural Languagecited by 285
  9. 2020Span-based Localizing Network for Natural Language Video Localizationcited by 235
  10. 2022Egocentric Video-Language Pretrainingcited by 232
  11. 2020Video Self-Stitching Graph Network for Temporal Action Localizationcited by 104

Built on by

Cited by year

Citing papers per year: 2022: 2; 2023: 2; 2024: 1; 2025: 1.

6 papers.

  1. 2023LifelongMemory: Leveraging LLMs for Answering Queries in Long-form Egocentric Videoscited by 51
  2. 2022EgoEnv: Human-centric environment representations from egocentric videocited by 22
  3. 2023GroundNLQ @ Ego4D Natural Language Queries Challenge 2023cited by 20
  4. 2024ObjectNLQ @ Ego4D Episodic Memory Challenge 2024cited by 10
  5. 2025Diffusion-Based Action Recognition Generalizes to Untrained Domainscited by 2
  6. 2022Masked Autoencoders for Egocentric Video Understanding @ Ego4D Challenge 2022cited by 1