mlsanityData to 14 Oct 2026

ReLER@ZJU-Alibaba Submission to the Ego4D Natural Language Queries Challenge 2022

arXiv 2207.00383 ↗First posted 1 Jul 2022cs.CV cs.IRcited by 19

Not on the map. Why?

Abstract (arXiv)

In this report, we present the ReLER@ZJU-Alibaba submission to the Ego4D Natural Language Queries (NLQ) Challenge in CVPR 2022. Given a video clip and a text query, the goal of this challenge is to locate a temporal moment of the video clip where the answer to the query can be obtained. To tackle this task, we propose a multi-scale cross-modal transformer and a video frame-level contrastive loss to fully uncover the correlation between language queries and video clips. Besides, we propose two data augmentation strategies to increase the diversity of training samples. The experimental results demonstrate the effectiveness of our method. The final submission ranked first on the leaderboard.

Key facts. Cited by 19 papers in the map (data through 14 Oct 2026). Builds on 12 of its 13 references that are in the map. First posted on arXiv 1 Jul 2022.

Builds on

12 of 13 references.

References · 12

  1. 2017Attention Is All You Needcited by 60,361
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  3. 2018SlowFast Networks for Video Recognitioncited by 1,867
  4. 2021Ego4D: Around the World in 3,000 Hours of Egocentric Videocited by 1,556
  5. 2019Learning 2D Temporal Adjacent Networks for Moment Localization with Natural Languagecited by 285
  6. 2020Span-based Localizing Network for Natural Language Video Localizationcited by 235
  7. 2022Omnivore: A Single Model for Many Visual Modalitiescited by 215
  8. 2021T2VLAD: Global-Local Sequence Alignment for Text-Video Retrievalcited by 103
  9. 2022CenterCLIP: Token Clustering for Efficient Text-Video Retrievalcited by 86
  10. 2021QVHighlights: Detecting Moments and Highlights in Videos via Natural Language Queriescited by 72
  11. 2021Natural Language Video Localization: A Revisit in Span-based Question Answering Frameworkcited by 55
  12. 2020Multi-Scale 2D Temporal Adjacent Networks for Moment Localization with Natural Languagecited by 29

Built on by

Cited by year

Citing papers per year: 2022: 3; 2023: 10; 2024: 4; 2025: 2.

19 papers.

Sort:

By area:

  1. 2023Grounded Question-Answering in Long Egocentric Videoscited by 64
  2. 2023LifelongMemory: Leveraging LLMs for Answering Queries in Long-form Egocentric Videoscited by 51
  3. 2023NaQ: Leveraging Narrations as Queries to Supervise Episodic Memorycited by 46
  4. 2023Action Sensitivity Learning for Temporal Action Localizationcited by 28
  5. 2022EgoEnv: Human-centric environment representations from egocentric videocited by 22
  6. 2023GroundNLQ @ Ego4D Natural Language Queries Challenge 2023cited by 20
  7. 2024ReVisionLLM: Recursive Vision-Language Model for Temporal Grounding in Hour-Long Videoscited by 18
  8. 2023SpotEM: Efficient Video Search for Episodic Memorycited by 17
  9. 2023RGNet: A Unified Clip Retrieval and Grounding Network for Long Videoscited by 15
  10. 2024Online Episodic Memory Visual Query Localization with Egocentric Streaming Object Memorycited by 11
  11. 2025Object-Shot Enhanced Grounding Network for Egocentric Videocited by 11
  12. 2023Boundary-Denoising for Video Activity Localizationcited by 10
7 more
  1. 2024ObjectNLQ @ Ego4D Episodic Memory Challenge 2024cited by 10
  2. 2023Action Sensitivity Learning for the Ego4D Episodic Memory Challenge 2023cited by 7
  3. 2022A Simple Transformer-Based Model for Ego4D Natural Language Queries Challengecited by 6
  4. 2023MINOTAUR: Multi-task Video Grounding From Multimodal Queriescited by 6
  5. 2022An Efficient COarse-to-fiNE Alignment Framework @ Ego4D Natural Language Queries Challenge 2022cited by 4
  6. 2024MomentMix Augmentation with Length-Aware DETR for Temporally Robust Moment Retrievalcited by 1
  7. 2025GazeNLQ @ Ego4D Natural Language Queries Challenge 2025cited by 0