mlsanityData to 14 Oct 2026

GazeNLQ @ Ego4D Natural Language Queries Challenge 2025

arXiv 2506.05782 ↗First posted 6 Jun 2025cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

This report presents our solution to the Ego4D Natural Language Queries (NLQ) Challenge at CVPR 2025. Egocentric video captures the scene from the wearer's perspective, where gaze serves as a key non-verbal communication cue that reflects visual attention and offer insights into human intention and cognition. Motivated by this, we propose a novel approach, GazeNLQ, which leverages gaze to retrieve video segments that match given natural language queries. Specifically, we introduce a contrastive learning-based pretraining strategy for gaze estimation directly from video. The estimated gaze is used to augment video representations within proposed model, thereby enhancing localization accuracy. Experimental results show that GazeNLQ achieves [email protected] and [email protected] scores of 27.82 and 18.68, respectively. Our code is available at https://github.com/stevenlin510/GazeNLQ.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 15 of its 15 references that are in the map. First posted on arXiv 6 Jun 2025.

Builds on

15 of 15 references.

References · 15

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2021Ego4D: Around the World in 3,000 Hours of Egocentric Videocited by 1,556
  3. 2017Soft-NMS -- Improving Object Detection With One Line of Codecited by 382
  4. 2022Egocentric Video-Language Pretrainingcited by 232
  5. 2022Omnivore: A Single Model for Many Visual Modalitiescited by 215
  6. 2023EgoVLPv2: Egocentric Video-Language Pre-training with Fusion in the Backbonecited by 130
  7. 2023Grounded Question-Answering in Long Egocentric Videoscited by 64
  8. 2022In the Eye of Transformer: Global-Local Correlation for Egocentric Gaze Estimationcited by 51
  9. 2022InternVideo-Ego4D: A Pack of Champion Solutions to Ego4D Challengescited by 48
  10. 2023NaQ: Leveraging Narrations as Queries to Supervise Episodic Memorycited by 46
  11. 2024EgoVideo: Exploring Egocentric Foundation Model and Downstream Adaptationcited by 44
  12. 2023EgoDistill: Egocentric Head Motion Distillation for Efficient Video Understandingcited by 32
3 more
  1. 2023GroundNLQ @ Ego4D Natural Language Queries Challenge 2023cited by 20
  2. 2022ReLER@ZJU-Alibaba Submission to the Ego4D Natural Language Queries Challenge 2022cited by 19
  3. 2024ObjectNLQ @ Ego4D Episodic Memory Challenge 2024cited by 10

Built on by

Not cited yet.