GazeNLQ @ Ego4D Natural Language Queries Challenge 2025
Not on the map. Why?
Abstract (arXiv)
This report presents our solution to the Ego4D Natural Language Queries (NLQ) Challenge at CVPR 2025. Egocentric video captures the scene from the wearer's perspective, where gaze serves as a key non-verbal communication cue that reflects visual attention and offer insights into human intention and cognition. Motivated by this, we propose a novel approach, GazeNLQ, which leverages gaze to retrieve video segments that match given natural language queries. Specifically, we introduce a contrastive learning-based pretraining strategy for gaze estimation directly from video. The estimated gaze is used to augment video representations within proposed model, thereby enhancing localization accuracy. Experimental results show that GazeNLQ achieves [email protected] and [email protected] scores of 27.82 and 18.68, respectively. Our code is available at https://github.com/stevenlin510/GazeNLQ.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 15 of its 15 references that are in the map. First posted on arXiv 6 Jun 2025.
Builds on
15 of 15 references.
References · 15
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2021Ego4D: Around the World in 3,000 Hours of Egocentric Videocited by 1,556
- 2017Soft-NMS -- Improving Object Detection With One Line of Codecited by 382
- 2022Egocentric Video-Language Pretrainingcited by 232
- 2022Omnivore: A Single Model for Many Visual Modalitiescited by 215
- 2023EgoVLPv2: Egocentric Video-Language Pre-training with Fusion in the Backbonecited by 130
- 2023Grounded Question-Answering in Long Egocentric Videoscited by 64
- 2022In the Eye of Transformer: Global-Local Correlation for Egocentric Gaze Estimationcited by 51
- 2022InternVideo-Ego4D: A Pack of Champion Solutions to Ego4D Challengescited by 48
- 2023NaQ: Leveraging Narrations as Queries to Supervise Episodic Memorycited by 46
- 2024EgoVideo: Exploring Egocentric Foundation Model and Downstream Adaptationcited by 44
- 2023EgoDistill: Egocentric Head Motion Distillation for Efficient Video Understandingcited by 32
3 more
Built on by
Not cited yet.