Egocentric Gaze Estimation via Neck-Mounted Camera
Not on the map. Why?
Abstract (arXiv)
This paper introduces neck-mounted view gaze estimation, a new task that estimates user gaze from the neck-mounted camera perspective. Prior work on egocentric gaze estimation, which predicts device wearer's gaze location within the camera's field of view, mainly focuses on head-mounted cameras while alternative viewpoints remain underexplored. To bridge this gap, we collect the first dataset for this task, consisting of approximately 4 hours of video collected from 8 participants during everyday activities. We evaluate a transformer-based gaze estimation model, GLC, on the new dataset and propose two extensions: an auxiliary gaze out-of-bound classification task and a multi-view co-learning approach that jointly trains head-view and neck-view models using a geometry-aware auxiliary loss. Experimental results show that incorporating gaze out-of-bound classification improves performance over standard fine-tuning, while the co-learning approach does not yield gains. We further analyze these results and discuss implications for neck-mounted gaze estimation.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 15 of its 29 references that are in the map. First posted on arXiv 12 Feb 2026.
Builds on
15 of 29 references.
References · 15
- 2021Ego4D: Around the World in 3,000 Hours of Egocentric Videocited by 1,530
- 2023CoTracker: It is Better to Track Togethercited by 516
- 2022HOI4D: A 4D Egocentric Dataset for Category-Level Human-Object Interactioncited by 321
- 2023Project Aria: A New Tool for Egocentric Multi-Modal AI Researchcited by 201
- 2024Nymeria: A Massive Collection of Multimodal Egocentric Daily Motion in the Wildcited by 109
- 2017Real-time Hand Tracking under Occlusion from an Egocentric RGB-D Sensorcited by 84
- 2018Predicting Gaze in Egocentric Video by Learning Task-dependent Attention Transitioncited by 78
- 2023AssemblyHands: Towards Egocentric Activity Understanding via 3D Hand Pose Estimationcited by 64
- 2022In the Eye of Transformer: Global-Local Correlation for Egocentric Gaze Estimationcited by 51
- 2020Integrating Human Gaze into Attention for Egocentric Activity Recognitioncited by 42
- 2018Attention is All We Need: Nailing Down Object-centric Attention for Egocentric Activity Recognitioncited by 28
- 2025Challenges and Trends in Egocentric Vision: A Surveycited by 20
Built on by
Not cited yet.