TinyGaze: Lightweight Gaze-Gesture Recognition on Commodity Mobile Devices
Not on the map. Why?
Abstract (arXiv)
Gaze gestures can provide hands free input on mobile devices, but practical use requires (i) gestures users can learn and recall and (ii) recognition models that are efficient enough for on-device deployment. We present an end-to-end pipeline using commodity ARKit head/eye transforms and a scaffolded guidance-to-recall protocol grounded in learning theory. In a pilot feasibility study (N=4 participants; 240 trials; controlled single-session setting), we benchmark a compact time-series model (TinyHAR) against deeper baselines (DeepConvLSTM, SA-HAR) on 5-way gesture recognition and 4-way user identification. TinyHAR achieves strong performance in this pilot benchmark (Macro F1 = 0.960 for gesture recognition; Macro F1 = 0.997 for user identification) while using only 46k parameters. A modality analysis further indicates that head pose dynamics are highly informative for mobile gaze gestures, highlighting embodied head--eye coordination as a key design consideration. Although the small sample size and controlled setting limit generalizability, these results indicate a potential direction for further investigation into on-device gaze gesture recognition.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 9 of its 31 references that are in the map. First posted on arXiv 30 Mar 2026.
Builds on
9 of 31 references.
References · 9
- 2020Human Activity Recognition from Wearable Sensor Data Using Self-Attentioncited by 25
- 2018Recurrent CNN for 3D Gaze Estimation using Appearance and Shape Cuescited by 21
- 2023An End-to-End Review of Gaze Estimation and its Interactive Applications on Handheld Mobile Devicescited by 13
- 2025Quantifying the Impact of Motion on 2D Gaze Estimation in Real-World Mobile Interactionscited by 6
- 2023DynamicRead: Exploring Robust Gaze Interaction Methods for Reading on Handheld Mobile Devices under Dynamic Conditionscited by 5
- 2025HOIGaze: Gaze Estimation During Hand-Object Interactions in Extended Reality Exploiting Eye-Hand-Head Coordinationcited by 3
- 2025MAC-Gaze: Motion-Aware Continual Calibration for Mobile Gaze Trackingcited by 3
- 2025Identity Deepfake Threats to Biometric Authentication Systems: Public and Expert Perspectivescited by 3
- 2026The People's Gaze: Co-Designing and Refining Gaze Gestures with General Users and Gaze Interaction Expertscited by 2
Built on by
Citing papers per year: 2026: 1.
1 paper.
- 2026Factor-Informed Uncertainty Distillation for Gaze Estimation22 Jul 2026