FLAME: Facial Landmark Heatmap Activated Multimodal Gaze Estimation
Not on the map. Why?
Abstract (arXiv)
3D gaze estimation is about predicting the line of sight of a person in 3D space. Person-independent models for the same lack precision due to anatomical differences of subjects, whereas person-specific calibrated techniques add strict constraints on scalability. To overcome these issues, we propose a novel technique, Facial Landmark Heatmap Activated Multimodal Gaze Estimation (FLAME), as a way of combining eye anatomical information using eye landmark heatmaps to obtain precise gaze estimation without any person-specific calibration. Our evaluation demonstrates a competitive performance of about 10% improvement on benchmark datasets ColumbiaGaze and EYEDIAP. We also conduct an ablation study to validate our method.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 16 of its 35 references that are in the map. First posted on arXiv 10 Oct 2021.
Builds on
16 of 35 references.
References · 16
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2021Revisiting Skeleton-based Action Recognitioncited by 256
- 2019Gaze360: Physically Unconstrained Gaze Estimation in the Wildcited by 173
- 2016Eye Tracking for Everyonecited by 155
- 2015Appearance-Based Gaze Estimation in the Wildcited by 153
- 2017MUTAN: Multimodal Tucker Fusion for Visual Question Answeringcited by 137
- 2019MMTM: Multimodal Transfer Module for CNN Fusioncited by 128
- 2016It's Written All Over Your Face: Full-Face Appearance-Based Gaze Estimationcited by 123
- 2017MPIIGaze: Real-World Dataset and Deep Appearance-Based Gaze Estimationcited by 118
- 2019Few-Shot Adaptive Gaze Estimationcited by 77
- 2021Gaze Estimation using Transformercited by 68
- 2020A Coarse-to-Fine Adaptive Network for Appearance-Based Gaze Estimationcited by 66
4 more
- 2019Appearance-Based Gaze Estimation Using Dilated-Convolutionscited by 46
- 2019Improving Few-Shot User-Specific Gaze Adaptation via Gaze Redirection Synthesiscited by 43
- 2019Unsupervised Representation Learning for Gaze Estimationcited by 42
- 2018Light-weight Head Pose Invariant Gaze Trackingcited by 14
Built on by
Citing papers per year: 2022: 2; 2023: 1; 2024: 1.
4 papers.
- 2022Bodily Behaviors in Social Interaction: Novel Annotations and State-of-the-Art Evaluationcited by 19
- 2024Learning Gaze-aware Compositional GANcited by 2
- 2022Multistream Gaze Estimation with Anatomical Eye Region Isolation by Synthetic to Real Transfer Learningcited by 1
- 2023Accurate Gaze Estimation using an Active-gaze Morphable Modelcited by 0
- 2024Learning Gaze-aware Compositional GAN31 May 2024
- 2023Accurate Gaze Estimation using an Active-gaze Morphable Model30 Jan 2023
- 2022Bodily Behaviors in Social Interaction: Novel Annotations and State-of-the-Art Evaluation26 Jul 2022
- 2022Multistream Gaze Estimation with Anatomical Eye Region Isolation by Synthetic to Real Transfer Learning18 Jun 2022