mlsanityData to 13 Oct 2026

FR-Net:A Light-weight FFT Residual Net For Gaze Estimation

arXiv 2305.11875 ↗First posted 4 May 2023cs.CVcited by 3

Not on the map. Why?

Abstract (arXiv)

Gaze estimation is a crucial task in computer vision, however, existing methods suffer from high computational costs, which limit their practical deployment in resource-limited environments. In this paper, we propose a novel lightweight model, FR-Net, for accurate gaze angle estimation while significantly reducing computational complexity. FR-Net utilizes the Fast Fourier Transform (FFT) to extract gaze-relevant features in frequency domains while reducing the number of parameters. Additionally, we introduce a shortcut component that focuses on the spatial domain to further improve the accuracy of our model. Our experimental results demonstrate that our approach achieves substantially lower gaze error angles (3.86 on MPII and 4.51 on EYEDIAP) compared to state-of-the-art gaze estimation methods, while utilizing 17 times fewer parameters (0.67M) and only 12% of FLOPs (0.22B). Furthermore, our method outperforms existing lightweight methods in terms of accuracy and efficiency for the gaze estimation task. These results suggest that our proposed approach has significant potential applications in areas such as human-computer interaction and driver assistance systems.

Key facts. Cited by 3 papers in the map (data through 13 Oct 2026). Builds on 26 of its 39 references that are in the map. First posted on arXiv 4 May 2023.

Builds on

26 of 39 references.

References · 26

  1. 2018MobileNetV2: Inverted Residuals and Linear Bottleneckscited by 4,786
  2. 2020Training data-efficient image transformers & distillation through attentioncited by 4,574
  3. 2017MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applicationscited by 3,836
  4. 2016Xception: Deep Learning with Depthwise Separable Convolutionscited by 2,326
  5. 2017ShuffleNet: An Extremely Efficient Convolutional Neural Network for Mobile Devicescited by 1,199
  6. 2021Tokens-to-Token ViT: Training Vision Transformers from Scratch on ImageNetcited by 1,101
  7. 2021MobileViT: Light-weight, General-purpose, and Mobile-friendly Vision Transformercited by 639
  8. 2021LeViT: a Vision Transformer in ConvNet's Clothing for Faster Inferencecited by 475
  9. 2021Global Filter Networks for Image Classificationcited by 259
  10. 2019Gaze360: Physically Unconstrained Gaze Estimation in the Wildcited by 173
  11. 2022Separable Self-attention for Mobile Vision Transformerscited by 163
  12. 2016Eye Tracking for Everyonecited by 155
14 more
  1. 2020ETH-XGaze: A Large Scale Dataset for Gaze Estimation under Extreme Head Pose and Gaze Variationcited by 141
  2. 2016It's Written All Over Your Face: Full-Face Appearance-Based Gaze Estimationcited by 123
  3. 2017MPIIGaze: Real-World Dataset and Deep Appearance-Based Gaze Estimationcited by 118
  4. 2021Appearance-based Gaze Estimation With Deep Learning: A Review and Benchmarkcited by 82
  5. 2021Gaze Estimation using Transformercited by 68
  6. 2020A Coarse-to-Fine Adaptive Network for Appearance-Based Gaze Estimationcited by 66
  7. 2021PureGaze: Purifying Gaze Feature for Generalizable Gaze Estimationcited by 54
  8. 2018Salient Objects in Clutter: Bringing Salient Object Detection to the Foregroundcited by 47
  9. 2019Appearance-Based Gaze Estimation Using Dilated-Convolutionscited by 46
  10. 2022MobileViTv3: Mobile-Friendly Vision Transformer with Simple and Effective Fusion of Local, Global and Input Featurescited by 44
  11. 2019Improving Few-Shot User-Specific Gaze Adaptation via Gaze Redirection Synthesiscited by 43
  12. 2021Generalizing Gaze Estimation with Outlier-guided Collaborative Adaptationcited by 42
  13. 2018Dynamics of Driver's Gaze: Explorations in Behavior Modeling & Maneuver Predictioncited by 15
  14. 2017Tracking Gaze and Visual Focus of Attention of People Involved in Social Interactioncited by 11

Built on by

Cited by year

Citing papers per year: 2024: 3.

3 papers.