mlsanityData to 14 Oct 2026

Lightweight Gaze Estimation Model Via Fusion Global Information

arXiv 2411.18064 ↗First posted 27 Nov 2024cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Deep learning-based appearance gaze estimation methods are gaining popularity due to their high accuracy and fewer constraints from the environment. However, existing high-precision models often rely on deeper networks, leading to problems such as large parameters, long training time, and slow convergence. In terms of this issue, this paper proposes a novel lightweight gaze estimation model FGI-Net(Fusion Global Information). The model fuses global information into the CNN, effectively compensating for the need of multi-layer convolution and pooling to indirectly capture global information, while reducing the complexity of the model, improving the model accuracy and convergence speed. To validate the performance of the model, a large number of experiments are conducted, comparing accuracy with existing classical models and lightweight models, comparing convergence speed with models of different architectures, and conducting ablation experiments. Experimental results show that compared with GazeCaps, the latest gaze estimation model, FGI-Net achieves a smaller angle error with 87.1% and 79.1% reduction in parameters and FLOPs, respectively (MPIIFaceGaze is 3.74deg, EyeDiap is 5.15deg, Gaze360 is 10.50deg and RT-Gene is 6.02deg). Moreover, compared with different architectural models such as CNN and Transformer, FGI-Net is able to quickly converge to a higher accuracy range with fewer iterations of training, when achieving optimal accuracy on the Gaze360 and EyeDiap datasets, the FGI-Net model has 25% and 37.5% fewer iterations of training compared to GazeTR, respectively.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 33 of its 47 references that are in the map. First posted on arXiv 27 Nov 2024.

Builds on

33 of 47 references.

References · 33

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  3. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  4. 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,364
  5. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
  6. 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,442
  7. 2018CBAM: Convolutional Block Attention Modulecited by 2,477
  8. 2016Xception: Deep Learning with Depthwise Separable Convolutionscited by 2,332
  9. 2017ShuffleNet: An Extremely Efficient Convolutional Neural Network for Mobile Devicescited by 1,200
  10. 2015Multi-Scale Context Aggregation by Dilated Convolutionscited by 1,133
  11. 2021Tokens-to-Token ViT: Training Vision Transformers from Scratch on ImageNetcited by 1,101
  12. 2016SqueezeNet: AlexNet-level accuracy with 50x fewer parameters and <0.5MB model sizecited by 1,060
21 more
  1. 2017Dynamic Routing Between Capsulescited by 689
  2. 2015Cyclical Learning Rates for Training Neural Networkscited by 629
  3. 2021LeViT: a Vision Transformer in ConvNet's Clothing for Faster Inferencecited by 475
  4. 2019Gaze360: Physically Unconstrained Gaze Estimation in the Wildcited by 174
  5. 2015Appearance-Based Gaze Estimation in the Wildcited by 153
  6. 2020ETH-XGaze: A Large Scale Dataset for Gaze Estimation under Extreme Head Pose and Gaze Variationcited by 141
  7. 2016It's Written All Over Your Face: Full-Face Appearance-Based Gaze Estimationcited by 123
  8. 2016Understanding and Improving Convolutional Neural Networks via Concatenated Rectified Linear Unitscited by 86
  9. 2021Gaze Estimation using Transformercited by 68
  10. 2020A Coarse-to-Fine Adaptive Network for Appearance-Based Gaze Estimationcited by 66
  11. 2022L2CS-Net: Fine-Grained Gaze Estimation in Unconstrained Environmentscited by 65
  12. 2021PureGaze: Purifying Gaze Feature for Generalizable Gaze Estimationcited by 54
  13. 2019Appearance-Based Gaze Estimation Using Dilated-Convolutionscited by 46
  14. 2022MobileViTv3: Mobile-Friendly Vision Transformer with Simple and Effective Fusion of Local, Global and Input Featurescited by 44
  15. 2022GazeOnce: Real-Time Multi-Person Gaze Estimationcited by 17
  16. 2023EFE: End-to-end Frame-to-Gaze Estimationcited by 11
  17. 2023Rotation-Constrained Cross-View Feature Fusion for Multi-View Appearance-based Gaze Estimationcited by 10
  18. 2022Towards Self-Supervised Gaze Estimationcited by 6
  19. 2022One Eye is All You Need: Lightweight Ensembles for Gaze Estimation with Single Encoderscited by 5
  20. 2023Toward Super-Resolution for Appearance-Based Gaze Estimationcited by 3
  21. 2023FR-Net:A Light-weight FFT Residual Net For Gaze Estimationcited by 3

Built on by

Not cited yet.