mlsanityData to 14 Oct 2026

EllSeg-Gen, towards Domain Generalization for head-mounted eyetracking

arXiv 2205.01947 ↗First posted 4 May 2022cs.CV cs.HC cs.ROcited by 6

Not on the map. Why?

Abstract (arXiv)

The study of human gaze behavior in natural contexts requires algorithms for gaze estimation that are robust to a wide range of imaging conditions. However, algorithms often fail to identify features such as the iris and pupil centroid in the presence of reflective artifacts and occlusions. Previous work has shown that convolutional networks excel at extracting gaze features despite the presence of such artifacts. However, these networks often perform poorly on data unseen during training. This work follows the intuition that jointly training a convolutional network with multiple datasets learns a generalized representation of eye parts. We compare the performance of a single model trained with multiple datasets against a pool of models trained on individual datasets. Results indicate that models tested on datasets in which eye images exhibit higher appearance variability benefit from multiset training. In contrast, dataset-specific models generalize better onto eye images with lower appearance variability.

Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Builds on 34 of its 67 references that are in the map. First posted on arXiv 4 May 2022.

Builds on

34 of 67 references.

References · 34

  1. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  2. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
  3. 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 7,005
  4. 2017Towards Deep Learning Models Resistant to Adversarial Attackscited by 6,415
  5. 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,897
  6. 2017What Uncertainties Do We Need in Bayesian Deep Learning for Computer Vision?cited by 2,352
  7. 2014Unsupervised Domain Adaptation by Backpropagationcited by 1,917
  8. 2019Theoretically Principled Trade-off between Robustness and Accuracycited by 1,517
  9. 2017Adversarial Discriminative Domain Adaptationcited by 1,311
  10. 2016Instance Normalization: The Missing Ingredient for Fast Stylizationcited by 1,198
  11. 2020In Search of Lost Domain Generalizationcited by 1,054
  12. 2017Deeper, Broader and Artier Domain Generalizationcited by 986
22 more
  1. 2017Learning to Generalize: Meta-Learning for Domain Generalizationcited by 763
  2. 2013Domain Generalization via Invariant Feature Representationcited by 623
  3. 2014Deep Domain Confusion: Maximizing for Domain Invariancecited by 600
  4. 2017The Effectiveness of Data Augmentation in Image Classification using Deep Learningcited by 370
  5. 2018How Does Batch Normalization Help Optimization?cited by 357
  6. 2015Domain Generalization for Object Recognition with Multi-task Autoencoderscited by 253
  7. 2019A review of domain adaptation without target labelscited by 156
  8. 2020Understanding and Mitigating the Tradeoff Between Robustness and Accuracycited by 149
  9. 2016The One Hundred Layers Tiramisu: Fully Convolutional DenseNets for Semantic Segmentationcited by 122
  10. 2018An introduction to domain adaptation and transfer learningcited by 112
  11. 2020Optimization for Medical Image Segmentation: Theory and Practice when evaluating with Dice Score or Jaccard Indexcited by 52
  12. 2018Deep Pictorial Gaze Estimationcited by 49
  13. 2014Pupil: An Open Source Platform for Pervasive Eye Tracking and Mobile Gaze-based Interactioncited by 43
  14. 2018Learning to Find Eye Region Landmarks for Remote Gaze Estimation in Unconstrained Settingscited by 38
  15. 2019RITnet: Real-time Semantic Segmentation of the Eye for Gaze Trackingcited by 33
  16. 2020EllSeg: An Ellipse Segmentation Framework for Robust Gaze Trackingcited by 24
  17. 2019Further advantages of data augmentation on convolutional neural networkscited by 19
  18. 2015Labeled pupils in the wild: A dataset for studying pupil detection in unconstrained environmentscited by 18
  19. 2015ElSe: Ellipse Selection for Robust Pupil Detection in Real-World Environmentscited by 16
  20. 2017PupilNet v2.0: Convolutional Neural Networks for CPU based real time Robust Pupil Detectioncited by 15
  21. 2020RIT-Eyes: Rendering of near-eye images for eye-tracking applicationscited by 10
  22. 2019Eyenet: Attention based Convolutional Encoder-Decoder Network for Eye Region Segmentationcited by 7

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2023: 2; 2024: 3; 2025: 0; 2026: 1.

6 papers.

  1. 2023Zero-Shot Segmentation of Eye Features Using the Segment Anything Model (SAM)cited by 7
  2. 2024Deep Domain Adaptation: A Sim2Real Neural Approach for Improving Eye-Tracking Systemscited by 6
  3. 2023LEyes: A Lightweight Framework for Deep Learning-Based Eye Tracking using Synthetic Eye Imagescited by 4
  4. 2024Zero-Shot Pupil Segmentation with SAM 2: A Case Study of Over 14 Million Imagescited by 2
  5. 2024Using Deep Learning to Increase Eye-Tracking Robustness, Accuracy, and Precision in Virtual Realitycited by 1
  6. 2026Enhancing Eye Feature Estimation from Event Data Streams through Adaptive Inference State Space Modelingcited by 0