EllSeg: An Ellipse Segmentation Framework for Robust Gaze Tracking
Not on the map. Why?
Abstract (arXiv)
Ellipse fitting, an essential component in pupil or iris tracking based video oculography, is performed on previously segmented eye parts generated using various computer vision techniques. Several factors, such as occlusions due to eyelid shape, camera position or eyelashes, frequently break ellipse fitting algorithms that rely on well-defined pupil or iris edge segments. In this work, we propose training a convolutional neural network to directly segment entire elliptical structures and demonstrate that such a framework is robust to occlusions and offers superior pupil and iris tracking performance (at least 10% and 24% increase in pupil and iris center detection rate respectively within a two-pixel error margin) compared to using standard eye parts segmentation for multiple publicly available synthetic segmentation datasets.
Key facts. Cited by 24 papers in the map (data through 7 Oct 2026). First posted on arXiv 19 Jul 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 3; 2022: 1; 2023: 7; 2024: 8; 2025: 1; 2026: 4.
24 papers.
Sort:
- 2023Eye-tracked Virtual Reality: A Comprehensive Survey on Methods and Privacy Challengescited by 12
- 2021A Multimodal Eye Movement Dataset and a Multimodal Eye Movement Segmentation Analysiscited by 7
- 20211000 Pupil Segmentations in a Second using Haar Like Features and Statistical Learningcited by 7
- 2023Zero-Shot Segmentation of Eye Features Using the Segment Anything Model (SAM)cited by 7
- 2022EllSeg-Gen, towards Domain Generalization for head-mounted eyetrackingcited by 6
- 2024Deep Domain Adaptation: A Sim2Real Neural Approach for Improving Eye-Tracking Systemscited by 6
- 2023Seeing the World through Your Eyescited by 5
- 2023LEyes: A Lightweight Framework for Deep Learning-Based Eye Tracking using Synthetic Eye Imagescited by 4
- 2021Semi-Supervised Learning for Eye Image Segmentationcited by 3
- 2024CondSeg: Ellipse Estimation of Pupil and Iris via Conditioned Segmentationcited by 2
- 2024EyeTrAES: Fine-grained, Low-Latency Eye Tracking via Adaptive Event Slicingcited by 2
- 2024Towards Unsupervised Eye-Region Segmentation for Eye Trackingcited by 2
12 more
- 2024Using Deep Learning to Increase Eye-Tracking Robustness, Accuracy, and Precision in Virtual Realitycited by 1
- 2024A Bayesian Approach Toward Robust Multidimensional Ellipsoid-Specific Fittingcited by 1
- 2024FovealNet: Advancing AI-Driven Gaze Tracking Solutions for Optimized Foveated Rendering System Performance in Virtual Realitycited by 1
- 2023An Embedded and Real-Time Pupil Detection Pipelinecited by 0
- 2023Robust Ellipsoid Fitting Using Axial Distance and Combinationcited by 0
- 2023DeepMetricEye: Metric Depth Estimation in Periocular VR Imagerycited by 0
- 2024Normalized Validity Scores for DNNs in Regression based Eye Feature Extractioncited by 0
- 2025EyeSeg: An Uncertainty-Aware Eye Segmentation Framework for AR/VRcited by 0
- 2026Enhancing Eye Feature Estimation from Event Data Streams through Adaptive Inference State Space Modelingcited by 0
- 2026Eye image segmentation using visual and concept prompts with Segment Anything Model 3 (SAM3)cited by 0
- 2026AmbientEye: A Dataset for Pupil Segmentation under Natural Ambient Infrared Illuminationcited by 0
- 2026Event-Based Motion Estimation via Oriented Distance Fieldscited by 0
- 2026Event-Based Motion Estimation via Oriented Distance Fields25 Aug 2026
- 2026AmbientEye: A Dataset for Pupil Segmentation under Natural Ambient Infrared Illumination2 Jun 2026
- 2026Eye image segmentation using visual and concept prompts with Segment Anything Model 3 (SAM3)18 Mar 2026
- 2026Enhancing Eye Feature Estimation from Event Data Streams through Adaptive Inference State Space Modeling14 Mar 2026
- 2025EyeSeg: An Uncertainty-Aware Eye Segmentation Framework for AR/VR13 Jul 2025
- 2024FovealNet: Advancing AI-Driven Gaze Tracking Solutions for Optimized Foveated Rendering System Performance in Virtual Reality12 Dec 2024
- 2024Towards Unsupervised Eye-Region Segmentation for Eye Tracking8 Oct 2024
- 2024EyeTrAES: Fine-grained, Low-Latency Eye Tracking via Adaptive Event Slicing27 Sep 2024
- 2024CondSeg: Ellipse Estimation of Pupil and Iris via Conditioned Segmentation30 Aug 2024
- 2024A Bayesian Approach Toward Robust Multidimensional Ellipsoid-Specific Fitting27 Jul 2024
- 2024Using Deep Learning to Increase Eye-Tracking Robustness, Accuracy, and Precision in Virtual Reality28 Mar 2024
- 2024Deep Domain Adaptation: A Sim2Real Neural Approach for Improving Eye-Tracking Systems23 Mar 2024
12 more
- 2024Normalized Validity Scores for DNNs in Regression based Eye Feature Extraction18 Mar 2024
- 2023Zero-Shot Segmentation of Eye Features Using the Segment Anything Model (SAM)14 Nov 2023
- 2023DeepMetricEye: Metric Depth Estimation in Periocular VR Imagery13 Nov 2023
- 2023LEyes: A Lightweight Framework for Deep Learning-Based Eye Tracking using Synthetic Eye Images12 Sep 2023
- 2023Seeing the World through Your Eyes15 Jun 2023
- 2023Eye-tracked Virtual Reality: A Comprehensive Survey on Methods and Privacy Challenges23 May 2023
- 2023Robust Ellipsoid Fitting Using Axial Distance and Combination2 Apr 2023
- 2023An Embedded and Real-Time Pupil Detection Pipeline27 Feb 2023
- 2022EllSeg-Gen, towards Domain Generalization for head-mounted eyetracking4 May 2022
- 2021Semi-Supervised Learning for Eye Image Segmentation17 Mar 2021
- 20211000 Pupil Segmentations in a Second using Haar Like Features and Statistical Learning3 Feb 2021
- 2021A Multimodal Eye Movement Dataset and a Multimodal Eye Movement Segmentation Analysis12 Jan 2021
- 2023Eye-tracked Virtual Reality: A Comprehensive Survey on Methods and Privacy Challengescited by 12
- 2021A Multimodal Eye Movement Dataset and a Multimodal Eye Movement Segmentation Analysiscited by 7
- 20211000 Pupil Segmentations in a Second using Haar Like Features and Statistical Learningcited by 7
- 2023Zero-Shot Segmentation of Eye Features Using the Segment Anything Model (SAM)cited by 7
- 2022EllSeg-Gen, towards Domain Generalization for head-mounted eyetrackingcited by 6
- 2024Deep Domain Adaptation: A Sim2Real Neural Approach for Improving Eye-Tracking Systemscited by 6
- 2023Seeing the World through Your Eyescited by 5
- 2023LEyes: A Lightweight Framework for Deep Learning-Based Eye Tracking using Synthetic Eye Imagescited by 4
- 2021Semi-Supervised Learning for Eye Image Segmentationcited by 3
- 2024CondSeg: Ellipse Estimation of Pupil and Iris via Conditioned Segmentationcited by 2
- 2024EyeTrAES: Fine-grained, Low-Latency Eye Tracking via Adaptive Event Slicingcited by 2
- 2024Towards Unsupervised Eye-Region Segmentation for Eye Trackingcited by 2
12 most cited of 24 All 24 (JSON)
- 2026Event-Based Motion Estimation via Oriented Distance Fields25 Aug 2026
- 2026AmbientEye: A Dataset for Pupil Segmentation under Natural Ambient Infrared Illumination2 Jun 2026
- 2026Eye image segmentation using visual and concept prompts with Segment Anything Model 3 (SAM3)18 Mar 2026
- 2026Enhancing Eye Feature Estimation from Event Data Streams through Adaptive Inference State Space Modeling14 Mar 2026
- 2025EyeSeg: An Uncertainty-Aware Eye Segmentation Framework for AR/VR13 Jul 2025
- 2024FovealNet: Advancing AI-Driven Gaze Tracking Solutions for Optimized Foveated Rendering System Performance in Virtual Reality12 Dec 2024
- 2024Towards Unsupervised Eye-Region Segmentation for Eye Tracking8 Oct 2024
- 2024EyeTrAES: Fine-grained, Low-Latency Eye Tracking via Adaptive Event Slicing27 Sep 2024
- 2024CondSeg: Ellipse Estimation of Pupil and Iris via Conditioned Segmentation30 Aug 2024
- 2024A Bayesian Approach Toward Robust Multidimensional Ellipsoid-Specific Fitting27 Jul 2024
- 2024Using Deep Learning to Increase Eye-Tracking Robustness, Accuracy, and Precision in Virtual Reality28 Mar 2024
- 2024Deep Domain Adaptation: A Sim2Real Neural Approach for Improving Eye-Tracking Systems23 Mar 2024
12 newest of 24 All 24 (JSON)