ElSe: Ellipse Selection for Robust Pupil Detection in Real-World Environments
Not on the map. Why?
Abstract (arXiv)
Fast and robust pupil detection is an essential prerequisite for video-based eye-tracking in real-world settings. Several algorithms for image-based pupil detection have been proposed, their applicability is mostly limited to laboratory conditions. In realworld scenarios, automated pupil detection has to face various challenges, such as illumination changes, reflections (on glasses), make-up, non-centered eye recording, and physiological eye characteristics. We propose ElSe, a novel algorithm based on ellipse evaluation of a filtered edge image. We aim at a robust, resource-saving approach that can be integrated in embedded architectures e.g. driving. The proposed algorithm was evaluated against four state-of-the-art methods on over 93,000 hand-labeled images from which 55,000 are new images contributed by this work. On average, the proposed method achieved a 14.53% improvement on the detection rate relative to the best state-of-the-art performer. download:ftp://[email protected]. de (password:eyedata).
Key facts. Cited by 16 papers in the map (data through 14 Oct 2026). First posted on arXiv 20 Nov 2015.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 6; 2022: 4; 2023: 2; 2024: 3; 2025: 1.
16 papers.
Sort:
- 2021TEyeD: Over 20 million real-world eye images with Pupil, Eyelid, and Iris 2D and 3D Segmentations, 2D and 3D Landmarks, 3D Eyeball, Gaze Vector, and Eye Movement Typescited by 32
- 2023An End-to-End Review of Gaze Estimation and its Interactive Applications on Handheld Mobile Devicescited by 13
- 2021The Gaze and Mouse Signal as additional Source for User Fingerprints in Browser Applicationscited by 10
- 2022Pistol: Pupil Invisible Supportive Tool to extract Pupil, Iris, Eye Opening, Eye Movements, Pupil and Iris Gaze Vector, and 2D as well as 3D Gazecited by 9
- 2021A Multimodal Eye Movement Dataset and a Multimodal Eye Movement Segmentation Analysiscited by 7
- 20211000 Pupil Segmentations in a Second using Haar Like Features and Statistical Learningcited by 7
- 2022EllSeg-Gen, towards Domain Generalization for head-mounted eyetrackingcited by 6
- 2021Maximum and Leaky Maximum Propagationcited by 4
- 2021Tensor Normalization and Full Distribution Trainingcited by 3
- 2022GroupGazer: A Tool to Compute the Gaze per Participant in Groups with integrated Calibration to Map the Gaze Online to a Screen or Beamer Projectioncited by 2
- 2024EyeTrAES: Fine-grained, Low-Latency Eye Tracking via Adaptive Event Slicingcited by 2
- 2024Zero-Shot Pupil Segmentation with SAM 2: A Case Study of Over 14 Million Imagescited by 2
4 more
- 2025Digitally Prototype Your Eye Tracker: Simulating Hardware Performance using 3D Synthetic Datacited by 2
- 2024Using Deep Learning to Increase Eye-Tracking Robustness, Accuracy, and Precision in Virtual Realitycited by 1
- 2022Technical Report: Combining knowledge from Transfer Learning during training and Wide Resnetscited by 0
- 2023A temporally quantized distribution of pupil diameters as a new feature for cognitive load classificationcited by 0
- 2025Digitally Prototype Your Eye Tracker: Simulating Hardware Performance using 3D Synthetic Data20 Mar 2025
- 2024Zero-Shot Pupil Segmentation with SAM 2: A Case Study of Over 14 Million Images11 Oct 2024
- 2024EyeTrAES: Fine-grained, Low-Latency Eye Tracking via Adaptive Event Slicing27 Sep 2024
- 2024Using Deep Learning to Increase Eye-Tracking Robustness, Accuracy, and Precision in Virtual Reality28 Mar 2024
- 2023An End-to-End Review of Gaze Estimation and its Interactive Applications on Handheld Mobile Devices30 Jun 2023
- 2023A temporally quantized distribution of pupil diameters as a new feature for cognitive load classification3 Mar 2023
- 2022Technical Report: Combining knowledge from Transfer Learning during training and Wide Resnets20 Jun 2022
- 2022EllSeg-Gen, towards Domain Generalization for head-mounted eyetracking4 May 2022
- 2022GroupGazer: A Tool to Compute the Gaze per Participant in Groups with integrated Calibration to Map the Gaze Online to a Screen or Beamer Projection19 Jan 2022
- 2022Pistol: Pupil Invisible Supportive Tool to extract Pupil, Iris, Eye Opening, Eye Movements, Pupil and Iris Gaze Vector, and 2D as well as 3D Gaze18 Jan 2022
- 2021Tensor Normalization and Full Distribution Training6 Sep 2021
- 2021Maximum and Leaky Maximum Propagation21 May 2021
4 more
- 2021TEyeD: Over 20 million real-world eye images with Pupil, Eyelid, and Iris 2D and 3D Segmentations, 2D and 3D Landmarks, 3D Eyeball, Gaze Vector, and Eye Movement Types3 Feb 2021
- 20211000 Pupil Segmentations in a Second using Haar Like Features and Statistical Learning3 Feb 2021
- 2021A Multimodal Eye Movement Dataset and a Multimodal Eye Movement Segmentation Analysis12 Jan 2021
- 2021The Gaze and Mouse Signal as additional Source for User Fingerprints in Browser Applications11 Jan 2021
- 2021TEyeD: Over 20 million real-world eye images with Pupil, Eyelid, and Iris 2D and 3D Segmentations, 2D and 3D Landmarks, 3D Eyeball, Gaze Vector, and Eye Movement Typescited by 32
- 2023An End-to-End Review of Gaze Estimation and its Interactive Applications on Handheld Mobile Devicescited by 13
- 2021The Gaze and Mouse Signal as additional Source for User Fingerprints in Browser Applicationscited by 10
- 2022Pistol: Pupil Invisible Supportive Tool to extract Pupil, Iris, Eye Opening, Eye Movements, Pupil and Iris Gaze Vector, and 2D as well as 3D Gazecited by 9
- 2021A Multimodal Eye Movement Dataset and a Multimodal Eye Movement Segmentation Analysiscited by 7
- 20211000 Pupil Segmentations in a Second using Haar Like Features and Statistical Learningcited by 7
- 2022EllSeg-Gen, towards Domain Generalization for head-mounted eyetrackingcited by 6
- 2021Maximum and Leaky Maximum Propagationcited by 4
- 2021Tensor Normalization and Full Distribution Trainingcited by 3
- 2022GroupGazer: A Tool to Compute the Gaze per Participant in Groups with integrated Calibration to Map the Gaze Online to a Screen or Beamer Projectioncited by 2
- 2024EyeTrAES: Fine-grained, Low-Latency Eye Tracking via Adaptive Event Slicingcited by 2
- 2024Zero-Shot Pupil Segmentation with SAM 2: A Case Study of Over 14 Million Imagescited by 2
12 most cited of 16 All 16 (JSON)
- 2025Digitally Prototype Your Eye Tracker: Simulating Hardware Performance using 3D Synthetic Data20 Mar 2025
- 2024Zero-Shot Pupil Segmentation with SAM 2: A Case Study of Over 14 Million Images11 Oct 2024
- 2024EyeTrAES: Fine-grained, Low-Latency Eye Tracking via Adaptive Event Slicing27 Sep 2024
- 2024Using Deep Learning to Increase Eye-Tracking Robustness, Accuracy, and Precision in Virtual Reality28 Mar 2024
- 2023An End-to-End Review of Gaze Estimation and its Interactive Applications on Handheld Mobile Devices30 Jun 2023
- 2023A temporally quantized distribution of pupil diameters as a new feature for cognitive load classification3 Mar 2023
- 2022Technical Report: Combining knowledge from Transfer Learning during training and Wide Resnets20 Jun 2022
- 2022EllSeg-Gen, towards Domain Generalization for head-mounted eyetracking4 May 2022
- 2022GroupGazer: A Tool to Compute the Gaze per Participant in Groups with integrated Calibration to Map the Gaze Online to a Screen or Beamer Projection19 Jan 2022
- 2022Pistol: Pupil Invisible Supportive Tool to extract Pupil, Iris, Eye Opening, Eye Movements, Pupil and Iris Gaze Vector, and 2D as well as 3D Gaze18 Jan 2022
- 2021Tensor Normalization and Full Distribution Training6 Sep 2021
- 2021Maximum and Leaky Maximum Propagation21 May 2021
12 newest of 16 All 16 (JSON)