# Labeled pupils in the wild: A dataset for studying pupil detection in unconstrained environments

arXiv: https://arxiv.org/abs/1511.05768 · HTML: https://mlsanity.com/paper/1511.05768/

## Key facts

- Cited by 18 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 18 Nov 2015.

## Built on by (most cited first, 18 of 18)

- [TEyeD: Over 20 million real-world eye images with Pupil, Eyelid, and Iris 2D and 3D Segmentations, 2D and 3D Landmarks, 3D Eyeball, Gaze Vector, and Eye Movement Types](https://mlsanity.com/paper/2102.02115/) (2021)
- [3ET: Efficient Event-based Eye Tracking using a Change-Based ConvLSTM Network](https://mlsanity.com/paper/2308.11771/) (2023)
- [Rethinking Efficient and Effective Point-based Networks for Event Camera Classification and Regression: EventMamba](https://mlsanity.com/paper/2405.06116/) (2024)
- [EyeNeRF: A Hybrid Representation for Photorealistic Synthesis, Animation and Relighting of Human Eyes](https://mlsanity.com/paper/2206.08428/) (2022)
- [MTGLS: Multi-Task Gaze Estimation with Limited Supervision](https://mlsanity.com/paper/2110.12100/) (2021)
- [1000 Pupil Segmentations in a Second using Haar Like Features and Statistical Learning](https://mlsanity.com/paper/2102.01921/) (2021)
- [EllSeg-Gen, towards Domain Generalization for head-mounted eyetracking](https://mlsanity.com/paper/2205.01947/) (2022)
- [EyePreserve: Identity-Preserving Iris Synthesis](https://mlsanity.com/paper/2312.12028/) (2023)
- [PrivatEyes: Appearance-based Gaze Estimation Using Federated Secure Multi-Party Computation](https://mlsanity.com/paper/2402.18970/) (2024)
- [GG-SSMs: Graph-Generating State Space Models](https://mlsanity.com/paper/2412.12423/) (2024)
- [Zero-Shot Pupil Segmentation with SAM 2: A Case Study of Over 14 Million Images](https://mlsanity.com/paper/2410.08926/) (2024)
- [Using Deep Learning to Increase Eye-Tracking Robustness, Accuracy, and Precision in Virtual Reality](https://mlsanity.com/paper/2403.19768/) (2024)
- [VRBiom: A New Periocular Dataset for Biometric Applications of HMD](https://mlsanity.com/paper/2407.02150/) (2024)
- [Biometrics in Extended Reality: A Review](https://mlsanity.com/paper/2411.10489/) (2024)
- [An Embedded and Real-Time Pupil Detection Pipeline](https://mlsanity.com/paper/2302.14098/) (2023)
- [CLERA: A Unified Model for Joint Cognitive Load and Eye Region Analysis in the Wild](https://mlsanity.com/paper/2306.15073/) (2023)
- [EyeSeg: An Uncertainty-Aware Eye Segmentation Framework for AR/VR](https://mlsanity.com/paper/2507.09649/) (2025)
- [AmbientEye: A Dataset for Pupil Segmentation under Natural Ambient Infrared Illumination](https://mlsanity.com/paper/2606.03774/) (2026)

## Abstract (arXiv)

We present labelled pupils in the wild (LPW), a novel dataset of 66 high-quality, high-speed eye region videos for the development and evaluation of pupil detection algorithms. The videos in our dataset were recorded from 22 participants in everyday locations at about 95 FPS using a state-of-the-art dark-pupil head-mounted eye tracker. They cover people with different ethnicities, a diverse set of everyday indoor and outdoor illumination environments, as well as natural gaze direction distributions. The dataset also includes participants wearing glasses, contact lenses, as well as make-up. We benchmark five state-of-the-art pupil detection algorithms on our dataset with respect to robustness and accuracy. We further study the influence of image resolution, vision aids, as well as recording location (indoor, outdoor) on pupil detection performance. Our evaluations provide valuable insights into the general pupil detection problem and allow us to identify key challenges for robust pupil detection on head-mounted eye trackers.