TEyeD: Over 20 million real-world eye images with Pupil, Eyelid, and Iris 2D and 3D Segmentations, 2D and 3D Landmarks, 3D Eyeball, Gaze Vector, and Eye Movement Types
Not on the map. Why?
Abstract (arXiv)
We present TEyeD, the world's largest unified public data set of eye images taken with head-mounted devices. TEyeD was acquired with seven different head-mounted eye trackers. Among them, two eye trackers were integrated into virtual reality (VR) or augmented reality (AR) devices. The images in TEyeD were obtained from various tasks, including car rides, simulator rides, outdoor sports activities, and daily indoor activities. The data set includes 2D and 3D landmarks, semantic segmentation, 3D eyeball annotation and the gaze vector and eye movement types for all images. Landmarks and semantic segmentation are provided for the pupil, iris and eyelids. Video lengths vary from a few minutes to several hours. With more than 20 million carefully annotated images, TEyeD provides a unique, coherent resource and a valuable foundation for advancing research in the field of computer vision, eye tracking and gaze estimation in modern VR and AR applications. Download: https://es-cloud.cs.uni-tuebingen.de/d/8e2ab8c3fdd444e1a135/?p=%2FTEyeDS&mode=list Alternative Download: https://hctlsrva.edu.sot.tum.de/TEyeDS/
Key facts. Cited by 32 papers in the map (data through 7 Oct 2026). Builds on 26 of its 99 references that are in the map. First posted on arXiv 3 Feb 2021.
Builds on
26 of 99 references.
References · 26
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 6,979
- 2016XGBoost: A Scalable Tree Boosting Systemcited by 5,120
- 2018MobileNetV2: Inverted Residuals and Linear Bottleneckscited by 4,773
- 2015Rendering of Eyes for Eye-Shape Registration and Gaze Estimationcited by 49
- 2019Gaze-in-wild: A dataset for studying eye and head coordination in everyday activitiescited by 25
- 2016PupilNet: Convolutional Neural Networks for Robust Pupil Detectioncited by 20
- 2015Labeled pupils in the wild: A dataset for studying pupil detection in unconstrained environmentscited by 18
- 2015ElSe: Ellipse Selection for Robust Pupil Detection in Real-World Environmentscited by 16
- 2017PupilNet v2.0: Convolutional Neural Networks for CPU based real time Robust Pupil Detectioncited by 15
14 more
- 2020Fully Convolutional Neural Networks for Raw Eye Tracking Data Segmentation, Generation, and Reconstructioncited by 12
- 2020Rotated Ring, Radial and Depth Wise Separable Radial Convolutionscited by 12
- 2018Eye movement velocity and gaze data generator for evaluation, robustness testing and assess of eye tracking software and visualization toolscited by 11
- 2019Learning to Validate the Quality of Detected Landmarkscited by 11
- 2020Weight and Gradient Centralization in Deep Neural Networkscited by 11
- 2017Fast camera focus estimation for gaze-based focus controlcited by 10
- 2018Eye movement simulation and detector creation to reduce laborious parameter adjustmentscited by 10
- 2019Training Decision Trees as Replacement for Convolution Layerscited by 10
- 2021The Gaze and Mouse Signal as additional Source for User Fingerprints in Browser Applicationscited by 10
- 2020Multi Layer Neural Networks as Replacement for Pooling Operationscited by 8
- 2020Explainable Online Validation of Machine Learning Models for Practical Applicationscited by 8
- 2021A Multimodal Eye Movement Dataset and a Multimodal Eye Movement Segmentation Analysiscited by 7
- 2015Bayesian Identification of Fixations, Saccades, and Smooth Pursuitscited by 4
- 2020MagicEyes: A Large Scale Eye Gaze Estimation Dataset for Mixed Realitycited by 4
Built on by
Citing papers per year: 2021: 2; 2022: 7; 2023: 7; 2024: 8; 2025: 1; 2026: 7.
32 papers.
Sort:
By area:
- 20233ET: Efficient Event-based Eye Tracking using a Change-Based ConvLSTM Networkcited by 30
- 2024Event-Based Eye Tracking. AIS 2024 Challenge Surveycited by 19
- 2022EyeNeRF: A Hybrid Representation for Photorealistic Synthesis, Animation and Relighting of Human Eyescited by 14
- 2023An End-to-End Review of Gaze Estimation and its Interactive Applications on Handheld Mobile Devicescited by 13
- 2023Eye-tracked Virtual Reality: A Comprehensive Survey on Methods and Privacy Challengescited by 12
- 20223DGazeNet: Generalizing Gaze Estimation with Weak-Supervision from Synthetic Viewscited by 11
- 2022Pistol: Pupil Invisible Supportive Tool to extract Pupil, Iris, Eye Opening, Eye Movements, Pupil and Iris Gaze Vector, and 2D as well as 3D Gazecited by 9
- 2024Co-designing a Sub-millisecond Latency Event-based Eye Tracking System with Submanifold Sparse CNNcited by 8
- 2023Zero-Shot Segmentation of Eye Features Using the Segment Anything Model (SAM)cited by 7
- 2021Maximum and Leaky Maximum Propagationcited by 4
- 2023LEyes: A Lightweight Framework for Deep Learning-Based Eye Tracking using Synthetic Eye Imagescited by 4
- 2024The Visual Experience Dataset: Over 200 Recorded Hours of Integrated Eye Movement, Odometry, and Egocentric Videocited by 4
20 more
- 2021Tensor Normalization and Full Distribution Trainingcited by 3
- 2022GroupGazer: A Tool to Compute the Gaze per Participant in Groups with integrated Calibration to Map the Gaze Online to a Screen or Beamer Projectioncited by 2
- 2024PupilSense: A Novel Application for Webcam-Based Pupil Diameter Estimationcited by 2
- 2024CondSeg: Ellipse Estimation of Pupil and Iris via Conditioned Segmentationcited by 2
- 2024Towards Unsupervised Eye-Region Segmentation for Eye Trackingcited by 2
- 2024Zero-Shot Pupil Segmentation with SAM 2: A Case Study of Over 14 Million Imagescited by 2
- 2022Artificial Neural Networks for Finger Vein Recognition: A Surveycited by 1
- 2023Model-aware 3D Eye Gaze from Weak and Few-shot Supervisionscited by 1
- 2026GazeShift: Unsupervised Gaze Estimation and Dataset for VRcited by 1
- 2026Rapidly deploying on-device eye tracking by distilling visual foundation modelscited by 1
- 2022On-Sensor Binarized Fully Convolutional Neural Network with A Pixel Processor Arraycited by 0
- 2022Technical Report: Combining knowledge from Transfer Learning during training and Wide Resnetscited by 0
- 2023DeepMetricEye: Metric Depth Estimation in Periocular VR Imagerycited by 0
- 2024Normalized Validity Scores for DNNs in Regression based Eye Feature Extractioncited by 0
- 2025EyeSeg: An Uncertainty-Aware Eye Segmentation Framework for AR/VRcited by 0
- 2026Eye image segmentation using visual and concept prompts with Segment Anything Model 3 (SAM3)cited by 0
- 2026PicoEyes: Unified Gaze Estimation Framework for Mixed Reality with a Large-Scale Multi-View Datasetcited by 0
- 2026AmbientEye: A Dataset for Pupil Segmentation under Natural Ambient Infrared Illuminationcited by 0
- 2026GenEyePose: Patient-Free, Knowledge-Based Saccadic Eye Movement Modeling for Digital Neurophysiologic Biomarker Developmentcited by 0
- 2026GazeDiT: Gaze-Accurate Diffusion Image Generation for Eye Tracking via Spatial Conditioningcited by 0
- 2026GazeDiT: Gaze-Accurate Diffusion Image Generation for Eye Tracking via Spatial Conditioning15 Sep 2026
- 2026GenEyePose: Patient-Free, Knowledge-Based Saccadic Eye Movement Modeling for Digital Neurophysiologic Biomarker Development8 Jun 2026
- 2026AmbientEye: A Dataset for Pupil Segmentation under Natural Ambient Infrared Illumination2 Jun 2026
- 2026PicoEyes: Unified Gaze Estimation Framework for Mixed Reality with a Large-Scale Multi-View Dataset8 May 2026
- 2026Rapidly deploying on-device eye tracking by distilling visual foundation models2 Apr 2026
- 2026Eye image segmentation using visual and concept prompts with Segment Anything Model 3 (SAM3)18 Mar 2026
- 2026GazeShift: Unsupervised Gaze Estimation and Dataset for VR8 Mar 2026
- 2025EyeSeg: An Uncertainty-Aware Eye Segmentation Framework for AR/VR13 Jul 2025
- 2024Zero-Shot Pupil Segmentation with SAM 2: A Case Study of Over 14 Million Images11 Oct 2024
- 2024Towards Unsupervised Eye-Region Segmentation for Eye Tracking8 Oct 2024
- 2024CondSeg: Ellipse Estimation of Pupil and Iris via Conditioned Segmentation30 Aug 2024
- 2024PupilSense: A Novel Application for Webcam-Based Pupil Diameter Estimation15 Jul 2024
20 more
- 2024Co-designing a Sub-millisecond Latency Event-based Eye Tracking System with Submanifold Sparse CNN22 Apr 2024
- 2024Event-Based Eye Tracking. AIS 2024 Challenge Survey17 Apr 2024
- 2024Normalized Validity Scores for DNNs in Regression based Eye Feature Extraction18 Mar 2024
- 2024The Visual Experience Dataset: Over 200 Recorded Hours of Integrated Eye Movement, Odometry, and Egocentric Video15 Feb 2024
- 2023Model-aware 3D Eye Gaze from Weak and Few-shot Supervisions20 Nov 2023
- 2023Zero-Shot Segmentation of Eye Features Using the Segment Anything Model (SAM)14 Nov 2023
- 2023DeepMetricEye: Metric Depth Estimation in Periocular VR Imagery13 Nov 2023
- 2023LEyes: A Lightweight Framework for Deep Learning-Based Eye Tracking using Synthetic Eye Images12 Sep 2023
- 20233ET: Efficient Event-based Eye Tracking using a Change-Based ConvLSTM Network22 Aug 2023
- 2023An End-to-End Review of Gaze Estimation and its Interactive Applications on Handheld Mobile Devices30 Jun 2023
- 2023Eye-tracked Virtual Reality: A Comprehensive Survey on Methods and Privacy Challenges23 May 2023
- 20223DGazeNet: Generalizing Gaze Estimation with Weak-Supervision from Synthetic Views6 Dec 2022
- 2022Artificial Neural Networks for Finger Vein Recognition: A Survey29 Aug 2022
- 2022Technical Report: Combining knowledge from Transfer Learning during training and Wide Resnets20 Jun 2022
- 2022EyeNeRF: A Hybrid Representation for Photorealistic Synthesis, Animation and Relighting of Human Eyes16 Jun 2022
- 2022On-Sensor Binarized Fully Convolutional Neural Network with A Pixel Processor Array2 Feb 2022
- 2022GroupGazer: A Tool to Compute the Gaze per Participant in Groups with integrated Calibration to Map the Gaze Online to a Screen or Beamer Projection19 Jan 2022
- 2022Pistol: Pupil Invisible Supportive Tool to extract Pupil, Iris, Eye Opening, Eye Movements, Pupil and Iris Gaze Vector, and 2D as well as 3D Gaze18 Jan 2022
- 2021Tensor Normalization and Full Distribution Training6 Sep 2021
- 2021Maximum and Leaky Maximum Propagation21 May 2021
- 20233ET: Efficient Event-based Eye Tracking using a Change-Based ConvLSTM Networkcited by 30
- 2024Event-Based Eye Tracking. AIS 2024 Challenge Surveycited by 19
- 2022EyeNeRF: A Hybrid Representation for Photorealistic Synthesis, Animation and Relighting of Human Eyescited by 14
- 2023An End-to-End Review of Gaze Estimation and its Interactive Applications on Handheld Mobile Devicescited by 13
- 2023Eye-tracked Virtual Reality: A Comprehensive Survey on Methods and Privacy Challengescited by 12
- 20223DGazeNet: Generalizing Gaze Estimation with Weak-Supervision from Synthetic Viewscited by 11
- 2022Pistol: Pupil Invisible Supportive Tool to extract Pupil, Iris, Eye Opening, Eye Movements, Pupil and Iris Gaze Vector, and 2D as well as 3D Gazecited by 9
- 2024Co-designing a Sub-millisecond Latency Event-based Eye Tracking System with Submanifold Sparse CNNcited by 8
- 2023Zero-Shot Segmentation of Eye Features Using the Segment Anything Model (SAM)cited by 7
- 2021Maximum and Leaky Maximum Propagationcited by 4
- 2023LEyes: A Lightweight Framework for Deep Learning-Based Eye Tracking using Synthetic Eye Imagescited by 4
- 2024The Visual Experience Dataset: Over 200 Recorded Hours of Integrated Eye Movement, Odometry, and Egocentric Videocited by 4
12 most cited of 31 All 31 (JSON)
- 2026GenEyePose: Patient-Free, Knowledge-Based Saccadic Eye Movement Modeling for Digital Neurophysiologic Biomarker Development8 Jun 2026
- 2026AmbientEye: A Dataset for Pupil Segmentation under Natural Ambient Infrared Illumination2 Jun 2026
- 2026PicoEyes: Unified Gaze Estimation Framework for Mixed Reality with a Large-Scale Multi-View Dataset8 May 2026
- 2026Rapidly deploying on-device eye tracking by distilling visual foundation models2 Apr 2026
- 2026Eye image segmentation using visual and concept prompts with Segment Anything Model 3 (SAM3)18 Mar 2026
- 2026GazeShift: Unsupervised Gaze Estimation and Dataset for VR8 Mar 2026
- 2025EyeSeg: An Uncertainty-Aware Eye Segmentation Framework for AR/VR13 Jul 2025
- 2024Zero-Shot Pupil Segmentation with SAM 2: A Case Study of Over 14 Million Images11 Oct 2024
- 2024Towards Unsupervised Eye-Region Segmentation for Eye Tracking8 Oct 2024
- 2024CondSeg: Ellipse Estimation of Pupil and Iris via Conditioned Segmentation30 Aug 2024
- 2024PupilSense: A Novel Application for Webcam-Based Pupil Diameter Estimation15 Jul 2024
- 2024Co-designing a Sub-millisecond Latency Event-based Eye Tracking System with Submanifold Sparse CNN22 Apr 2024
12 newest of 31 All 31 (JSON)