Pupil: An Open Source Platform for Pervasive Eye Tracking and Mobile Gaze-based Interaction
Not on the map. Why?
Abstract (arXiv)
Commercial head-mounted eye trackers provide useful features to customers in industry and research but are expensive and rely on closed source hardware and software. This limits the application areas and use of mobile eye tracking to expert users and inhibits user-driven development, customisation, and extension. In this paper we present Pupil -- an accessible, affordable, and extensible open source platform for mobile eye tracking and gaze-based interaction. Pupil comprises 1) a light-weight headset with high-resolution cameras, 2) an open source software framework for mobile eye tracking, as well as 3) a graphical user interface (GUI) to playback and visualize video and gaze data. Pupil features high-resolution scene and eye cameras for monocular and binocular gaze estimation. The software and GUI are platform-independent and include state-of-the-art algorithms for real-time pupil detection and tracking, calibration, and accurate gaze estimation. Results of a performance evaluation show that Pupil can provide an average gaze estimation accuracy of 0.6 degree of visual angle (0.08 degree precision) with a latency of the processing pipeline of only 0.045 seconds.
Key facts. Cited by 43 papers in the map (data through 14 Oct 2026). First posted on arXiv 30 Apr 2014.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 3; 2022: 8; 2023: 6; 2024: 9; 2025: 9; 2026: 8.
43 papers.
Sort:
By area:
- 2024EgoExoLearn: A Dataset for Bridging Asynchronous Ego- and Exo-centric View of Procedural Activities in Real Worldcited by 95
- 2024Retrieval-Augmented Egocentric Video Captioningcited by 42
- 2021Multimodal Fusion of EMG and Vision for Human Grasp Intent Inference in Prosthetic Hand Controlcited by 13
- 2023An End-to-End Review of Gaze Estimation and its Interactive Applications on Handheld Mobile Devicescited by 13
- 2023Eye-tracked Virtual Reality: A Comprehensive Survey on Methods and Privacy Challengescited by 12
- 2021Where Do Deep Fakes Look? Synthetic Face Detection via Gaze Trackingcited by 9
- 2022EllSeg-Gen, towards Domain Generalization for head-mounted eyetrackingcited by 6
- 2022FreeGaze: Resource-efficient Gaze Estimation via Frequency Domain Contrastive Learningcited by 5
- 2022Gaze-enhanced Crossmodal Embeddings for Emotion Recognitioncited by 4
- 2024Involution Fused ConvNet for Classifying Eye-Tracking Patterns of Children with Autism Spectrum Disordercited by 4
- 2024Modeling State Shifting via Local-Global Distillation for Event-Frame Gaze Trackingcited by 4
- 2024PrivateGaze: Preserving User Privacy in Black-box Mobile Gaze Tracking Servicescited by 4
31 more
- 2022Head and eye egocentric gesture recognition for human-robot interaction using eyewear camerascited by 3
- 2022What's on your mind? A Mental and Perceptual Load Estimation Framework towards Adaptive In-vehicle Interaction while Drivingcited by 3
- 2023One step closer to EEG based eye trackingcited by 3
- 2024DiffGaze: A Diffusion Model for Continuous Gaze Sequence Generation on 360deg Imagescited by 2
- 2024Swap It Like Its Hot: Segmentation-based spoof attacks on eye-tracking imagescited by 2
- 2024EyeTrAES: Fine-grained, Low-Latency Eye Tracking via Adaptive Event Slicingcited by 2
- 2025Digitally Prototype Your Eye Tracker: Simulating Hardware Performance using 3D Synthetic Datacited by 2
- 2025CNeuroMod-THINGS, a densely-sampled fMRI dataset for visual neurosciencecited by 2
- 2022Do Smart Glasses Dream of Sentimental Visions? Deep Emotionship Analysis for Eyewear Devicescited by 1
- 2022Gaze-Vergence-Controlled See-Through Vision in Augmented Realitycited by 1
- 2024Using Deep Learning to Increase Eye-Tracking Robustness, Accuracy, and Precision in Virtual Realitycited by 1
- 2025High-frequency near-eye ground truth for event-based eye trackingcited by 1
- 2026GuideAI: A Real-time Personalized Learning Solution with Adaptive Interventionscited by 1
- 2021MemX: An Attention-Aware Smart Eyewear System for Personalized Moment Auto-capturecited by 0
- 2022Slippage-robust Gaze Tracking for Near-eye Displaycited by 0
- 2023An Embedded and Real-Time Pupil Detection Pipelinecited by 0
- 2023A temporally quantized distribution of pupil diameters as a new feature for cognitive load classificationcited by 0
- 2023Human Comfortability Index Estimation in Industrial Human-Robot Collaboration Taskcited by 0
- 2025IG-MCTS: Human-in-the-Loop Cooperative Navigation under Incomplete Informationcited by 0
- 2025SecureGaze: Defending Gaze Estimation Against Backdoor Attackscited by 0
- 2025Mind Your Vision: Multimodal Estimation of Refractive Disorders Using Electrooculography and Eye Trackingcited by 0
- 2025Pose-Robust Calibration Strategy for Point-of-Gaze Estimation on Mobile Phonescited by 0
- 2025Detecting Reading-Induced Confusion Using EEG and Eye Trackingcited by 0
- 2025SensHRPS: Sensing Comfortable Human-Robot Proxemics and Personal Space With Eye-Trackingcited by 0
- 2026An Affordable, Wearable Stereo-Eye-Tracking Platformcited by 0
- 2026Visual Search Patterns in 3D Pancreatic Imaging: An Eye Tracking Studycited by 0
- 2026MOTOR: A Multimodal Dataset for Two-Wheeler Rider Behavior Understandingcited by 0
- 2026GazeBehavior Annotation Toolkit (GBAT): AI-powered toolkit for automatic annotation of egocentric eye-tracking and video data of child-caregiver interactioncited by 0
- 2026Comparing Human Gaze and Vision-Language Model Attention in Safety-Relevant Environmentscited by 0
- 2026Drift Calibration in Geometric Eye Tracking Systemscited by 0
- 2026An Intelligent Decision Support System for Emotion Monitoring using Microscopic Fixational Dynamicscited by 0
- 2026An Intelligent Decision Support System for Emotion Monitoring using Microscopic Fixational Dynamics1 Sep 2026
- 2026Drift Calibration in Geometric Eye Tracking Systems30 Aug 2026
- 2026Comparing Human Gaze and Vision-Language Model Attention in Safety-Relevant Environments13 Jun 2026
- 2026GazeBehavior Annotation Toolkit (GBAT): AI-powered toolkit for automatic annotation of egocentric eye-tracking and video data of child-caregiver interaction21 May 2026
- 2026MOTOR: A Multimodal Dataset for Two-Wheeler Rider Behavior Understanding21 May 2026
- 2026Visual Search Patterns in 3D Pancreatic Imaging: An Eye Tracking Study13 May 2026
- 2026An Affordable, Wearable Stereo-Eye-Tracking Platform27 Apr 2026
- 2026GuideAI: A Real-time Personalized Learning Solution with Adaptive Interventions28 Jan 2026
- 2025SensHRPS: Sensing Comfortable Human-Robot Proxemics and Personal Space With Eye-Tracking9 Dec 2025
- 2025Detecting Reading-Induced Confusion Using EEG and Eye Tracking20 Aug 2025
- 2025Pose-Robust Calibration Strategy for Point-of-Gaze Estimation on Mobile Phones14 Aug 2025
- 2025CNeuroMod-THINGS, a densely-sampled fMRI dataset for visual neuroscience11 Jul 2025
31 more
- 2025Mind Your Vision: Multimodal Estimation of Refractive Disorders Using Electrooculography and Eye Tracking24 May 2025
- 2025Digitally Prototype Your Eye Tracker: Simulating Hardware Performance using 3D Synthetic Data20 Mar 2025
- 2025SecureGaze: Defending Gaze Estimation Against Backdoor Attacks27 Feb 2025
- 2025High-frequency near-eye ground truth for event-based eye tracking5 Feb 2025
- 2025IG-MCTS: Human-in-the-Loop Cooperative Navigation under Incomplete Information3 Feb 2025
- 2024EyeTrAES: Fine-grained, Low-Latency Eye Tracking via Adaptive Event Slicing27 Sep 2024
- 2024PrivateGaze: Preserving User Privacy in Black-box Mobile Gaze Tracking Services1 Aug 2024
- 2024Swap It Like Its Hot: Segmentation-based spoof attacks on eye-tracking images22 Apr 2024
- 2024Modeling State Shifting via Local-Global Distillation for Event-Frame Gaze Tracking31 Mar 2024
- 2024Using Deep Learning to Increase Eye-Tracking Robustness, Accuracy, and Precision in Virtual Reality28 Mar 2024
- 2024DiffGaze: A Diffusion Model for Continuous Gaze Sequence Generation on 360deg Images26 Mar 2024
- 2024EgoExoLearn: A Dataset for Bridging Asynchronous Ego- and Exo-centric View of Procedural Activities in Real World24 Mar 2024
- 2024Involution Fused ConvNet for Classifying Eye-Tracking Patterns of Children with Autism Spectrum Disorder7 Jan 2024
- 2024Retrieval-Augmented Egocentric Video Captioning1 Jan 2024
- 2023Human Comfortability Index Estimation in Industrial Human-Robot Collaboration Task28 Aug 2023
- 2023An End-to-End Review of Gaze Estimation and its Interactive Applications on Handheld Mobile Devices30 Jun 2023
- 2023Eye-tracked Virtual Reality: A Comprehensive Survey on Methods and Privacy Challenges23 May 2023
- 2023A temporally quantized distribution of pupil diameters as a new feature for cognitive load classification3 Mar 2023
- 2023One step closer to EEG based eye tracking3 Mar 2023
- 2023An Embedded and Real-Time Pupil Detection Pipeline27 Feb 2023
- 2022Slippage-robust Gaze Tracking for Near-eye Display20 Oct 2022
- 2022FreeGaze: Resource-efficient Gaze Estimation via Frequency Domain Contrastive Learning14 Sep 2022
- 2022What's on your mind? A Mental and Perceptual Load Estimation Framework towards Adaptive In-vehicle Interaction while Driving10 Aug 2022
- 2022Gaze-Vergence-Controlled See-Through Vision in Augmented Reality6 Jul 2022
- 2022EllSeg-Gen, towards Domain Generalization for head-mounted eyetracking4 May 2022
- 2022Gaze-enhanced Crossmodal Embeddings for Emotion Recognition30 Apr 2022
- 2022Head and eye egocentric gesture recognition for human-robot interaction using eyewear cameras27 Jan 2022
- 2022Do Smart Glasses Dream of Sentimental Visions? Deep Emotionship Analysis for Eyewear Devices24 Jan 2022
- 2021MemX: An Attention-Aware Smart Eyewear System for Personalized Moment Auto-capture3 May 2021
- 2021Multimodal Fusion of EMG and Vision for Human Grasp Intent Inference in Prosthetic Hand Control8 Apr 2021
- 2021Where Do Deep Fakes Look? Synthetic Face Detection via Gaze Tracking4 Jan 2021
- 2024EgoExoLearn: A Dataset for Bridging Asynchronous Ego- and Exo-centric View of Procedural Activities in Real Worldcited by 95
- 2024Retrieval-Augmented Egocentric Video Captioningcited by 42
- 2021Multimodal Fusion of EMG and Vision for Human Grasp Intent Inference in Prosthetic Hand Controlcited by 13
- 2023An End-to-End Review of Gaze Estimation and its Interactive Applications on Handheld Mobile Devicescited by 13
- 2023Eye-tracked Virtual Reality: A Comprehensive Survey on Methods and Privacy Challengescited by 12
- 2021Where Do Deep Fakes Look? Synthetic Face Detection via Gaze Trackingcited by 9
- 2022EllSeg-Gen, towards Domain Generalization for head-mounted eyetrackingcited by 6
- 2022FreeGaze: Resource-efficient Gaze Estimation via Frequency Domain Contrastive Learningcited by 5
- 2022Gaze-enhanced Crossmodal Embeddings for Emotion Recognitioncited by 4
- 2024Involution Fused ConvNet for Classifying Eye-Tracking Patterns of Children with Autism Spectrum Disordercited by 4
- 2024Modeling State Shifting via Local-Global Distillation for Event-Frame Gaze Trackingcited by 4
- 2024PrivateGaze: Preserving User Privacy in Black-box Mobile Gaze Tracking Servicescited by 4
12 most cited of 41 All 41 (JSON)
- 2026An Intelligent Decision Support System for Emotion Monitoring using Microscopic Fixational Dynamics1 Sep 2026
- 2026Drift Calibration in Geometric Eye Tracking Systems30 Aug 2026
- 2026GazeBehavior Annotation Toolkit (GBAT): AI-powered toolkit for automatic annotation of egocentric eye-tracking and video data of child-caregiver interaction21 May 2026
- 2026MOTOR: A Multimodal Dataset for Two-Wheeler Rider Behavior Understanding21 May 2026
- 2026Visual Search Patterns in 3D Pancreatic Imaging: An Eye Tracking Study13 May 2026
- 2026An Affordable, Wearable Stereo-Eye-Tracking Platform27 Apr 2026
- 2026GuideAI: A Real-time Personalized Learning Solution with Adaptive Interventions28 Jan 2026
- 2025SensHRPS: Sensing Comfortable Human-Robot Proxemics and Personal Space With Eye-Tracking9 Dec 2025
- 2025Detecting Reading-Induced Confusion Using EEG and Eye Tracking20 Aug 2025
- 2025Pose-Robust Calibration Strategy for Point-of-Gaze Estimation on Mobile Phones14 Aug 2025
- 2025CNeuroMod-THINGS, a densely-sampled fMRI dataset for visual neuroscience11 Jul 2025
- 2025Mind Your Vision: Multimodal Estimation of Refractive Disorders Using Electrooculography and Eye Tracking24 May 2025
12 newest of 41 All 41 (JSON)