# Pistol: Pupil Invisible Supportive Tool to extract Pupil, Iris, Eye Opening, Eye Movements, Pupil and Iris Gaze Vector, and 2D as well as 3D Gaze

arXiv: https://arxiv.org/abs/2201.06799 · HTML: https://mlsanity.com/paper/2201.06799/

## Key facts

- Cited by 9 papers in the map (data through 14 Oct 2026).
- Builds on 9 of its 57 references that are in the map.
- First posted on arXiv 18 Jan 2022.

## Builds on (most cited first, 9 of 9)

- [Deep Residual Learning for Image Recognition](https://mlsanity.com/paper/1512.03385/) (2015)
- [Decoupled Weight Decay Regularization](https://mlsanity.com/paper/1711.05101/) (2017)
- [TEyeD: Over 20 million real-world eye images with Pupil, Eyelid, and Iris 2D and 3D Segmentations, 2D and 3D Landmarks, 3D Eyeball, Gaze Vector, and Eye Movement Types](https://mlsanity.com/paper/2102.02115/) (2021)
- [ElSe: Ellipse Selection for Robust Pupil Detection in Real-World Environments](https://mlsanity.com/paper/1511.06575/) (2015)
- [Fully Convolutional Neural Networks for Raw Eye Tracking Data Segmentation, Generation, and Reconstruction](https://mlsanity.com/paper/2002.10905/) (2020)
- [Learning to Validate the Quality of Detected Landmarks](https://mlsanity.com/paper/1901.10143/) (2019)
- [Maximum and Leaky Maximum Propagation](https://mlsanity.com/paper/2105.10277/) (2021)
- [Tensor Normalization and Full Distribution Training](https://mlsanity.com/paper/2109.02345/) (2021)
- [A review of the low-cost eye-tracking systems for 2010-2020](https://mlsanity.com/paper/2010.05480/) (2020)

## Built on by (most cited first, 9 of 9)

- [Zero-Shot Segmentation of Eye Features Using the Segment Anything Model (SAM)](https://mlsanity.com/paper/2311.08077/) (2023)
- [LEyes: A Lightweight Framework for Deep Learning-Based Eye Tracking using Synthetic Eye Images](https://mlsanity.com/paper/2309.06129/) (2023)
- [One step closer to EEG based eye tracking](https://mlsanity.com/paper/2303.06039/) (2023)
- [Gaze-based Object Detection in the Wild](https://mlsanity.com/paper/2203.15651/) (2022)
- [Technical Report: Combining knowledge from Transfer Learning during training and Wide Resnets](https://mlsanity.com/paper/2206.09697/) (2022)
- [DeepMetricEye: Metric Depth Estimation in Periocular VR Imagery](https://mlsanity.com/paper/2311.07235/) (2023)
- [Teaching Unknown Objects by Leveraging Human Gaze and Augmented Reality in Human-Robot Interaction](https://mlsanity.com/paper/2312.07638/) (2023)
- [Normalized Validity Scores for DNNs in Regression based Eye Feature Extraction](https://mlsanity.com/paper/2403.11665/) (2024)
- [Eye image segmentation using visual and concept prompts with Segment Anything Model 3 (SAM3)](https://mlsanity.com/paper/2603.17715/) (2026)

## Abstract (arXiv)

This paper describes a feature extraction and gaze estimation software, named textitPistol that can be used with Pupil Invisible projects and other eye trackers in the future. In offline mode, our software extracts multiple features from the eye including, the pupil and iris ellipse, eye aperture, pupil vector, iris vector, eye movement types from pupil and iris velocities, marker detection, marker distance, 2D gaze estimation for the pupil center, iris center, pupil vector, and iris vector using Levenberg Marquart fitting and neural networks. The gaze signal is computed in 2D for each eye and each feature separately and for both eyes in 3D also for each feature separately. We hope this software helps other researchers to extract state-of-the-art features for their research out of their recordings. Link: https://es-cloud.cs.uni-tuebingen.de/d/8e2ab8c3fdd444e1a135/?p=%2FPISTOL&mode=list