RITnet: Real-time Semantic Segmentation of the Eye for Gaze Tracking
Not on the map. Why?
Abstract (arXiv)
Accurate eye segmentation can improve eye-gaze estimation and support interactive computing based on visual attention; however, existing eye segmentation methods suffer from issues such as person-dependent accuracy, lack of robustness, and an inability to be run in real-time. Here, we present the RITnet model, which is a deep neural network that combines U-Net and DenseNet. RITnet is under 1 MB and achieves 95.3% accuracy on the 2019 OpenEDS Semantic Segmentation challenge. Using a GeForce GTX 1080 Ti, RITnet tracks at > 300Hz, enabling real-time gaze tracking applications. Pre-trained models and source code are available https://bitbucket.org/eye-ush/ritnet/.
Key facts. Cited by 33 papers in the map (data through 7 Oct 2026). First posted on arXiv 1 Oct 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 4; 2022: 7; 2023: 3; 2024: 10; 2025: 6; 2026: 3.
33 papers.
Sort:
- 2021Automatic Gaze Analysis: A Survey of Deep Learning based Approachescited by 33
- 2022Semantic Segmentation with Active Semi-Supervised Learningcited by 16
- 2022XRBench: An Extended Reality (XR) Machine Learning Benchmark Suite for the Metaversecited by 14
- 2023Eye-tracked Virtual Reality: A Comprehensive Survey on Methods and Privacy Challengescited by 12
- 20211000 Pupil Segmentations in a Second using Haar Like Features and Statistical Learningcited by 7
- 2022EllSeg-Gen, towards Domain Generalization for head-mounted eyetrackingcited by 6
- 2024Deep Domain Adaptation: A Sim2Real Neural Approach for Improving Eye-Tracking Systemscited by 6
- 2022HAZE-Net: High-Frequency Attentive Super-Resolved Gaze Estimation in Low-Resolution Face Imagescited by 4
- 2021Semi-Supervised Learning for Eye Image Segmentationcited by 3
- 2022Two-headed eye-segmentation approach for biometric identificationcited by 3
- 2024BOXR: Body and head motion Optimization framework for eXtended Realitycited by 3
- 2025FlatTrack: Eye-tracking with ultra-thin lensless camerascited by 3
21 more
- 2024CondSeg: Ellipse Estimation of Pupil and Iris via Conditioned Segmentationcited by 2
- 2024EyeTrAES: Fine-grained, Low-Latency Eye Tracking via Adaptive Event Slicingcited by 2
- 2024Towards Unsupervised Eye-Region Segmentation for Eye Trackingcited by 2
- 2022Multistream Gaze Estimation with Anatomical Eye Region Isolation by Synthetic to Real Transfer Learningcited by 1
- 2023Robust Sclera Segmentation for Skin-tone Agnostic Face Image Quality Assessmentcited by 1
- 2024Using Deep Learning to Increase Eye-Tracking Robustness, Accuracy, and Precision in Virtual Realitycited by 1
- 2024VRBiom: A New Periocular Dataset for Biometric Applications of HMDcited by 1
- 2024Energy-Efficient & Real-Time Computer Vision with Intelligent Skipping via Reconfigurable CMOS Image Sensorscited by 1
- 2024FovealNet: Advancing AI-Driven Gaze Tracking Solutions for Optimized Foveated Rendering System Performance in Virtual Realitycited by 1
- 2025Iris Style Transfer: Enhancing Iris Recognition with Style Features and Privacy Preservation through Neural Style Transfercited by 1
- 2025Trade-offs in Privacy-Preserving Eye Tracking through Iris Obfuscation: A Benchmarking Studycited by 1
- 2021Dataset for eye-tracking taskscited by 0
- 2022Cycle-GAN for eye-trackingcited by 0
- 2023DeepMetricEye: Metric Depth Estimation in Periocular VR Imagerycited by 0
- 2024Topology and Intersection-Union Constrained Loss Function for Multi-Region Anatomical Segmentation in Ocular Imagescited by 0
- 2025Stable Tracking of Eye Gaze Direction During Ophthalmic Surgerycited by 0
- 2025A3FR: Agile 3D Gaussian Splatting with Incremental Gaze Tracked Foveated Rendering in Virtual Realitycited by 0
- 2025EyeSeg: An Uncertainty-Aware Eye Segmentation Framework for AR/VRcited by 0
- 2026VUDA: Enabling Controlled Spatial Sharing of Graphics and Compute on NVIDIA GPUscited by 0
- 2026AmbientEye: A Dataset for Pupil Segmentation under Natural Ambient Infrared Illuminationcited by 0
- 2026Step-Attention Refinement of DINOv3 Features for Efficient Anterior Eye Segmentationcited by 0
- 2026Step-Attention Refinement of DINOv3 Features for Efficient Anterior Eye Segmentation29 Jul 2026
- 2026AmbientEye: A Dataset for Pupil Segmentation under Natural Ambient Infrared Illumination2 Jun 2026
- 2026VUDA: Enabling Controlled Spatial Sharing of Graphics and Compute on NVIDIA GPUs2 May 2026
- 2025EyeSeg: An Uncertainty-Aware Eye Segmentation Framework for AR/VR13 Jul 2025
- 2025A3FR: Agile 3D Gaussian Splatting with Incremental Gaze Tracked Foveated Rendering in Virtual Reality5 Jul 2025
- 2025Stable Tracking of Eye Gaze Direction During Ophthalmic Surgery1 Jul 2025
- 2025Trade-offs in Privacy-Preserving Eye Tracking through Iris Obfuscation: A Benchmarking Study14 Apr 2025
- 2025Iris Style Transfer: Enhancing Iris Recognition with Style Features and Privacy Preservation through Neural Style Transfer6 Mar 2025
- 2025FlatTrack: Eye-tracking with ultra-thin lensless cameras26 Jan 2025
- 2024FovealNet: Advancing AI-Driven Gaze Tracking Solutions for Optimized Foveated Rendering System Performance in Virtual Reality12 Dec 2024
- 2024Topology and Intersection-Union Constrained Loss Function for Multi-Region Anatomical Segmentation in Ocular Images1 Nov 2024
- 2024BOXR: Body and head motion Optimization framework for eXtended Reality16 Oct 2024
21 more
- 2024Towards Unsupervised Eye-Region Segmentation for Eye Tracking8 Oct 2024
- 2024EyeTrAES: Fine-grained, Low-Latency Eye Tracking via Adaptive Event Slicing27 Sep 2024
- 2024Energy-Efficient & Real-Time Computer Vision with Intelligent Skipping via Reconfigurable CMOS Image Sensors25 Sep 2024
- 2024CondSeg: Ellipse Estimation of Pupil and Iris via Conditioned Segmentation30 Aug 2024
- 2024VRBiom: A New Periocular Dataset for Biometric Applications of HMD2 Jul 2024
- 2024Using Deep Learning to Increase Eye-Tracking Robustness, Accuracy, and Precision in Virtual Reality28 Mar 2024
- 2024Deep Domain Adaptation: A Sim2Real Neural Approach for Improving Eye-Tracking Systems23 Mar 2024
- 2023Robust Sclera Segmentation for Skin-tone Agnostic Face Image Quality Assessment22 Dec 2023
- 2023DeepMetricEye: Metric Depth Estimation in Periocular VR Imagery13 Nov 2023
- 2023Eye-tracked Virtual Reality: A Comprehensive Survey on Methods and Privacy Challenges23 May 2023
- 2022XRBench: An Extended Reality (XR) Machine Learning Benchmark Suite for the Metaverse16 Nov 2022
- 2022Two-headed eye-segmentation approach for biometric identification30 Sep 2022
- 2022HAZE-Net: High-Frequency Attentive Super-Resolved Gaze Estimation in Low-Resolution Face Images21 Sep 2022
- 2022Multistream Gaze Estimation with Anatomical Eye Region Isolation by Synthetic to Real Transfer Learning18 Jun 2022
- 2022Cycle-GAN for eye-tracking21 May 2022
- 2022EllSeg-Gen, towards Domain Generalization for head-mounted eyetracking4 May 2022
- 2022Semantic Segmentation with Active Semi-Supervised Learning21 Mar 2022
- 2021Automatic Gaze Analysis: A Survey of Deep Learning based Approaches12 Aug 2021
- 2021Dataset for eye-tracking tasks1 Jun 2021
- 2021Semi-Supervised Learning for Eye Image Segmentation17 Mar 2021
- 20211000 Pupil Segmentations in a Second using Haar Like Features and Statistical Learning3 Feb 2021
- 2021Automatic Gaze Analysis: A Survey of Deep Learning based Approachescited by 33
- 2022Semantic Segmentation with Active Semi-Supervised Learningcited by 16
- 2022XRBench: An Extended Reality (XR) Machine Learning Benchmark Suite for the Metaversecited by 14
- 2023Eye-tracked Virtual Reality: A Comprehensive Survey on Methods and Privacy Challengescited by 12
- 20211000 Pupil Segmentations in a Second using Haar Like Features and Statistical Learningcited by 7
- 2022EllSeg-Gen, towards Domain Generalization for head-mounted eyetrackingcited by 6
- 2024Deep Domain Adaptation: A Sim2Real Neural Approach for Improving Eye-Tracking Systemscited by 6
- 2022HAZE-Net: High-Frequency Attentive Super-Resolved Gaze Estimation in Low-Resolution Face Imagescited by 4
- 2021Semi-Supervised Learning for Eye Image Segmentationcited by 3
- 2022Two-headed eye-segmentation approach for biometric identificationcited by 3
- 2024BOXR: Body and head motion Optimization framework for eXtended Realitycited by 3
- 2025FlatTrack: Eye-tracking with ultra-thin lensless camerascited by 3
12 most cited of 33 All 33 (JSON)
- 2026Step-Attention Refinement of DINOv3 Features for Efficient Anterior Eye Segmentation29 Jul 2026
- 2026AmbientEye: A Dataset for Pupil Segmentation under Natural Ambient Infrared Illumination2 Jun 2026
- 2026VUDA: Enabling Controlled Spatial Sharing of Graphics and Compute on NVIDIA GPUs2 May 2026
- 2025EyeSeg: An Uncertainty-Aware Eye Segmentation Framework for AR/VR13 Jul 2025
- 2025A3FR: Agile 3D Gaussian Splatting with Incremental Gaze Tracked Foveated Rendering in Virtual Reality5 Jul 2025
- 2025Stable Tracking of Eye Gaze Direction During Ophthalmic Surgery1 Jul 2025
- 2025Trade-offs in Privacy-Preserving Eye Tracking through Iris Obfuscation: A Benchmarking Study14 Apr 2025
- 2025Iris Style Transfer: Enhancing Iris Recognition with Style Features and Privacy Preservation through Neural Style Transfer6 Mar 2025
- 2025FlatTrack: Eye-tracking with ultra-thin lensless cameras26 Jan 2025
- 2024FovealNet: Advancing AI-Driven Gaze Tracking Solutions for Optimized Foveated Rendering System Performance in Virtual Reality12 Dec 2024
- 2024Topology and Intersection-Union Constrained Loss Function for Multi-Region Anatomical Segmentation in Ocular Images1 Nov 2024
- 2024BOXR: Body and head motion Optimization framework for eXtended Reality16 Oct 2024
12 newest of 33 All 33 (JSON)