mlsanityData to 7 Oct 2026

PrivateGaze: Preserving User Privacy in Black-box Mobile Gaze Tracking Services

arXiv 2408.00950 ↗First posted 1 Aug 2024cs.CVcited by 4

Not on the map. Why?

Abstract (arXiv)

Eye gaze contains rich information about human attention and cognitive processes. This capability makes the underlying technology, known as gaze tracking, a critical enabler for many ubiquitous applications and has triggered the development of easy-to-use gaze estimation services. Indeed, by utilizing the ubiquitous cameras on tablets and smartphones, users can readily access many gaze estimation services. In using these services, users must provide their full-face images to the gaze estimator, which is often a black box. This poses significant privacy threats to the users, especially when a malicious service provider gathers a large collection of face images to classify sensitive user attributes. In this work, we present PrivateGaze, the first approach that can effectively preserve users' privacy in black-box gaze tracking services without compromising gaze estimation performance. Specifically, we proposed a novel framework to train a privacy preserver that converts full-face images into obfuscated counterparts, which are effective for gaze estimation while containing no privacy information. Evaluation on four datasets shows that the obfuscated image can protect users' private information, such as identity and gender, against unauthorized attribute classification. Meanwhile, when used directly by the black-box gaze estimator as inputs, the obfuscated images lead to comparable tracking performance to the conventional, unprotected full-face images.

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 38 of its 102 references that are in the map. First posted on arXiv 1 Aug 2024.

Builds on

38 of 102 references.

References · 38

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  3. 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
  4. 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,415
  5. 2017Towards Deep Learning Models Resistant to Adversarial Attackscited by 6,326
  6. 2018MobileNetV2: Inverted Residuals and Linear Bottleneckscited by 4,773
  7. 2017ShuffleNet: An Extremely Efficient Convolutional Neural Network for Mobile Devicescited by 1,194
  8. 2019FSGAN: Subject Agnostic Face Swapping and Reenactmentcited by 319
  9. 2021SimSwap: An Efficient Framework For High Fidelity Face Swappingcited by 243
  10. 2016Eye Tracking for Everyonecited by 155
  11. 2015Appearance-Based Gaze Estimation in the Wildcited by 153
  12. 2020ETH-XGaze: A Large Scale Dataset for Gaze Estimation under Extreme Head Pose and Gaze Variationcited by 141
26 more
  1. 2020DeepFaceLab: Integrated, flexible and extensible face-swapping frameworkcited by 129
  2. 2016It's Written All Over Your Face: Full-Face Appearance-Based Gaze Estimationcited by 123
  3. 2021One Shot Face Swapping on Megapixelscited by 105
  4. 2017On Face Segmentation, Face Swapping, and Face Perceptioncited by 71
  5. 2020Event Based, Near Eye Gaze Tracking Beyond 10,000Hzcited by 53
  6. 2014Pupil: An Open Source Platform for Pervasive Eye Tracking and Mobile Gaze-based Interactioncited by 43
  7. 2017Adversarial Image Perturbation for Privacy Protection -- A Game Theory Perspectivecited by 38
  8. 2019Adversarial Learning of Privacy-Preserving and Task-Oriented Representationscited by 35
  9. 2018Learning Privacy Preserving Encodings through Adversarial Trainingcited by 30
  10. 2021Smooth-Swap: A Simple Enhancement for Face-Swapping with Smoothnesscited by 30
  11. 2020Self-Learning Transformations for Improving Gaze and Head Redirectioncited by 28
  12. 2021Weakly-Supervised Physically Unconstrained Gaze Estimationcited by 28
  13. 2023Retina : Low-Power Eye Tracking with Event Camera and Spiking Hardwarecited by 27
  14. 2021IdentityDP: Differential Private Identification Protection for Face Imagescited by 24
  15. 2021DP-Image: Differential Privacy for Image Data in Feature Spacecited by 23
  16. 2021A privacy-preserving approach to streaming eye-tracking datacited by 13
  17. 2021Differentially Private Imaging via Latent Space Manipulationcited by 13
  18. 2018Privacy-Aware Eye Tracking Using Differential Privacycited by 11
  19. 2023Face Transformer: Towards High Fidelity and Accurate Face Swappingcited by 11
  20. 2019Detecting Gaze Towards Eyes in Natural Social Interactions and its Use in Child Assessmentcited by 10
  21. 2018PrivacEye: Privacy-Preserving Head-Mounted Eye Tracking Using Egocentric Scene Image and Eye Movement Featurescited by 8
  22. 2019Privacy Preserving Gaze Estimation using Synthetic Images via a Randomized Encoding Based Frameworkcited by 7
  23. 2022Federated Learning for Appearance-based Gaze Estimation in the Wildcited by 7
  24. 2021FICGAN: Facial Identity Controllable GAN for De-identificationcited by 6
  25. 2020The Security-Utility Trade-off for Iris Authentication and Eye Animation for Social Virtual Avatarscited by 5
  26. 2023Introducing Explicit Gaze Constraints to Face Swappingcited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 3; 2026: 1.

4 papers.