mlsanityData to 7 Oct 2026

EyeMakeYou: Identity-, Task-, and Subjective-State-Conditioned Diffusion for High-Frequency Gaze Synthesis

arXiv 2609.04501 ↗First posted 3 Sep 2026cs.HC cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Eye movement biometrics (EMB) is an emerging behavioral modality for user authentication, particularly in virtual- and augmented-reality systems, where gaze dynamics contain distinctive subject-specific features. However, robust EMB systems require diverse, high-quality gaze recordings that are expensive to collect and often unavailable at the scale needed for model development. Generative models can mitigate data scarcity, but existing methods either synthesize generic gaze behavior or personalize signals primarily by identity, without jointly representing the user's task and subjective state. Consequently, generated signals may appear visually realistic while failing to retain the behavioral properties required for biometric applications. To address this limitation, we propose EyeMakeYou, a multi-conditional denoising diffusion framework for subject-specific, high-frequency gaze synthesis. EyeMakeYou generates 5-s, 1000-Hz bivariate gaze-velocity sequences from an identity-removed reference trajectory and conditions the denoising process on an identity embedding, a task embedding, and self-reported ratings of overall difficulty, mental tiredness, and eye tiredness. Its objective combines diffusion noise prediction and identity preservation with multi-resolution spectral, drift-consistency, and event-weighted local-smoothness losses. Experiments on GazeBase show that EyeMakeYou achieves higher median spatial accuracy and greater real--synthetic similarity in the embedding feature space than the existing generative approaches, while retaining selected task-dependent associations between subjective reports and oculomotor features. These findings support conditional diffusion as a practical approach for augmenting gaze datasets for biometric and interactive applications.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 21 of its 56 references that are in the map. First posted on arXiv 3 Sep 2026.

Builds on

21 of 56 references.

References · 21

  1. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  2. 2022Generative Adversarial Networkscited by 5,603
  3. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
  4. 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,736
  5. 2020DiffWave: A Versatile Diffusion Model for Audio Synthesiscited by 1,339
  6. 2015Rendering of Eyes for Eye-Shape Registration and Gaze Estimationcited by 49
  7. 2019A survey of advances in vision-based vehicle re-identificationcited by 36
  8. 2018PathGAN: Visual Scanpath Prediction with Generative Adversarial Networkscited by 32
  9. 2020GazeBase: A Large-Scale, Multi-Stimulus, Longitudinal Eye Movement Datasetcited by 20
  10. 2020Fully Convolutional Neural Networks for Raw Eye Tracking Data Segmentation, Generation, and Reconstructioncited by 12
  11. 2018Eye movement velocity and gaze data generator for evaluation, robustness testing and assess of eye tracking software and visualization toolscited by 11
  12. 2018Privacy-Aware Eye Tracking Using Differential Privacycited by 11
9 more
  1. 2021Eye Know You: Metric Learning for End-to-end Biometric Authentication Using Eye Movements from a Longitudinal Datasetcited by 11
  2. 2018Eye movement simulation and detector creation to reduce laborious parameter adjustmentscited by 10
  3. 2019Authentication of Smartphone Users Using Behavioral Biometricscited by 6
  4. 2019Evaluating the Data Quality of Eye Tracking Signals from a Virtual Reality System: Case Study using SMI's Eye-Tracking HTC Vivecited by 6
  5. 2024Evaluation of Eye Tracking Signal Quality for Virtual Reality Applications: A Case Study in the Meta Quest Procited by 6
  6. 2022HPCGen: Hierarchical K-Means Clustering and Level Based Principal Components for Scan Path Genarationcited by 5
  7. 2024DiffEyeSyn: Diffusion-based User-specific Eye Movement Synthesiscited by 3
  8. 2023Determining Which Sine Wave Frequencies Correspond to Signal and Which Correspond to Noise in Eye-Tracking Time-Seriescited by 2
  9. 2025Quantitative and Qualitative Comparison of Generative Models for Subject-Specific Gaze Synthesis: Diffusion vs GANscited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Diffusion models for eye-gaze trajectory generation using position and velocity representations
  2. 2026GazeDiT: Gaze-Accurate Diffusion Image Generation for Eye Tracking via Spatial Conditioning
  3. 2025HAGI++: Head-Assisted Gaze Imputation and Generation
  4. 2024DiffGaze: A Diffusion Model for Continuous Gaze Sequence Generation on 360deg Images
  5. 2026A Synthetic Eye Movement Dataset for Script Reading Detection: Real Trajectory Replay on a 3D Simulator
  6. 2023GazeMoDiff: Gaze-guided Diffusion Model for Stochastic Human Motion Prediction
  7. 2024Modeling State Shifting via Local-Global Distillation for Event-Frame Gaze Tracking
  8. 2026GazeFlow: From Human Gaze Behavior to Generative Egocentric Gaze Prediction