mlsanityData to 7 Oct 2026

Diffusion models for eye-gaze trajectory generation using position and velocity representations

arXiv 2609.05522 ↗First posted 1 Sep 2026cs.CV cs.AI cs.NEcited by 0

On the map: Diffusion models → Video generation

Abstract (arXiv)

Eye-tracking data are expensive to collect, requiring specialized hardware and controlled laboratory conditions, and difficult to share because of privacy constraints. We address this using two complementary denoising diffusion probabilistic models (DDPMs) for unconditional generation of eye-gaze dynamics from visual-search data. Both use an identical FiLM-conditioned one-dimensional U-Net with self-attention (19.35,M parameters), trained on 8,s sliding-window sequences from 28 participants. One model generates raw two-dimensional gaze-position sequences, while the other generates two-component velocity sequences; each uses representation-specific preprocessing, training settings, data partitions, and evaluation protocols. Both are evaluated across three independent training seeds, with aggregated metrics reported as mean,±,SD. The position-space model achieves a mean Jensen-Shannon (JS) divergence of 0.016±0.004 across nine kinematic features, with the highest feature-wise mean below 0.030, fixation duration within 2% of real data, and a Fr'echet Gaze Distance more than an order of magnitude below statistical and Markovian baselines. Under a Train-on-Synthetic-Test-on-Real protocol, synthetic-only training achieves R2=0.66±0.02, or 82.7% of the real-data R2 point estimate. The velocity-space model achieves a mean JS divergence of 0.0065 across velocity components, speed, log-speed, and turning angle, with a maximum of 0.015±0.005. Reconstructed path length is less accurate (0.21±0.02 versus 0.03±0.01 in position space), although the protocols differ. Overall, unconditional diffusion captures local gaze kinematics and short-range temporal and directional structure, while long-range properties such as saccade counts and cumulative path geometry remain targets for future conditioned models.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Video generation, one of 14 directions in Diffusion models. Builds on 21 of its 49 references that are in the map. First posted on arXiv 1 Sep 2026.

Builds on

21 of 49 references.

Closest ancestors · 2

Same direction, newest first

  1. 2025DiffEye: Diffusion-Based Continuous Eye-Tracking Data Generation Conditioned on Natural Images20 Sep
  2. 2025Modeling Human Gaze Behavior with Diffusion Models for Unified Scanpath Prediction30 Jul

Other references · 19

  1. 2017Attention Is All You Needcited by 59,932
  2. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  3. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  4. 2020Denoising Diffusion Implicit Modelscited by 9,655
  5. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
  6. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
  7. 2016SGDR: Stochastic Gradient Descent with Warm Restartscited by 4,993
  8. 2017FiLM: Visual Reasoning with a General Conditioning Layercited by 2,286
  9. 2017Sigmoid-Weighted Linear Units for Neural Network Function Approximation in Reinforcement Learningcited by 935
  10. 2017Real-valued (Medical) Time Series Generation with Recurrent Conditional GANscited by 329
  11. 2018GAN-based Synthetic Medical Image Augmentation for increased CNN Performance in Liver Lesion Classificationcited by 242
  12. 2023Efficient Diffusion Training via Min-SNR Weighting Strategycited by 242
7 more
  1. 2022Diffusion-based Time Series Imputation and Forecasting with Structured State Space Modelscited by 195
  2. 2019Don't Blame the ELBO! A Linear VAE Perspective on Posterior Collapsecited by 120
  3. 2024The Rise of Diffusion Models in Time-Series Forecastingcited by 25
  4. 2023Synthetic ECG Signal Generation using Probabilistic Diffusion Modelscited by 22
  5. 2024Modeling stochastic eye tracking data: A comparison of quantum generative adversarial networks and Markov modelscited by 2
  6. 2024Modeling Eye Gaze Velocity Trajectories using GANs with Spectral Loss for Enhanced Fidelitycited by 2
  7. 2025Identification of fixations and saccades in eye-tracking data using adaptive threshold-based methodcited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026GazeDiT: Gaze-Accurate Diffusion Image Generation for Eye Tracking via Spatial Conditioning
  2. 2024DiffGaze: A Diffusion Model for Continuous Gaze Sequence Generation on 360deg Images
  3. 2026Infinite Gaze Generation for Videos with Autoregressive Diffusion
  4. 2024Modeling State Shifting via Local-Global Distillation for Event-Frame Gaze Tracking
  5. 2026EyeMakeYou: Identity-, Task-, and Subjective-State-Conditioned Diffusion for High-Frequency Gaze Synthesis
  6. 2023GazeMoDiff: Gaze-guided Diffusion Model for Stochastic Human Motion Prediction
  7. 2026GazeFlow: From Human Gaze Behavior to Generative Egocentric Gaze Prediction
  8. 2026GazeD: Context-Aware Diffusion for Accurate 3D Gaze Estimation