# Improving Few-Shot User-Specific Gaze Adaptation via Gaze Redirection Synthesis

arXiv: https://arxiv.org/abs/1904.10638 · HTML: https://mlsanity.com/paper/1904.10638/

## Key facts

- Cited by 43 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 24 Apr 2019.

## Built on by (most cited first, 30 of 43)

- [Appearance-based Gaze Estimation With Deep Learning: A Review and Benchmark](https://mlsanity.com/paper/2104.12668/) (2021)
- [PureGaze: Purifying Gaze Feature for Generalizable Gaze Estimation](https://mlsanity.com/paper/2103.13173/) (2021)
- [Generalizing Gaze Estimation with Outlier-guided Collaborative Adaptation](https://mlsanity.com/paper/2107.13780/) (2021)
- [Automatic Gaze Analysis: A Survey of Deep Learning based Approaches](https://mlsanity.com/paper/2108.05479/) (2021)
- [Synthetic Data in Human Analysis: A Survey](https://mlsanity.com/paper/2208.09191/) (2022)
- [Multimodal Across Domains Gaze Target Detection](https://mlsanity.com/paper/2208.10822/) (2022)
- [Learning-by-Novel-View-Synthesis for Full-Face Appearance-Based 3D Gaze Estimation](https://mlsanity.com/paper/2201.07927/) (2022)
- [GazeNeRF: 3D-Aware Gaze Redirection with Neural Radiance Fields](https://mlsanity.com/paper/2212.04823/) (2022)
- [Eye-tracked Virtual Reality: A Comprehensive Survey on Methods and Privacy Challenges](https://mlsanity.com/paper/2305.14080/) (2023)
- [3DGazeNet: Generalizing Gaze Estimation with Weak-Supervision from Synthetic Views](https://mlsanity.com/paper/2212.02997/) (2022)
- [MTGLS: Multi-Task Gaze Estimation with Limited Supervision](https://mlsanity.com/paper/2110.12100/) (2021)
- [Free-HeadGAN: Neural Talking Head Synthesis with Explicit Gaze Control](https://mlsanity.com/paper/2208.02210/) (2022)
- [NeRF-Gaze: A Head-Eye Redirection Parametric Model for Gaze Estimation](https://mlsanity.com/paper/2212.14710/) (2022)
- [Rotation-Constrained Cross-View Feature Fusion for Multi-View Appearance-based Gaze Estimation](https://mlsanity.com/paper/2305.12704/) (2023)
- [Enhancing 3D Gaze Estimation in the Wild using Weak Supervision with Gaze Following Labels](https://mlsanity.com/paper/2502.20249/) (2025)
- [LatentGaze: Cross-Domain Gaze Estimation through Gaze-Aware Analytic Latent Code Manipulation](https://mlsanity.com/paper/2209.10171/) (2022)
- [Test-Time Personalization with Meta Prompt for Gaze Estimation](https://mlsanity.com/paper/2401.01577/) (2024)
- [Towards Self-Supervised Gaze Estimation](https://mlsanity.com/paper/2203.10974/) (2022)
- [Jitter Does Matter: Adapting Gaze Estimation to New Domains](https://mlsanity.com/paper/2210.02082/) (2022)
- [ReDirTrans: Latent-to-Latent Translation for Gaze and Head Redirection](https://mlsanity.com/paper/2305.11452/) (2023)
- [High-Fidelity Eye Animatable Neural Radiance Fields for Human Face](https://mlsanity.com/paper/2308.00773/) (2023)
- [CUDA-GHR: Controllable Unsupervised Domain Adaptation for Gaze and Head Redirection](https://mlsanity.com/paper/2106.10852/) (2021)
- [The Story in Your Eyes: An Individual-difference-aware Model for Cross-person Gaze Estimation](https://mlsanity.com/paper/2106.14183/) (2021)
- [Unsupervised High-Resolution Portrait Gaze Correction and Animation](https://mlsanity.com/paper/2207.00256/) (2022)
- [FreeGaze: Resource-efficient Gaze Estimation via Frequency Domain Contrastive Learning](https://mlsanity.com/paper/2209.06692/) (2022)
- [UVAGaze: Unsupervised 1-to-2 Views Adaptation for Gaze Estimation](https://mlsanity.com/paper/2312.15644/) (2023)
- [FLAME: Facial Landmark Heatmap Activated Multimodal Gaze Estimation](https://mlsanity.com/paper/2110.04828/) (2021)
- [FR-Net:A Light-weight FFT Residual Net For Gaze Estimation](https://mlsanity.com/paper/2305.11875/) (2023)
- [Domain-Adaptive Full-Face Gaze Estimation via Novel-View-Synthesis and Feature Disentanglement](https://mlsanity.com/paper/2305.16140/) (2023)
- [Appearance Debiased Gaze Estimation via Stochastic Subject-Wise Adversarial Learning](https://mlsanity.com/paper/2401.13865/) (2024)

## Abstract (arXiv)

As an indicator of human attention gaze is a subtle behavioral cue which can be exploited in many applications. However, inferring 3D gaze direction is challenging even for deep neural networks given the lack of large amount of data (groundtruthing gaze is expensive and existing datasets use different setups) and the inherent presence of gaze biases due to person-specific difference. In this work, we address the problem of person-specific gaze model adaptation from only a few reference training samples. The main and novel idea is to improve gaze adaptation by generating additional training samples through the synthesis of gaze-redirected eye images from existing reference samples. In doing so, our contributions are threefold: (i) we design our gaze redirection framework from synthetic data, allowing us to benefit from aligned training sample pairs to predict accurate inverse mapping fields; (ii) we proposed a self-supervised approach for domain adaptation; (iii) we exploit the gaze redirection to improve the performance of person-specific gaze estimation. Extensive experiments on two public datasets demonstrate the validity of our gaze retargeting and gaze estimation framework.