DeepWarp: Photorealistic Image Resynthesis for Gaze Manipulation
Not on the map. Why?
Abstract (arXiv)
In this work, we consider the task of generating highly-realistic images of a given face with a redirected gaze. We treat this problem as a specific instance of conditional image generation and suggest a new deep architecture that can handle this task very well as revealed by numerical comparison with prior art and a user study. Our deep architecture performs coarse-to-fine warping with an additional intensity correction of individual pixels. All these operations are performed in a feed-forward manner, and the parameters associated with different operations are learned jointly in the end-to-end fashion. After learning, the resulting neural network can synthesize images with manipulated gaze, while the redirection angle can be selected arbitrarily from a certain range and provided as an input to the network.
Key facts. Cited by 27 papers in the map (data through 14 Oct 2026). First posted on arXiv 25 Jul 2016.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 9; 2022: 6; 2023: 5; 2024: 3; 2025: 1; 2026: 3.
27 papers.
Sort:
By area:
- 2021GAN Inversion: A Surveycited by 367
- 2021GAN-Supervised Dense Visual Alignmentcited by 62
- 2021Automatic Gaze Analysis: A Survey of Deep Learning based Approachescited by 33
- 2024TRIPS: Trilinear Point Splatting for Real-Time Radiance Field Renderingcited by 33
- 2022EyeNeRF: A Hybrid Representation for Photorealistic Synthesis, Animation and Relighting of Human Eyescited by 14
- 2023VET: Visual Error Tomography for Point Cloud Completion and High-Quality Neural Renderingcited by 14
- 2022GazeNeRF: 3D-Aware Gaze Redirection with Neural Radiance Fieldscited by 12
- 2021Free-Viewpoint RGB-D Human Performance Capture and Renderingcited by 11
- 2021MTGLS: Multi-Task Gaze Estimation with Limited Supervisioncited by 10
- 2022Free-HeadGAN: Neural Talking Head Synthesis with Explicit Gaze Controlcited by 10
- 2021Where Do Deep Fakes Look? Synthetic Face Detection via Gaze Trackingcited by 9
- 2021ADOP: Approximate Differentiable One-Pixel Point Renderingcited by 9
15 more
- 2024GazeGaussian: High-Fidelity Gaze Redirection with 3D Gaussian Splattingcited by 9
- 2021DyStyle: Dynamic Neural Network for Multi-Attribute-Conditioned Style Editingcited by 7
- 2023ReDirTrans: Latent-to-Latent Translation for Gaze and Head Redirectioncited by 6
- 2021CUDA-GHR: Controllable Unsupervised Domain Adaptation for Gaze and Head Redirectioncited by 5
- 2022Unsupervised High-Resolution Portrait Gaze Correction and Animationcited by 5
- 2023iWarpGAN: Disentangling Identity and Style to Generate Synthetic Iris Imagescited by 4
- 2022Polymorphic-GAN: Generating Aligned Samples across Multiple Domains with Learned Morph Mapscited by 3
- 2025Differential Contrastive Training for Gaze Estimationcited by 3
- 2024Learning Gaze-aware Compositional GANcited by 2
- 2022'Labelling the Gaps': A Weakly Supervised Automatic Eye Gaze Estimationcited by 0
- 2023EyeBAG: Accurate Control of Eye Blink and Gaze Based on Data Augmentation Leveraging Style Mixingcited by 0
- 2023Angle Range and Identity Similarity Enhanced Gaze and Head Redirection based on Synthetic datacited by 0
- 2026Neural Image Space Tessellation effectcited by 0
- 2026GazePrior: Zero-Shot AR/VR Eye Tracking via Learned 3D Gaze Reconstructioncited by 0
- 2026GazeDiT: Gaze-Accurate Diffusion Image Generation for Eye Tracking via Spatial Conditioningcited by 0
- 2026GazeDiT: Gaze-Accurate Diffusion Image Generation for Eye Tracking via Spatial Conditioning15 Sep 2026
- 2026GazePrior: Zero-Shot AR/VR Eye Tracking via Learned 3D Gaze Reconstruction21 May 2026
- 2026Neural Image Space Tessellation effect27 Feb 2026
- 2025Differential Contrastive Training for Gaze Estimation27 Feb 2025
- 2024GazeGaussian: High-Fidelity Gaze Redirection with 3D Gaussian Splatting20 Nov 2024
- 2024Learning Gaze-aware Compositional GAN31 May 2024
- 2024TRIPS: Trilinear Point Splatting for Real-Time Radiance Field Rendering11 Jan 2024
- 2023VET: Visual Error Tomography for Point Cloud Completion and High-Quality Neural Rendering8 Nov 2023
- 2023Angle Range and Identity Similarity Enhanced Gaze and Head Redirection based on Synthetic data11 Sep 2023
- 2023EyeBAG: Accurate Control of Eye Blink and Gaze Based on Data Augmentation Leveraging Style Mixing30 Jun 2023
- 2023iWarpGAN: Disentangling Identity and Style to Generate Synthetic Iris Images21 May 2023
- 2023ReDirTrans: Latent-to-Latent Translation for Gaze and Head Redirection19 May 2023
15 more
- 2022GazeNeRF: 3D-Aware Gaze Redirection with Neural Radiance Fields8 Dec 2022
- 2022Free-HeadGAN: Neural Talking Head Synthesis with Explicit Gaze Control3 Aug 2022
- 2022'Labelling the Gaps': A Weakly Supervised Automatic Eye Gaze Estimation3 Aug 2022
- 2022Unsupervised High-Resolution Portrait Gaze Correction and Animation1 Jul 2022
- 2022EyeNeRF: A Hybrid Representation for Photorealistic Synthesis, Animation and Relighting of Human Eyes16 Jun 2022
- 2022Polymorphic-GAN: Generating Aligned Samples across Multiple Domains with Learned Morph Maps6 Jun 2022
- 2021Free-Viewpoint RGB-D Human Performance Capture and Rendering27 Dec 2021
- 2021GAN-Supervised Dense Visual Alignment9 Dec 2021
- 2021MTGLS: Multi-Task Gaze Estimation with Limited Supervision23 Oct 2021
- 2021ADOP: Approximate Differentiable One-Pixel Point Rendering13 Oct 2021
- 2021DyStyle: Dynamic Neural Network for Multi-Attribute-Conditioned Style Editing22 Sep 2021
- 2021Automatic Gaze Analysis: A Survey of Deep Learning based Approaches12 Aug 2021
- 2021CUDA-GHR: Controllable Unsupervised Domain Adaptation for Gaze and Head Redirection21 Jun 2021
- 2021GAN Inversion: A Survey14 Jan 2021
- 2021Where Do Deep Fakes Look? Synthetic Face Detection via Gaze Tracking4 Jan 2021
- 2021GAN Inversion: A Surveycited by 367
- 2021GAN-Supervised Dense Visual Alignmentcited by 62
- 2021Automatic Gaze Analysis: A Survey of Deep Learning based Approachescited by 33
- 2024TRIPS: Trilinear Point Splatting for Real-Time Radiance Field Renderingcited by 33
- 2022EyeNeRF: A Hybrid Representation for Photorealistic Synthesis, Animation and Relighting of Human Eyescited by 14
- 2023VET: Visual Error Tomography for Point Cloud Completion and High-Quality Neural Renderingcited by 14
- 2022GazeNeRF: 3D-Aware Gaze Redirection with Neural Radiance Fieldscited by 12
- 2021Free-Viewpoint RGB-D Human Performance Capture and Renderingcited by 11
- 2021MTGLS: Multi-Task Gaze Estimation with Limited Supervisioncited by 10
- 2022Free-HeadGAN: Neural Talking Head Synthesis with Explicit Gaze Controlcited by 10
- 2021Where Do Deep Fakes Look? Synthetic Face Detection via Gaze Trackingcited by 9
- 2021ADOP: Approximate Differentiable One-Pixel Point Renderingcited by 9
12 most cited of 26 All 26 (JSON)
- 2026GazePrior: Zero-Shot AR/VR Eye Tracking via Learned 3D Gaze Reconstruction21 May 2026
- 2026Neural Image Space Tessellation effect27 Feb 2026
- 2025Differential Contrastive Training for Gaze Estimation27 Feb 2025
- 2024GazeGaussian: High-Fidelity Gaze Redirection with 3D Gaussian Splatting20 Nov 2024
- 2024Learning Gaze-aware Compositional GAN31 May 2024
- 2024TRIPS: Trilinear Point Splatting for Real-Time Radiance Field Rendering11 Jan 2024
- 2023VET: Visual Error Tomography for Point Cloud Completion and High-Quality Neural Rendering8 Nov 2023
- 2023Angle Range and Identity Similarity Enhanced Gaze and Head Redirection based on Synthetic data11 Sep 2023
- 2023EyeBAG: Accurate Control of Eye Blink and Gaze Based on Data Augmentation Leveraging Style Mixing30 Jun 2023
- 2023iWarpGAN: Disentangling Identity and Style to Generate Synthetic Iris Images21 May 2023
- 2023ReDirTrans: Latent-to-Latent Translation for Gaze and Head Redirection19 May 2023
- 2022GazeNeRF: 3D-Aware Gaze Redirection with Neural Radiance Fields8 Dec 2022
12 newest of 26 All 26 (JSON)