mlsanityData to 14 Oct 2026

StyGazeTalk: Learning Stylized Generation of Gaze and Head Dynamics

arXiv 2509.17168 ↗First posted 21 Sep 2025cs.GR cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Gaze and head movements play a central role in expressive 3D media, human-agent interaction, and immersive communication. Existing works often model facial components in isolation and lack mechanisms for generating personalized, style-aware gaze behaviors. We propose StyGazeTalk, a multimodal framework that synthesizes synchronized gaze-head dynamics with controllable styles. To support high-fidelity training, we construct HAGE, a high-precision multimodal dataset containing eye-tracking data, audio, head pose, and 3D facial parameters. Experiments show that our method produces temporally coherent, style-consistent gaze-head motions, enhancing realism in 3D face generation.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 19 of its 40 references that are in the map. First posted on arXiv 21 Sep 2025.

Builds on

19 of 40 references.

References · 19

  1. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
  2. 2017VoxCeleb: a large-scale speaker identification datasetcited by 732
  3. 2020A Lip Sync Expert Is All You Need for Speech to Lip Generation In The Wildcited by 672
  4. 2019MediaPipe: A Framework for Building Perception Pipelinescited by 583
  5. 2021AI Choreographer: Music Conditioned 3D Dance Generation with AIST++cited by 485
  6. 2020Learning an Animatable Detailed 3D Face Model from In-The-Wild Imagescited by 477
  7. 2020MakeItTalk: Speaker-Aware Talking-Head Animationcited by 312
  8. 2021Pose-Controllable Talking Face Generation by Implicitly Modularized Audio-Visual Representationcited by 288
  9. 2019Capture, Learning, and Synthesis of 3D Speaking Stylescited by 259
  10. 2022EMOCA: Emotion Driven Monocular Face Capture and Animationcited by 255
  11. 2021FaceFormer: Speech-Driven 3D Facial Animation with Transformerscited by 209
  12. 2021MeshTalk: 3D Face Animation from Speech using Cross-Modality Disentanglementcited by 190
7 more
  1. 2023CodeTalker: Speech-Driven 3D Facial Animation with Discrete Motion Priorcited by 184
  2. 2021Audio2Head: Audio-driven One-shot Talking-head Generation with Natural Head Motioncited by 149
  3. 2023DiffPoseTalk: Speech-Driven Stylistic 3D Facial Animation and Head Pose Generation via Diffusion Modelscited by 81
  4. 2022Imitator: Personalized Speech-driven 3D Facial Animationcited by 74
  5. 2022Visual Speech-Aware Perceptual 3D Facial Expression Reconstruction from Videoscited by 50
  6. 2022SPACE: Speech-driven Portrait Animation with Controllable Expressioncited by 49
  7. 2021Self-supervised Contrastive Learning of Multi-view Facial Expressionscited by 23

Built on by

Not cited yet.