mlsanityData to 14 Oct 2026

FaithfulFaces: Pose-Faithful Facial Identity Preservation for Text-to-Video Generation

arXiv 2605.04702 ↗First posted 6 May 2026cs.CV cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Identity-preserving text-to-video generation (IPT2V) empowers users to produce diverse and imaginative videos with consistent human facial identity. Despite recent progress, existing methods often suffer from significant identity distortion under large facial pose variations or facial occlusions. In this paper, we propose textitFaithfulFaces, a pose-faithful facial identity preservation learning framework to improve IPT2V in complex dynamic scenes. The key of FaithfulFaces is a pose-shared identity aligner that refines and aligns facial poses across distinct views via a pose-shared dictionary and a pose variation-identity invariance constraint. By mapping single-view inputs into a global facial pose representation with explicit Euler angle embeddings, FaithfulFaces provides a pose-faithful facial prior that guides generative foundations toward robust identity-preserving generation. In particular, we develop a specialized pipeline to curate a high-quality video dataset featuring substantial facial pose diversity. Extensive experiments demonstrate that FaithfulFaces achieves state-of-the-art performance, maintaining superior identity consistency and structural clarity even as pose changes and occlusions occur.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 29 of its 34 references that are in the map. First posted on arXiv 6 May 2026.

Builds on

29 of 34 references.

References · 29

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  3. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
  4. 2018Representation Learning with Contrastive Predictive Codingcited by 7,777
  5. 2022Scalable Diffusion Models with Transformerscited by 6,054
  6. 2022Flow Matching for Generative Modelingcited by 5,702
  7. 2025Qwen2.5-VL Technical Reportcited by 5,587
  8. 2015Rethinking the Inception Architecture for Computer Visioncited by 5,475
  9. 2017Neural Discrete Representation Learningcited by 4,712
  10. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
  11. 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,424
  12. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
17 more
  1. 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
  2. 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuningcited by 1,433
  3. 2024Movie Gen: A Cast of Media Foundation Modelscited by 644
  4. 2025VACE: All-in-One Video Creation and Editingcited by 479
  5. 2020CurricularFace: Adaptive Curriculum Learning Loss for Deep Face Recognitioncited by 321
  6. 2025Seedance 1.0: Exploring the Boundaries of Video Generation Modelscited by 259
  7. 2024Identity-Preserving Text-to-Video Generation by Frequency Decompositioncited by 158
  8. 2025Phantom: Subject-consistent video generation via cross-modal alignmentcited by 129
  9. 2024ID-Animator: Zero-Shot Identity-Preserving Human Video Generationcited by 124
  10. 2025HunyuanCustom: A Multimodal-Driven Architecture for Customized Video Generationcited by 87
  11. 2025SkyReels-A2: Compose Anything in Video Diffusion Transformerscited by 73
  12. 20226D Rotation Representation For Unconstrained Head Pose Estimationcited by 64
  13. 2022Multi-modal Alignment using Representation Codebookcited by 63
  14. 2025MagicMirror: ID-Preserved Video Generation in Video Diffusion Transformerscited by 34
  15. 2025Stand-In: A Lightweight and Plug-and-Play Identity Control for Video Generationcited by 28
  16. 2025MAGREF: Masked Guidance for Any-Reference Video Generation with Subject Disentanglementcited by 23
  17. 2025FantasyID: Face Knowledge Enhanced ID-Preserving Video Generationcited by 18

Built on by

Not cited yet.