FaithfulFaces: Pose-Faithful Facial Identity Preservation for Text-to-Video Generation
Not on the map. Why?
Abstract (arXiv)
Identity-preserving text-to-video generation (IPT2V) empowers users to produce diverse and imaginative videos with consistent human facial identity. Despite recent progress, existing methods often suffer from significant identity distortion under large facial pose variations or facial occlusions. In this paper, we propose textitFaithfulFaces, a pose-faithful facial identity preservation learning framework to improve IPT2V in complex dynamic scenes. The key of FaithfulFaces is a pose-shared identity aligner that refines and aligns facial poses across distinct views via a pose-shared dictionary and a pose variation-identity invariance constraint. By mapping single-view inputs into a global facial pose representation with explicit Euler angle embeddings, FaithfulFaces provides a pose-faithful facial prior that guides generative foundations toward robust identity-preserving generation. In particular, we develop a specialized pipeline to curate a high-quality video dataset featuring substantial facial pose diversity. Extensive experiments demonstrate that FaithfulFaces achieves state-of-the-art performance, maintaining superior identity consistency and structural clarity even as pose changes and occlusions occur.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 29 of its 34 references that are in the map. First posted on arXiv 6 May 2026.
Builds on
29 of 34 references.
References · 29
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
- 2018Representation Learning with Contrastive Predictive Codingcited by 7,777
- 2022Scalable Diffusion Models with Transformerscited by 6,054
- 2022Flow Matching for Generative Modelingcited by 5,702
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2015Rethinking the Inception Architecture for Computer Visioncited by 5,475
- 2017Neural Discrete Representation Learningcited by 4,712
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
- 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,424
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
17 more
- 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
- 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuningcited by 1,433
- 2024Movie Gen: A Cast of Media Foundation Modelscited by 644
- 2025VACE: All-in-One Video Creation and Editingcited by 479
- 2020CurricularFace: Adaptive Curriculum Learning Loss for Deep Face Recognitioncited by 321
- 2025Seedance 1.0: Exploring the Boundaries of Video Generation Modelscited by 259
- 2024Identity-Preserving Text-to-Video Generation by Frequency Decompositioncited by 158
- 2025Phantom: Subject-consistent video generation via cross-modal alignmentcited by 129
- 2024ID-Animator: Zero-Shot Identity-Preserving Human Video Generationcited by 124
- 2025HunyuanCustom: A Multimodal-Driven Architecture for Customized Video Generationcited by 87
- 2025SkyReels-A2: Compose Anything in Video Diffusion Transformerscited by 73
- 20226D Rotation Representation For Unconstrained Head Pose Estimationcited by 64
- 2022Multi-modal Alignment using Representation Codebookcited by 63
- 2025MagicMirror: ID-Preserved Video Generation in Video Diffusion Transformerscited by 34
- 2025Stand-In: A Lightweight and Plug-and-Play Identity Control for Video Generationcited by 28
- 2025MAGREF: Masked Guidance for Any-Reference Video Generation with Subject Disentanglementcited by 23
- 2025FantasyID: Face Knowledge Enhanced ID-Preserving Video Generationcited by 18
Built on by
Not cited yet.