Identity-Preserving Text-to-Video Generation via Training-Free Prompt, Image, and Guidance Enhancement
Not on the map. Why?
Abstract (arXiv)
Identity-preserving text-to-video (IPT2V) generation creates videos faithful to both a reference subject image and a text prompt. While fine-tuning large pretrained video diffusion models on ID-matched data achieves state-of-the-art results on IPT2V, data scarcity and high tuning costs hinder broader improvement. We thus introduce a Training-Free Prompt, Image, and Guidance Enhancement (TPIGE) framework that bridges the semantic gap between the video description and the reference image and design sampling guidance that enhances identity preservation and video quality, achieving performance gains at minimal cost.Specifically, we first propose Face Aware Prompt Enhancement, using GPT-4o to enhance the text prompt with facial details derived from the reference image. We then propose Prompt Aware Reference Image Enhancement, leveraging an identity-preserving image generator to refine the reference image, rectifying conflicts with the text prompt. The above mutual refinement significantly improves input quality before video generation. Finally, we propose ID-Aware Spatiotemporal Guidance Enhancement, utilizing unified gradients to optimize identity preservation and video quality jointly during generation.Our method outperforms prior work and is validated by automatic and human evaluations on a 1000 video test set, winning first place in the ACM Multimedia 2025 Identity-Preserving Video Generation Challenge, demonstrating state-of-the-art performance and strong generality. The code is available at https://github.com/Andyplus1/IPT2V.git.
Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Builds on 26 of its 40 references that are in the map. First posted on arXiv 1 Sep 2025.
Builds on
26 of 40 references.
References · 26
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
- 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
- 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
- 2025VACE: All-in-One Video Creation and Editingcited by 479
- 2023PhotoMaker: Customizing Realistic Human Photos via Stacked ID Embeddingcited by 328
- 2020CurricularFace: Adaptive Curriculum Learning Loss for Deep Face Recognitioncited by 321
- 2023DreamVideo: Composing Your Dream Videos with Customized Subject and Motioncited by 188
- 2023AMT: All-Pairs Multi-Field Transforms for Efficient Frame Interpolationcited by 180
- 2024GME: Improving Universal Multimodal Retrieval by Multimodal LLMscited by 170
- 2024Vidu: a Highly Consistent, Dynamic and Skilled Text-to-Video Generator with Diffusion Modelscited by 160
14 more
- 2024Identity-Preserving Text-to-Video Generation by Frequency Decompositioncited by 158
- 2024ID-Animator: Zero-Shot Identity-Preserving Human Video Generationcited by 124
- 2025ACE++: Instruction-Based Image Creation and Editing via Context-Aware Content Fillingcited by 95
- 2024MotionBooth: Motion-Aware Customized Text-to-Video Generationcited by 93
- 2024CustomVideo: Customizing Text-to-Video Generation with Multiple Subjectscited by 77
- 2024Magic-Me: Identity-Specific Video Customized Diffusioncited by 59
- 2024EvaGaussians: Event Stream Assisted Gaussian Splatting from Blurry Imagescited by 56
- 2024MagicTime: Time-lapse Video Generation Models as Metamorphic Simulatorscited by 51
- 2024Still-Moving: Customized Video Generation without Customized Video Datacited by 50
- 2024Cycle3D: High-quality and Consistent Image-to-3D Generation via Generation-Reconstruction Cyclecited by 36
- 2025Movie Weaver: Tuning-Free Multi-Concept Video Personalization with Anchored Promptscited by 29
- 2024Diff-BGM: A Diffusion Model for Video Background Music Generationcited by 23
- 2025ConMo: Controllable Motion Disentanglement and Recomposition for Zero-Shot Motion Transfercited by 12
- 2025Balancing Preservation and Modification: A Region and Semantic Aware Metric for Instruction-Based Image Editingcited by 10
Built on by
Citing papers per year: 2025: 2; 2026: 6.
8 papers.
- 2025Scaling Zero-Shot Reference-to-Video Generationcited by 9
- 2026ARGUS: Stacked Multi-View Identity Mosaic Injection for Subject-Preserving Video Generationcited by 7
- 2025BachVid: Training-Free Video Generation with Consistent Background and Charactercited by 1
- 2026Unleashing Multimodal Large Language Models for Training-free HOI Detection in the Wildcited by 1
- 2026HOMIE: Human-object Centric Video Personalization via Multimodal Intelligent Enhancementcited by 1
- 2026Spatial-Temporal Decoupled Reference Conditioning for Identity-Preserving Text-to-Video Generationcited by 0
- 2026KeyID: Decoupled Drafting and Keyframe Editing for Identity-Preserving Video Generationcited by 0
- 2026Identity-Preserving Text-to-Video Generation via Agentic Enhancement and Semantic Repaircited by 0
- 2026Identity-Preserving Text-to-Video Generation via Agentic Enhancement and Semantic Repair21 Aug 2026
- 2026KeyID: Decoupled Drafting and Keyframe Editing for Identity-Preserving Video Generation17 Aug 2026
- 2026HOMIE: Human-object Centric Video Personalization via Multimodal Intelligent Enhancement20 Jul 2026
- 2026Unleashing Multimodal Large Language Models for Training-free HOI Detection in the Wild15 Jul 2026
- 2026ARGUS: Stacked Multi-View Identity Mosaic Injection for Subject-Preserving Video Generation10 Jun 2026
- 2026Spatial-Temporal Decoupled Reference Conditioning for Identity-Preserving Text-to-Video Generation1 Jun 2026
- 2025Scaling Zero-Shot Reference-to-Video Generation7 Dec 2025
- 2025BachVid: Training-Free Video Generation with Consistent Background and Character24 Oct 2025
Similar, not cited
Close in wording, no citation either way
- 2025MoCA: Identity-Preserving Text-to-Video Generation via Mixture of Cross Attention
- 2025Identity-Preserving Image-to-Video Generation via Reward-Guided Optimization
- 2025FantasyID: Face Knowledge Enhanced ID-Preserving Video Generation
- 2025IP-FaceDiff: Identity-Preserving Facial Video Editing with Diffusion
- 2025MagicMirror: ID-Preserved Video Generation in Video Diffusion Transformers
- 2026HarmoView: Harmonizing Multi-View Constraints for Identity-Consistent Video Generation
- 2025ASemConsist: Adaptive Semantic Feature Control for Training-Free Identity-Consistent Generation
- 2023Text2Video-Zero: Text-to-Image Diffusion Models are Zero-Shot Video Generators