mlsanityData to 14 Oct 2026

Identity-Preserving Text-to-Video Generation via Training-Free Prompt, Image, and Guidance Enhancement

arXiv 2509.01362 ↗First posted 1 Sep 2025cs.CV cs.MMcited by 8

Not on the map. Why?

Abstract (arXiv)

Identity-preserving text-to-video (IPT2V) generation creates videos faithful to both a reference subject image and a text prompt. While fine-tuning large pretrained video diffusion models on ID-matched data achieves state-of-the-art results on IPT2V, data scarcity and high tuning costs hinder broader improvement. We thus introduce a Training-Free Prompt, Image, and Guidance Enhancement (TPIGE) framework that bridges the semantic gap between the video description and the reference image and design sampling guidance that enhances identity preservation and video quality, achieving performance gains at minimal cost.Specifically, we first propose Face Aware Prompt Enhancement, using GPT-4o to enhance the text prompt with facial details derived from the reference image. We then propose Prompt Aware Reference Image Enhancement, leveraging an identity-preserving image generator to refine the reference image, rectifying conflicts with the text prompt. The above mutual refinement significantly improves input quality before video generation. Finally, we propose ID-Aware Spatiotemporal Guidance Enhancement, utilizing unified gradients to optimize identity preservation and video quality jointly during generation.Our method outperforms prior work and is validated by automatic and human evaluations on a 1000 video test set, winning first place in the ACM Multimedia 2025 Identity-Preserving Video Generation Challenge, demonstrating state-of-the-art performance and strong generality. The code is available at https://github.com/Andyplus1/IPT2V.git.

Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Builds on 26 of its 40 references that are in the map. First posted on arXiv 1 Sep 2025.

Builds on

26 of 40 references.

References · 26

  1. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
  2. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
  3. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
  4. 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
  5. 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
  6. 2025VACE: All-in-One Video Creation and Editingcited by 479
  7. 2023PhotoMaker: Customizing Realistic Human Photos via Stacked ID Embeddingcited by 328
  8. 2020CurricularFace: Adaptive Curriculum Learning Loss for Deep Face Recognitioncited by 321
  9. 2023DreamVideo: Composing Your Dream Videos with Customized Subject and Motioncited by 188
  10. 2023AMT: All-Pairs Multi-Field Transforms for Efficient Frame Interpolationcited by 180
  11. 2024GME: Improving Universal Multimodal Retrieval by Multimodal LLMscited by 170
  12. 2024Vidu: a Highly Consistent, Dynamic and Skilled Text-to-Video Generator with Diffusion Modelscited by 160
14 more
  1. 2024Identity-Preserving Text-to-Video Generation by Frequency Decompositioncited by 158
  2. 2024ID-Animator: Zero-Shot Identity-Preserving Human Video Generationcited by 124
  3. 2025ACE++: Instruction-Based Image Creation and Editing via Context-Aware Content Fillingcited by 95
  4. 2024MotionBooth: Motion-Aware Customized Text-to-Video Generationcited by 93
  5. 2024CustomVideo: Customizing Text-to-Video Generation with Multiple Subjectscited by 77
  6. 2024Magic-Me: Identity-Specific Video Customized Diffusioncited by 59
  7. 2024EvaGaussians: Event Stream Assisted Gaussian Splatting from Blurry Imagescited by 56
  8. 2024MagicTime: Time-lapse Video Generation Models as Metamorphic Simulatorscited by 51
  9. 2024Still-Moving: Customized Video Generation without Customized Video Datacited by 50
  10. 2024Cycle3D: High-quality and Consistent Image-to-3D Generation via Generation-Reconstruction Cyclecited by 36
  11. 2025Movie Weaver: Tuning-Free Multi-Concept Video Personalization with Anchored Promptscited by 29
  12. 2024Diff-BGM: A Diffusion Model for Video Background Music Generationcited by 23
  13. 2025ConMo: Controllable Motion Disentanglement and Recomposition for Zero-Shot Motion Transfercited by 12
  14. 2025Balancing Preservation and Modification: A Region and Semantic Aware Metric for Instruction-Based Image Editingcited by 10

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 2; 2026: 6.

8 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025MoCA: Identity-Preserving Text-to-Video Generation via Mixture of Cross Attention
  2. 2025Identity-Preserving Image-to-Video Generation via Reward-Guided Optimization
  3. 2025FantasyID: Face Knowledge Enhanced ID-Preserving Video Generation
  4. 2025IP-FaceDiff: Identity-Preserving Facial Video Editing with Diffusion
  5. 2025MagicMirror: ID-Preserved Video Generation in Video Diffusion Transformers
  6. 2026HarmoView: Harmonizing Multi-View Constraints for Identity-Consistent Video Generation
  7. 2025ASemConsist: Adaptive Semantic Feature Control for Training-Free Identity-Consistent Generation
  8. 2023Text2Video-Zero: Text-to-Image Diffusion Models are Zero-Shot Video Generators