Identity-Preserving Text-to-Video Generation Guided by Simple yet Effective Spatial-Temporal Decoupled Representations
Not on the map. Why?
Abstract (arXiv)
Identity-preserving text-to-video (IPT2V) generation, which aims to create high-fidelity videos with consistent human identity, has become crucial for downstream applications. However, current end-to-end frameworks suffer a critical spatial-temporal trade-off: optimizing for spatially coherent layouts of key elements (e.g., character identity preservation) often compromises instruction-compliant temporal smoothness, while prioritizing dynamic realism risks disrupting the spatial coherence of visual structures. To tackle this issue, we propose a simple yet effective spatial-temporal decoupled framework that decomposes representations into spatial features for layouts and temporal features for motion dynamics. Specifically, our paper proposes a semantic prompt optimization mechanism and stage-wise decoupled generation paradigm. The former module decouples the prompt into spatial and temporal components. Aligned with the subsequent stage-wise decoupled approach, the spatial prompts guide the text-to-image (T2I) stage to generate coherent spatial features, while the temporal prompts direct the sequential image-to-video (I2V) stage to ensure motion consistency. Experimental results validate that our approach achieves excellent spatiotemporal consistency, demonstrating outstanding performance in identity preservation, text relevance, and video quality. By leveraging this simple yet robust mechanism, our algorithm secures the runner-up position in 2025 ACM MultiMedia Challenge. Our code is available at https://github.com/rain152/IPVG.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 33 of its 51 references that are in the map. First posted on arXiv 7 Jul 2025.
Builds on
33 of 51 references.
References · 33
- 2025Qwen3 Technical Reportcited by 8,195
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
- 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,385
- 2022Video Diffusion Modelscited by 2,280
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,198
- 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,755
- 2023T2I-Adapter: Learning Adapters to Dig out More Controllable Ability for Text-to-Image Diffusion Modelscited by 1,339
- 2021Cascaded Diffusion Models for High Fidelity Image Generationcited by 1,155
- 2025VACE: All-in-One Video Creation and Editingcited by 467
- 2023DynamiCrafter: Animating Open-domain Images with Video Diffusion Priorscited by 463
- 2024InstantID: Zero-shot Identity-Preserving Generation in Secondscited by 431
- 2023PhotoMaker: Customizing Realistic Human Photos via Stacked ID Embeddingcited by 324
21 more
- 2020CurricularFace: Adaptive Curriculum Learning Loss for Deep Face Recognitioncited by 320
- 2025VBench-2.0: Advancing Video Generation Benchmark Suite for Intrinsic Faithfulnesscited by 289
- 2023AMT: All-Pairs Multi-Field Transforms for Efficient Frame Interpolationcited by 177
- 2024Identity-Preserving Text-to-Video Generation by Frequency Decompositioncited by 155
- 2024ID-Animator: Zero-Shot Identity-Preserving Human Video Generationcited by 122
- 2024MotionBooth: Motion-Aware Customized Text-to-Video Generationcited by 92
- 2025HunyuanCustom: A Multimodal-Driven Architecture for Customized Video Generationcited by 84
- 2022High-resolution Iterative Feedback Network for Camouflaged Object Detectioncited by 78
- 2025SkyReels-A2: Compose Anything in Video Diffusion Transformerscited by 72
- 2023AnimateAnything: Fine-Grained Open Domain Image Animation with Motion Guidancecited by 66
- 2024MotionMaster: Training-free Camera Motion Transfer For Video Generationcited by 50
- 2024Still-Moving: Customized Video Generation without Customized Video Datacited by 49
- 2024Moonshot: Towards Controllable Video Generation and Editing with Multimodal Conditionscited by 42
- 2020Face Super-Resolution Guided by 3D Facial Priorscited by 38
- 2025Concat-ID: Towards Universal Identity-Preserving Video Synthesiscited by 28
- 2025EchoVideo: Identity-Preserving Human Video Generation by Multimodal Feature Fusioncited by 12
- 2025HyperLoRA: Parameter-Efficient Adaptive Generation for Portrait Synthesiscited by 10
- 2022Non-Imaging Medical Data Synthesis for Trustworthy AI: A Comprehensive Surveycited by 9
- 2025Identity-Preserving Text-to-Image Generation via Dual-Level Feature Decoupling and Expert-Guided Fusioncited by 2
- 2025MoCA-Video: Motion-Aware Concept Alignment for Consistent Video Editingcited by 2
- 2025ATA: Adaptive Transformation Agent for Text-Guided Subject-Position Variable Background Inpaintingcited by 1
Built on by
Citing papers per year: 2025: 1; 2026: 3.
4 papers.
- 2025Identity-Preserving Image-to-Video Generation via Reward-Guided Optimizationcited by 7
- 2026EntityBench: Towards Entity-Consistent Long-Range Multi-Shot Video Generationcited by 6
- 2026Spatial-Temporal Decoupled Reference Conditioning for Identity-Preserving Text-to-Video Generationcited by 0
- 2026Keyframe-Anchored Identity Preservation for Sequential-Action Video Generationcited by 0
- 2026Keyframe-Anchored Identity Preservation for Sequential-Action Video Generation20 Jul 2026
- 2026Spatial-Temporal Decoupled Reference Conditioning for Identity-Preserving Text-to-Video Generation1 Jun 2026
- 2026EntityBench: Towards Entity-Consistent Long-Range Multi-Shot Video Generation14 May 2026
- 2025Identity-Preserving Image-to-Video Generation via Reward-Guided Optimization16 Oct 2025