Customizing Video Portraits via Identity-ActionDecoupling
Not on the map. Why?
Abstract (arXiv)
Identity-Preserving Text-to-Video Generation (IPT2V) seeks to synthesize a temporally coherent video from a reference image and a textual description, while simultaneously preserving the subject's identity and allowing fine-grained control over facial dynamics. Although recent methods such as ID-Animator and ConsisID inject identity features only at inference time, they ignored the ID-irrelevant information contained in Facial embedding, leading to monotonous or inaccurate facial movements that poorly follow the prompt. We introduce Identity-Action Decoupling (IaD) framework as well as two loss function Identity Decoupling Loss and Text Alignment Loss to solve this problem. Without any subject-specific fine-tuning, IaD yields videos that (1) maintain cross-temporal identity consistency and (2) exhibit rich, controllable expressions and scene variations that closely match the input text.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 25 of its 40 references that are in the map. First posted on arXiv 21 Jun 2026.
Builds on
25 of 40 references.
References · 25
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2020Denoising Diffusion Implicit Modelscited by 9,655
- 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
- 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,286
- 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,388
- 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,231
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,198
- 2024InstantID: Zero-shot Identity-Preserving Generation in Secondscited by 431
- 2023DreamVideo: Composing Your Dream Videos with Customized Subject and Motioncited by 186
- 2024Identity-Preserving Text-to-Video Generation by Frequency Decompositioncited by 155
13 more
- 2024ID-Animator: Zero-Shot Identity-Preserving Human Video Generationcited by 122
- 2023PortraitBooth: A Versatile Portrait Model for Fast Identity-preserved Personalizationcited by 77
- 2024Still-Moving: Customized Video Generation without Customized Video Datacited by 49
- 2024InstantFamily: Masked Attention for Zero-shot Multi-ID Image Generationcited by 30
- 2024PersonalVideo: High ID-Fidelity Video Customization without Dynamic and Semantic Degradationcited by 29
- 2024IDProtector: An Adversarial Noise Encoder to Protect Against ID-Preserving Image Generationcited by 21
- 2025CINEMA: Coherent Multi-Subject Video Generation via MLLM-Based Guidancecited by 19
- 2025Ingredients: Blending Custom Photos with Video Diffusion Transformerscited by 13
- 2024MovieCharacter: A Tuning-Free Framework for Controllable Character Video Synthesiscited by 12
- 2025CuES: A Curiosity-driven and Environment-grounded Synthesis Framework for Agentic RLcited by 8
- 2024Real-time Identity Defenses against Malicious Personalization of Diffusion Modelscited by 5
- 2026Video Generation Models as World Models: Efficient Paradigms, Architectures and Algorithmscited by 5
- 2024Hi-EF: Benchmarking Emotion Forecasting in Human-interactioncited by 1
Built on by
Not cited yet.