mlsanityData to 7 Oct 2026

Customizing Video Portraits via Identity-ActionDecoupling

arXiv 2606.22347 ↗First posted 21 Jun 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Identity-Preserving Text-to-Video Generation (IPT2V) seeks to synthesize a temporally coherent video from a reference image and a textual description, while simultaneously preserving the subject's identity and allowing fine-grained control over facial dynamics. Although recent methods such as ID-Animator and ConsisID inject identity features only at inference time, they ignored the ID-irrelevant information contained in Facial embedding, leading to monotonous or inaccurate facial movements that poorly follow the prompt. We introduce Identity-Action Decoupling (IaD) framework as well as two loss function Identity Decoupling Loss and Text Alignment Loss to solve this problem. Without any subject-specific fine-tuning, IaD yields videos that (1) maintain cross-temporal identity consistency and (2) exhibit rich, controllable expressions and scene variations that closely match the input text.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 25 of its 40 references that are in the map. First posted on arXiv 21 Jun 2026.

Builds on

25 of 40 references.

References · 25

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  3. 2020Denoising Diffusion Implicit Modelscited by 9,655
  4. 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
  5. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
  6. 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,286
  7. 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,388
  8. 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,231
  9. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,198
  10. 2024InstantID: Zero-shot Identity-Preserving Generation in Secondscited by 431
  11. 2023DreamVideo: Composing Your Dream Videos with Customized Subject and Motioncited by 186
  12. 2024Identity-Preserving Text-to-Video Generation by Frequency Decompositioncited by 155
13 more
  1. 2024ID-Animator: Zero-Shot Identity-Preserving Human Video Generationcited by 122
  2. 2023PortraitBooth: A Versatile Portrait Model for Fast Identity-preserved Personalizationcited by 77
  3. 2024Still-Moving: Customized Video Generation without Customized Video Datacited by 49
  4. 2024InstantFamily: Masked Attention for Zero-shot Multi-ID Image Generationcited by 30
  5. 2024PersonalVideo: High ID-Fidelity Video Customization without Dynamic and Semantic Degradationcited by 29
  6. 2024IDProtector: An Adversarial Noise Encoder to Protect Against ID-Preserving Image Generationcited by 21
  7. 2025CINEMA: Coherent Multi-Subject Video Generation via MLLM-Based Guidancecited by 19
  8. 2025Ingredients: Blending Custom Photos with Video Diffusion Transformerscited by 13
  9. 2024MovieCharacter: A Tuning-Free Framework for Controllable Character Video Synthesiscited by 12
  10. 2025CuES: A Curiosity-driven and Environment-grounded Synthesis Framework for Agentic RLcited by 8
  11. 2024Real-time Identity Defenses against Malicious Personalization of Diffusion Modelscited by 5
  12. 2026Video Generation Models as World Models: Efficient Paradigms, Architectures and Algorithmscited by 5
  13. 2024Hi-EF: Benchmarking Emotion Forecasting in Human-interactioncited by 1

Built on by

Not cited yet.