mlsanityData to 7 Oct 2026

Identity-Consistent Video Generation under Large Facial-Angle Variations

arXiv 2603.21299 ↗First posted 22 Mar 2026cs.CVcited by 3

Not on the map. Why?

Abstract (arXiv)

Single-view reference-to-video methods often struggle to preserve identity consistency under large facial-angle variations. This limitation naturally motivates the incorporation of multi-view facial references. However, simply introducing additional reference images exacerbates the textitcopy-paste problem, particularly the textbftextitview-dependent copy-paste artifact, which reduces facial motion naturalness. Although cross-paired data can alleviate this issue, collecting such data is costly. To balance the consistency and naturalness, we propose Mv2ID, a multi-view conditioned framework under in-paired supervision. We introduce a region-masking training strategy to prevent shortcut learning and extract essential identity features by encouraging the model to aggregate complementary identity cues across views. In addition, we design a reference decoupled-RoPE mechanism that assigns distinct positional encoding to video and conditioning tokens for better modeling of their heterogeneous properties. Furthermore, we construct a large-scale dataset with diverse facial-angle variations and propose dedicated evaluation metrics for identity consistency and motion naturalness. Extensive experiments demonstrate that our method significantly improves identity consistency while maintaining motion naturalness, outperforming existing approaches trained with cross-paired data.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 43 of its 53 references that are in the map. First posted on arXiv 22 Mar 2026.

Builds on

43 of 53 references.

References · 43

  1. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  3. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  4. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
  5. 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
  6. 2022Flow Matching for Generative Modelingcited by 5,426
  7. 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,736
  8. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,550
  9. 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,006
  10. 2022Elucidating the Design Space of Diffusion-Based Generative Modelscited by 2,994
  11. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
  12. 2022Imagen Video: High Definition Video Generation with Diffusion Modelscited by 1,765
31 more
  1. 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,755
  2. 2022Make-A-Video: Text-to-Video Generation without Text-Video Datacited by 1,725
  3. 2023Zero-1-to-3: Zero-shot One Image to 3D Objectcited by 1,483
  4. 2022Magic3D: High-Resolution Text-to-3D Content Creationcited by 1,285
  5. 2023ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillationcited by 1,207
  6. 2022CogVideo: Large-scale Pretraining for Text-to-Video Generation via Transformerscited by 973
  7. 2022Tune-A-Video: One-Shot Tuning of Image Diffusion Models for Text-to-Video Generationcited by 958
  8. 2024Open-Sora: Democratizing Efficient Video Production for Allcited by 637
  9. 2022Phenaki: Variable Length Video Generation From Open Domain Textual Descriptioncited by 475
  10. 2025VACE: All-in-One Video Creation and Editingcited by 467
  11. 2024Lumiere: A Space-Time Diffusion Model for Video Generationcited by 450
  12. 2017NIMA: Neural Image Assessmentcited by 387
  13. 2024Open-Sora Plan: Open-Source Large Video Generation Modelcited by 286
  14. 2023DreamVideo: Composing Your Dream Videos with Customized Subject and Motioncited by 186
  15. 2019RetinaFace: Single-stage Dense Face Localisation in the Wildcited by 164
  16. 2025Phantom: Subject-consistent video generation via cross-modal alignmentcited by 126
  17. 2023VideoBooth: Diffusion-based Video Generation with Image Promptscited by 124
  18. 2025OpenS2V-Nexus: A Detailed Benchmark and Million-Scale Dataset for Subject-to-Video Generationcited by 73
  19. 2025HunyuanPortrait: Implicit Condition Control for Enhanced Portrait Animationcited by 55
  20. 2025HuMo: Human-Centric Video Generation via Collaborative Multi-Modal Conditioningcited by 44
  21. 2024ConsistentID: Portrait Generation with Multimodal Fine-Grained Identity Preservingcited by 42
  22. 2024PersonalVideo: High ID-Fidelity Video Customization without Dynamic and Semantic Degradationcited by 29
  23. 2025MAGREF: Masked Guidance for Any-Reference Video Generation with Subject Disentanglementcited by 22
  24. 2025Audio-visual Controlled Video Diffusion with Masked Selective State Spaces Modeling for Natural Talking Head Generationcited by 17
  25. 2025Phantom-Data : Towards a General Subject-Consistent Video Generation Datasetcited by 17
  26. 2025Kaleido: Open-Sourced Multi-Subject Reference Video Generation Modelcited by 16
  27. 2023DiffTalker: Co-driven audio-image diffusion for talking faces via intermediate landmarkscited by 9
  28. 2023Layered Rendering Diffusion Model for Controllable Zero-Shot Image Synthesiscited by 9
  29. 2026MV-S2V: Multi-View Subject-Consistent Video Generationcited by 9
  30. 2023Leveraging Diffusion Disentangled Representations to Mitigate Shortcuts in Underspecified Visual Taskscited by 4
  31. 2024Rethinking and Red-Teaming Protective Perturbation in Personalized Diffusion Modelscited by 4

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 3.

3 papers.