mlsanityData to 14 Oct 2026

MagicMirror: ID-Preserved Video Generation in Video Diffusion Transformers

arXiv 2501.03931 ↗First posted 7 Jan 2025cs.CVcited by 34

On the map: Diffusion models → Video generation

Abstract (arXiv)

We present MagicMirror, a framework for generating identity-preserved videos with cinematic-level quality and dynamic motion. While recent advances in video diffusion models have shown impressive capabilities in text-to-video generation, maintaining consistent identity while producing natural motion remains challenging. Previous methods either require person-specific fine-tuning or struggle to balance identity preservation with motion diversity. Built upon Video Diffusion Transformers, our method introduces three key components: (1) a dual-branch facial feature extractor that captures both identity and structural features, (2) a lightweight cross-modal adapter with Conditioned Adaptive Normalization for efficient identity integration, and (3) a two-stage training strategy combining synthetic identity pairs with video data. Extensive experiments demonstrate that MagicMirror effectively balances identity consistency with natural motion, outperforming existing methods across multiple metrics while requiring minimal parameters added. The code and model will be made publicly available.

Key facts. Cited by 34 papers in the map (data through 14 Oct 2026). Placed in Video generation, one of 14 directions in Diffusion models. Builds on 58 of its 75 references that are in the map. First posted on arXiv 7 Jan 2025.

Builds on

58 of 75 references.

Closest ancestors · 7

Same direction, newest first

  1. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformer12 Aug
  2. 2024Latte: Latent Diffusion Transformer for Video Generation5 Jan
  3. 2023DynamiCrafter: Animating Open-domain Images with Video Diffusion Priors18 Oct
  4. 2023A Survey on Video Diffusion Models16 Oct
  5. 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuning10 Jul
  6. 2022Latent Video Diffusion Models for High-Fidelity Long Video Generation23 Nov
  7. 2022Video Diffusion Models7 Apr

Other references · 51

  1. 2017Attention Is All You Needcited by 60,361
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  3. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  4. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  5. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
  6. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  7. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
  8. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
  9. 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,137
  10. 2022Scalable Diffusion Models with Transformerscited by 6,054
  11. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
  12. 2022Generative Adversarial Networkscited by 5,627
38 more
  1. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
  2. 2021Zero-Shot Text-to-Image Generationcited by 4,288
  3. 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,614
  4. 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,588
  5. 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,300
  6. 2020Taming Transformers for High-Resolution Image Synthesiscited by 3,253
  7. 2016Improved Techniques for Training GANscited by 2,970
  8. 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,245
  9. 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
  10. 2021LAION-400M: Open Dataset of CLIP-Filtered 400 Million Image-Text Pairscited by 1,555
  11. 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Modelscited by 1,464
  12. 2022Scaling Autoregressive Models for Content-Rich Text-to-Image Generationcited by 1,295
  13. 2021Variational Diffusion Modelscited by 1,153
  14. 2022Diffusion-LM Improves Controllable Text Generationcited by 1,027
  15. 2024WorldSimBench: Towards Video Generation Models as World Simulatorscited by 881
  16. 2023CogVLM: Visual Expert for Pretrained Language Modelscited by 708
  17. 2023MotionCtrl: A Unified and Flexible Motion Controller for Video Generationcited by 580
  18. 2022DiffuSeq: Sequence to Sequence Text Generation with Diffusion Modelscited by 450
  19. 2024InstantID: Zero-shot Identity-Preserving Generation in Secondscited by 436
  20. 2024ViewCrafter: Taming Video Diffusion Models for High-fidelity Novel View Synthesiscited by 403
  21. 2024Mini-Gemini: Mining the Potential of Multi-modality Vision Language Modelscited by 365
  22. 2021Towards Real-World Blind Face Restoration with Generative Facial Priorcited by 349
  23. 2023EvalCrafter: Benchmarking and Evaluating Large Video Generation Modelscited by 340
  24. 2023PhotoMaker: Customizing Realistic Human Photos via Stacked ID Embeddingcited by 328
  25. 2022DiffDock: Diffusion Steps, Twists, and Turns for Molecular Dockingcited by 313
  26. 2021Score-based diffusion models for accelerated MRIcited by 311
  27. 2021Come-Closer-Diffuse-Faster: Accelerating Conditional Diffusion Models for Inverse Problems through Stochastic Contractioncited by 307
  28. 2024Open-Sora Plan: Open-Source Large Video Generation Modelcited by 296
  29. 2022Torsional Diffusion for Molecular Conformer Generationcited by 263
  30. 2024ControlNeXt: Powerful and Efficient Control for Image and Video Generationcited by 159
  31. 2024Identity-Preserving Text-to-Video Generation by Frequency Decompositioncited by 158
  32. 2024PuLID: Pure and Lightning ID Customization via Contrastive Alignmentcited by 144
  33. 2023Make Pixels Dance: High-Dynamic Video Generationcited by 140
  34. 2024ID-Animator: Zero-Shot Identity-Preserving Human Video Generationcited by 124
  35. 2023CelebV-Text: A Large-Scale Facial Text-Video Datasetcited by 104
  36. 2023PortraitBooth: A Versatile Portrait Model for Fast Identity-preserved Personalizationcited by 77
  37. 2023PhotoVerse: Tuning-Free Image Customization with Text-to-Image Diffusion Modelscited by 70
  38. 2024Magic-Me: Identity-Specific Video Customized Diffusioncited by 59

50 most cited of 51 All 51 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 18; 2026: 16.

34 papers.

Sort:

By area:

  1. 2025VACE: All-in-One Video Creation and Editingcited by 479
  2. 2025FullDiT: Multi-Task Video Generative Foundation Model with Full Attentioncited by 47
  3. 2025Training-Free Efficient Video Generation via Dynamic Token Carvingcited by 34
  4. 2025Concat-ID: Towards Universal Identity-Preserving Video Synthesiscited by 28
  5. 2025Bidirectional Sparse Attention for Faster Video Diffusion Trainingcited by 19
  6. 2025EchoVideo: Identity-Preserving Human Video Generation by Multimodal Feature Fusioncited by 12
  7. 2025DreamVE: Unified Instruction-based Image and Video Editingcited by 11
  8. 2026MuSS: A Large-Scale Dataset and Cinematic Narrative Benchmark for Multi-Shot Subject-to-Video Generationcited by 9
  9. 2026Evolution of Video Generative Foundationscited by 7
  10. 2025GenHSI: Controllable Generation of Human-Scene Interaction Videoscited by 6
  11. 2026LumosX: Relate Any Identities with Their Attributes for Personalized Video Generationcited by 6
  12. 2025ContextAnyone: Context-Aware Diffusion for Character-Consistent Text-to-Video Generationcited by 5
22 more
  1. 2025MoSA: Motion-Coherent Human Video Generation via Structure-Appearance Decouplingcited by 4
  2. 2026SocialDirector: Training-Free Social Interaction Control for Multi-Person Video Generationcited by 4
  3. 2025LaVieID: Local Autoregressive Diffusion Transformers for Identity-Preserving Video Creationcited by 3
  4. 2026Rethinking Position Embedding as a Context Controller for Multi-Reference and Multi-Shot Video Generationcited by 3
  5. 2025Learning Zero-Shot Subject-Driven Video Generation Using 1% Computecited by 2
  6. 2025MoCA-Video: Motion-Aware Concept Alignment for Consistent Video Editingcited by 2
  7. 2026EditYourself: Audio-Driven Generation and Manipulation of Talking Head Videos with Diffusion Transformerscited by 2
  8. 2025UniMMVSR: A Unified Multi-Modal Framework for Cascaded Video Super-Resolutioncited by 1
  9. 2025Video Consistency Distance: Enhancing Temporal Consistency for Image-to-Video Generation via Reward-Based Fine-Tuningcited by 1
  10. 2025FREE: Uncertainty-Aware Autoregression for Parallel Diffusion Transformerscited by 1
  11. 2026AnyID: Ultra-Fidelity Universal Identity-Preserving Video Generation from Any Visual Referencescited by 1
  12. 2026ID-V2V: Identity-Preserving Video Restylizationcited by 1
  13. 2026Illuminating Visual Identity in Universal Multimodal Embeddingscited by 1
  14. 2025StableDub: Taming Diffusion Prior for Generalized and Efficient Visual Dubbingcited by 0
  15. 2025AI killed the video star. Audio-driven diffusion model for expressive talking head generationcited by 0
  16. 2026FaithfulFaces: Pose-Faithful Facial Identity Preservation for Text-to-Video Generationcited by 0
  17. 2026Spatial-Temporal Decoupled Reference Conditioning for Identity-Preserving Text-to-Video Generationcited by 0
  18. 2026GroupVideo: Multi-Identity Customized Text-to-Video Generationcited by 0
  19. 2026KeyID: Decoupled Drafting and Keyframe Editing for Identity-Preserving Video Generationcited by 0
  20. 2026Preserving Knowledge across Space and Time for Continual Video Deepfake Detectioncited by 0
  21. 2026Custom Forcing: Training-Free Subject Customization for Autoregressive Video Generationcited by 0
  22. 2026Generating the Wild: Individual-Consistent Image-to-Video Generation for Wildlifecited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2025MoCA: Identity-Preserving Text-to-Video Generation via Mixture of Cross Attention
  2. 2025FantasyID: Face Knowledge Enhanced ID-Preserving Video Generation
  3. 2024StableAnimator: High-Quality Identity-Preserving Human Image Animation
  4. 2025MagicID: Hybrid Preference Optimization for ID-Consistent and Dynamic-Preserved Video Customization
  5. 2025Identity-Preserving Image-to-Video Generation via Reward-Guided Optimization
  6. 2026DreamID-V:Bridging the Image-to-Video Gap for High-Fidelity Face Swapping via Diffusion Transformer
  7. 2025Ingredients: Blending Custom Photos with Video Diffusion Transformers
  8. 2025Identity-Preserving Text-to-Video Generation via Training-Free Prompt, Image, and Guidance Enhancement