MagicMirror: ID-Preserved Video Generation in Video Diffusion Transformers
On the map: Diffusion models → Video generation
Abstract (arXiv)
We present MagicMirror, a framework for generating identity-preserved videos with cinematic-level quality and dynamic motion. While recent advances in video diffusion models have shown impressive capabilities in text-to-video generation, maintaining consistent identity while producing natural motion remains challenging. Previous methods either require person-specific fine-tuning or struggle to balance identity preservation with motion diversity. Built upon Video Diffusion Transformers, our method introduces three key components: (1) a dual-branch facial feature extractor that captures both identity and structural features, (2) a lightweight cross-modal adapter with Conditioned Adaptive Normalization for efficient identity integration, and (3) a two-stage training strategy combining synthetic identity pairs with video data. Extensive experiments demonstrate that MagicMirror effectively balances identity consistency with natural motion, outperforming existing methods across multiple metrics while requiring minimal parameters added. The code and model will be made publicly available.
Key facts. Cited by 34 papers in the map (data through 14 Oct 2026). Placed in Video generation, one of 14 directions in Diffusion models. Builds on 58 of its 75 references that are in the map. First posted on arXiv 7 Jan 2025.
Builds on
58 of 75 references.
Closest ancestors · 7
Same direction, newest first
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformer12 Aug
- 2024Latte: Latent Diffusion Transformer for Video Generation5 Jan
- 2023DynamiCrafter: Animating Open-domain Images with Video Diffusion Priors18 Oct
- 2023A Survey on Video Diffusion Models16 Oct
- 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuning10 Jul
- 2022Latent Video Diffusion Models for High-Fidelity Long Video Generation23 Nov
- 2022Video Diffusion Models7 Apr
Other references · 51
- 2017Attention Is All You Needcited by 60,361
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
- 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,137
- 2022Scalable Diffusion Models with Transformerscited by 6,054
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
- 2022Generative Adversarial Networkscited by 5,627
38 more
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
- 2021Zero-Shot Text-to-Image Generationcited by 4,288
- 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,614
- 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,588
- 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,300
- 2020Taming Transformers for High-Resolution Image Synthesiscited by 3,253
- 2016Improved Techniques for Training GANscited by 2,970
- 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,245
- 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
- 2021LAION-400M: Open Dataset of CLIP-Filtered 400 Million Image-Text Pairscited by 1,555
- 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Modelscited by 1,464
- 2022Scaling Autoregressive Models for Content-Rich Text-to-Image Generationcited by 1,295
- 2021Variational Diffusion Modelscited by 1,153
- 2022Diffusion-LM Improves Controllable Text Generationcited by 1,027
- 2024WorldSimBench: Towards Video Generation Models as World Simulatorscited by 881
- 2023CogVLM: Visual Expert for Pretrained Language Modelscited by 708
- 2023MotionCtrl: A Unified and Flexible Motion Controller for Video Generationcited by 580
- 2022DiffuSeq: Sequence to Sequence Text Generation with Diffusion Modelscited by 450
- 2024InstantID: Zero-shot Identity-Preserving Generation in Secondscited by 436
- 2024ViewCrafter: Taming Video Diffusion Models for High-fidelity Novel View Synthesiscited by 403
- 2024Mini-Gemini: Mining the Potential of Multi-modality Vision Language Modelscited by 365
- 2021Towards Real-World Blind Face Restoration with Generative Facial Priorcited by 349
- 2023EvalCrafter: Benchmarking and Evaluating Large Video Generation Modelscited by 340
- 2023PhotoMaker: Customizing Realistic Human Photos via Stacked ID Embeddingcited by 328
- 2022DiffDock: Diffusion Steps, Twists, and Turns for Molecular Dockingcited by 313
- 2021Score-based diffusion models for accelerated MRIcited by 311
- 2021Come-Closer-Diffuse-Faster: Accelerating Conditional Diffusion Models for Inverse Problems through Stochastic Contractioncited by 307
- 2024Open-Sora Plan: Open-Source Large Video Generation Modelcited by 296
- 2022Torsional Diffusion for Molecular Conformer Generationcited by 263
- 2024ControlNeXt: Powerful and Efficient Control for Image and Video Generationcited by 159
- 2024Identity-Preserving Text-to-Video Generation by Frequency Decompositioncited by 158
- 2024PuLID: Pure and Lightning ID Customization via Contrastive Alignmentcited by 144
- 2023Make Pixels Dance: High-Dynamic Video Generationcited by 140
- 2024ID-Animator: Zero-Shot Identity-Preserving Human Video Generationcited by 124
- 2023CelebV-Text: A Large-Scale Facial Text-Video Datasetcited by 104
- 2023PortraitBooth: A Versatile Portrait Model for Fast Identity-preserved Personalizationcited by 77
- 2023PhotoVerse: Tuning-Free Image Customization with Text-to-Image Diffusion Modelscited by 70
- 2024Magic-Me: Identity-Specific Video Customized Diffusioncited by 59
50 most cited of 51 All 51 (JSON)
Built on by
Citing papers per year: 2025: 18; 2026: 16.
34 papers.
Sort:
By area:
- 2025VACE: All-in-One Video Creation and Editingcited by 479
- 2025FullDiT: Multi-Task Video Generative Foundation Model with Full Attentioncited by 47
- 2025Training-Free Efficient Video Generation via Dynamic Token Carvingcited by 34
- 2025Concat-ID: Towards Universal Identity-Preserving Video Synthesiscited by 28
- 2025Bidirectional Sparse Attention for Faster Video Diffusion Trainingcited by 19
- 2025EchoVideo: Identity-Preserving Human Video Generation by Multimodal Feature Fusioncited by 12
- 2025DreamVE: Unified Instruction-based Image and Video Editingcited by 11
- 2026MuSS: A Large-Scale Dataset and Cinematic Narrative Benchmark for Multi-Shot Subject-to-Video Generationcited by 9
- 2026Evolution of Video Generative Foundationscited by 7
- 2025GenHSI: Controllable Generation of Human-Scene Interaction Videoscited by 6
- 2026LumosX: Relate Any Identities with Their Attributes for Personalized Video Generationcited by 6
- 2025ContextAnyone: Context-Aware Diffusion for Character-Consistent Text-to-Video Generationcited by 5
22 more
- 2025MoSA: Motion-Coherent Human Video Generation via Structure-Appearance Decouplingcited by 4
- 2026SocialDirector: Training-Free Social Interaction Control for Multi-Person Video Generationcited by 4
- 2025LaVieID: Local Autoregressive Diffusion Transformers for Identity-Preserving Video Creationcited by 3
- 2026Rethinking Position Embedding as a Context Controller for Multi-Reference and Multi-Shot Video Generationcited by 3
- 2025Learning Zero-Shot Subject-Driven Video Generation Using 1% Computecited by 2
- 2025MoCA-Video: Motion-Aware Concept Alignment for Consistent Video Editingcited by 2
- 2026EditYourself: Audio-Driven Generation and Manipulation of Talking Head Videos with Diffusion Transformerscited by 2
- 2025UniMMVSR: A Unified Multi-Modal Framework for Cascaded Video Super-Resolutioncited by 1
- 2025Video Consistency Distance: Enhancing Temporal Consistency for Image-to-Video Generation via Reward-Based Fine-Tuningcited by 1
- 2025FREE: Uncertainty-Aware Autoregression for Parallel Diffusion Transformerscited by 1
- 2026AnyID: Ultra-Fidelity Universal Identity-Preserving Video Generation from Any Visual Referencescited by 1
- 2026ID-V2V: Identity-Preserving Video Restylizationcited by 1
- 2026Illuminating Visual Identity in Universal Multimodal Embeddingscited by 1
- 2025StableDub: Taming Diffusion Prior for Generalized and Efficient Visual Dubbingcited by 0
- 2025AI killed the video star. Audio-driven diffusion model for expressive talking head generationcited by 0
- 2026FaithfulFaces: Pose-Faithful Facial Identity Preservation for Text-to-Video Generationcited by 0
- 2026Spatial-Temporal Decoupled Reference Conditioning for Identity-Preserving Text-to-Video Generationcited by 0
- 2026GroupVideo: Multi-Identity Customized Text-to-Video Generationcited by 0
- 2026KeyID: Decoupled Drafting and Keyframe Editing for Identity-Preserving Video Generationcited by 0
- 2026Preserving Knowledge across Space and Time for Continual Video Deepfake Detectioncited by 0
- 2026Custom Forcing: Training-Free Subject Customization for Autoregressive Video Generationcited by 0
- 2026Generating the Wild: Individual-Consistent Image-to-Video Generation for Wildlifecited by 0
- 2026Generating the Wild: Individual-Consistent Image-to-Video Generation for Wildlife4 Oct 2026
- 2026Custom Forcing: Training-Free Subject Customization for Autoregressive Video Generation2 Oct 2026
- 2026Preserving Knowledge across Space and Time for Continual Video Deepfake Detection3 Sep 2026
- 2026KeyID: Decoupled Drafting and Keyframe Editing for Identity-Preserving Video Generation17 Aug 2026
- 2026Illuminating Visual Identity in Universal Multimodal Embeddings3 Aug 2026
- 2026ID-V2V: Identity-Preserving Video Restylization24 Jul 2026
- 2026GroupVideo: Multi-Identity Customized Text-to-Video Generation23 Jul 2026
- 2026Spatial-Temporal Decoupled Reference Conditioning for Identity-Preserving Text-to-Video Generation1 Jun 2026
- 2026SocialDirector: Training-Free Social Interaction Control for Multi-Person Video Generation11 May 2026
- 2026FaithfulFaces: Pose-Faithful Facial Identity Preservation for Text-to-Video Generation6 May 2026
- 2026MuSS: A Large-Scale Dataset and Cinematic Narrative Benchmark for Multi-Shot Subject-to-Video Generation26 Apr 2026
- 2026Evolution of Video Generative Foundations7 Apr 2026
22 more
- 2026Rethinking Position Embedding as a Context Controller for Multi-Reference and Multi-Shot Video Generation4 Apr 2026
- 2026AnyID: Ultra-Fidelity Universal Identity-Preserving Video Generation from Any Visual References26 Mar 2026
- 2026LumosX: Relate Any Identities with Their Attributes for Personalized Video Generation20 Mar 2026
- 2026EditYourself: Audio-Driven Generation and Manipulation of Talking Head Videos with Diffusion Transformers29 Jan 2026
- 2025ContextAnyone: Context-Aware Diffusion for Character-Consistent Text-to-Video Generation8 Dec 2025
- 2025AI killed the video star. Audio-driven diffusion model for expressive talking head generation27 Nov 2025
- 2025FREE: Uncertainty-Aware Autoregression for Parallel Diffusion Transformers25 Nov 2025
- 2025Video Consistency Distance: Enhancing Temporal Consistency for Image-to-Video Generation via Reward-Based Fine-Tuning22 Oct 2025
- 2025UniMMVSR: A Unified Multi-Modal Framework for Cascaded Video Super-Resolution9 Oct 2025
- 2025StableDub: Taming Diffusion Prior for Generalized and Efficient Visual Dubbing26 Sep 2025
- 2025Bidirectional Sparse Attention for Faster Video Diffusion Training1 Sep 2025
- 2025MoSA: Motion-Coherent Human Video Generation via Structure-Appearance Decoupling24 Aug 2025
- 2025LaVieID: Local Autoregressive Diffusion Transformers for Identity-Preserving Video Creation11 Aug 2025
- 2025DreamVE: Unified Instruction-based Image and Video Editing8 Aug 2025
- 2025GenHSI: Controllable Generation of Human-Scene Interaction Videos24 Jun 2025
- 2025MoCA-Video: Motion-Aware Concept Alignment for Consistent Video Editing1 Jun 2025
- 2025Training-Free Efficient Video Generation via Dynamic Token Carving22 May 2025
- 2025Learning Zero-Shot Subject-Driven Video Generation Using 1% Compute23 Apr 2025
- 2025FullDiT: Multi-Task Video Generative Foundation Model with Full Attention25 Mar 2025
- 2025Concat-ID: Towards Universal Identity-Preserving Video Synthesis18 Mar 2025
- 2025VACE: All-in-One Video Creation and Editing10 Mar 2025
- 2025EchoVideo: Identity-Preserving Human Video Generation by Multimodal Feature Fusion23 Jan 2025
- 2025VACE: All-in-One Video Creation and Editingcited by 479
- 2025Training-Free Efficient Video Generation via Dynamic Token Carvingcited by 34
- 2025Bidirectional Sparse Attention for Faster Video Diffusion Trainingcited by 19
- 2025GenHSI: Controllable Generation of Human-Scene Interaction Videoscited by 6
- 2026LumosX: Relate Any Identities with Their Attributes for Personalized Video Generationcited by 6
- 2025LaVieID: Local Autoregressive Diffusion Transformers for Identity-Preserving Video Creationcited by 3
- 2026EditYourself: Audio-Driven Generation and Manipulation of Talking Head Videos with Diffusion Transformerscited by 2
- 2025Video Consistency Distance: Enhancing Temporal Consistency for Image-to-Video Generation via Reward-Based Fine-Tuningcited by 1
- 2025FREE: Uncertainty-Aware Autoregression for Parallel Diffusion Transformerscited by 1
- 2025StableDub: Taming Diffusion Prior for Generalized and Efficient Visual Dubbingcited by 0
- 2025AI killed the video star. Audio-driven diffusion model for expressive talking head generationcited by 0
- 2026LumosX: Relate Any Identities with Their Attributes for Personalized Video Generation20 Mar 2026
- 2026EditYourself: Audio-Driven Generation and Manipulation of Talking Head Videos with Diffusion Transformers29 Jan 2026
- 2025AI killed the video star. Audio-driven diffusion model for expressive talking head generation27 Nov 2025
- 2025FREE: Uncertainty-Aware Autoregression for Parallel Diffusion Transformers25 Nov 2025
- 2025Video Consistency Distance: Enhancing Temporal Consistency for Image-to-Video Generation via Reward-Based Fine-Tuning22 Oct 2025
- 2025StableDub: Taming Diffusion Prior for Generalized and Efficient Visual Dubbing26 Sep 2025
- 2025Bidirectional Sparse Attention for Faster Video Diffusion Training1 Sep 2025
- 2025LaVieID: Local Autoregressive Diffusion Transformers for Identity-Preserving Video Creation11 Aug 2025
- 2025GenHSI: Controllable Generation of Human-Scene Interaction Videos24 Jun 2025
- 2025Training-Free Efficient Video Generation via Dynamic Token Carving22 May 2025
- 2025VACE: All-in-One Video Creation and Editing10 Mar 2025
- 2026Evolution of Video Generative Foundationscited by 7
- 2026Evolution of Video Generative Foundations7 Apr 2026
- 2025FullDiT: Multi-Task Video Generative Foundation Model with Full Attentioncited by 47
- 2025Concat-ID: Towards Universal Identity-Preserving Video Synthesiscited by 28
- 2025EchoVideo: Identity-Preserving Human Video Generation by Multimodal Feature Fusioncited by 12
- 2025DreamVE: Unified Instruction-based Image and Video Editingcited by 11
- 2026MuSS: A Large-Scale Dataset and Cinematic Narrative Benchmark for Multi-Shot Subject-to-Video Generationcited by 9
- 2025ContextAnyone: Context-Aware Diffusion for Character-Consistent Text-to-Video Generationcited by 5
- 2025MoSA: Motion-Coherent Human Video Generation via Structure-Appearance Decouplingcited by 4
- 2026SocialDirector: Training-Free Social Interaction Control for Multi-Person Video Generationcited by 4
- 2026Rethinking Position Embedding as a Context Controller for Multi-Reference and Multi-Shot Video Generationcited by 3
- 2025Learning Zero-Shot Subject-Driven Video Generation Using 1% Computecited by 2
- 2025MoCA-Video: Motion-Aware Concept Alignment for Consistent Video Editingcited by 2
- 2025UniMMVSR: A Unified Multi-Modal Framework for Cascaded Video Super-Resolutioncited by 1
12 most cited of 22 All 22 (JSON)
- 2026Generating the Wild: Individual-Consistent Image-to-Video Generation for Wildlife4 Oct 2026
- 2026Custom Forcing: Training-Free Subject Customization for Autoregressive Video Generation2 Oct 2026
- 2026Preserving Knowledge across Space and Time for Continual Video Deepfake Detection3 Sep 2026
- 2026KeyID: Decoupled Drafting and Keyframe Editing for Identity-Preserving Video Generation17 Aug 2026
- 2026Illuminating Visual Identity in Universal Multimodal Embeddings3 Aug 2026
- 2026ID-V2V: Identity-Preserving Video Restylization24 Jul 2026
- 2026GroupVideo: Multi-Identity Customized Text-to-Video Generation23 Jul 2026
- 2026Spatial-Temporal Decoupled Reference Conditioning for Identity-Preserving Text-to-Video Generation1 Jun 2026
- 2026SocialDirector: Training-Free Social Interaction Control for Multi-Person Video Generation11 May 2026
- 2026FaithfulFaces: Pose-Faithful Facial Identity Preservation for Text-to-Video Generation6 May 2026
- 2026MuSS: A Large-Scale Dataset and Cinematic Narrative Benchmark for Multi-Shot Subject-to-Video Generation26 Apr 2026
- 2026Rethinking Position Embedding as a Context Controller for Multi-Reference and Multi-Shot Video Generation4 Apr 2026
12 newest of 22 All 22 (JSON)
Similar, not cited
Close in wording, no citation either way
- 2025MoCA: Identity-Preserving Text-to-Video Generation via Mixture of Cross Attention
- 2025FantasyID: Face Knowledge Enhanced ID-Preserving Video Generation
- 2024StableAnimator: High-Quality Identity-Preserving Human Image Animation
- 2025MagicID: Hybrid Preference Optimization for ID-Consistent and Dynamic-Preserved Video Customization
- 2025Identity-Preserving Image-to-Video Generation via Reward-Guided Optimization
- 2026DreamID-V:Bridging the Image-to-Video Gap for High-Fidelity Face Swapping via Diffusion Transformer
- 2025Ingredients: Blending Custom Photos with Video Diffusion Transformers
- 2025Identity-Preserving Text-to-Video Generation via Training-Free Prompt, Image, and Guidance Enhancement