MagicID: Hybrid Preference Optimization for ID-Consistent and Dynamic-Preserved Video Customization
Not on the map. Why?
Abstract (arXiv)
Video identity customization seeks to produce high-fidelity videos that maintain consistent identity and exhibit significant dynamics based on users' reference images. However, existing approaches face two key challenges: identity degradation over extended video length and reduced dynamics during training, primarily due to their reliance on traditional self-reconstruction training with static images. To address these issues, we introduce MagicID, a novel framework designed to directly promote the generation of identity-consistent and dynamically rich videos tailored to user preferences. Specifically, we propose constructing pairwise preference video data with explicit identity and dynamic rewards for preference learning, instead of sticking to the traditional self-reconstruction. To address the constraints of customized preference data, we introduce a hybrid sampling strategy. This approach first prioritizes identity preservation by leveraging static videos derived from reference images, then enhances dynamic motion quality in the generated videos using a Frontier-based sampling method. By utilizing these hybrid preference pairs, we optimize the model to align with the reward differences between pairs of customized preferences. Extensive experiments show that MagicID successfully achieves consistent identity and natural dynamics, surpassing existing methods across various metrics.
Key facts. Cited by 17 papers in the map (data through 14 Oct 2026). Builds on 37 of its 48 references that are in the map. First posted on arXiv 16 Mar 2025.
Builds on
37 of 48 references.
References · 37
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 8,065
- 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,300
- 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,415
- 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,245
- 2023Qwen-VL: A Versatile Vision-Language Model for Understanding, Localization, Text Reading, and Beyondcited by 2,224
- 2019Fine-Tuning Language Models from Human Preferencescited by 2,150
- 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
- 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
- 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Modelscited by 1,464
- 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuningcited by 1,433
- 2023Diffusion Model Alignment Using Direct Preference Optimizationcited by 790
25 more
- 2023ModelScope Text-to-Video Technical Reportcited by 658
- 2024Movie Gen: A Cast of Media Foundation Modelscited by 644
- 2024VideoCrafter2: Overcoming Data Limitations for High-Quality Video Diffusion Modelscited by 579
- 2024InstantID: Zero-shot Identity-Preserving Generation in Secondscited by 436
- 2023PhotoMaker: Customizing Realistic Human Photos via Stacked ID Embeddingcited by 328
- 2023FastComposer: Tuning-Free Multi-Subject Image Generation with Localized Attentioncited by 313
- 2024Is DPO Superior to PPO for LLM Alignment? A Comprehensive Studycited by 262
- 2023Subject-Diffusion:Open Domain Personalized Text-to-Image Generation without Test-time Fine-tuningcited by 191
- 2020Partial FC: Training 10 Million Identities on a Single Machinecited by 163
- 2024Identity-Preserving Text-to-Video Generation by Frequency Decompositioncited by 158
- 2024PuLID: Pure and Lightning ID Customization via Contrastive Alignmentcited by 144
- 2024ID-Animator: Zero-Shot Identity-Preserving Human Video Generationcited by 124
- 2024VideoDPO: Omni-Preference Alignment for Video Diffusion Generationcited by 108
- 2023Face0: Instantaneously Conditioning a Text-to-Image Model on a Facecited by 78
- 2023PortraitBooth: A Versatile Portrait Model for Fast Identity-preserved Personalizationcited by 77
- 2024CustomCrafter: Customized Video Generation with Preserving Motion and Concept Composition Abilitiescited by 60
- 2024Magic-Me: Identity-Specific Video Customized Diffusioncited by 59
- 2024LCM-Lookahead for Encoder-based Text-to-Image Personalizationcited by 48
- 2024sDPO: Don't Use Your Data All at Oncecited by 46
- 2024DreamVideo-2: Zero-Shot Subject-Driven Video Customization with Precise Motion Controlcited by 43
- 2025Calibrated Multi-Preference Optimization for Aligning Diffusion Modelscited by 41
- 2024PersonalVideo: High ID-Fidelity Video Customization without Dynamic and Semantic Degradationcited by 29
- 2025DreamDPO: Aligning Text-to-3D Generation with Human Preferences via Direct Preference Optimizationcited by 27
- 2025HuViDPO:Enhancing Video Generation through Direct Preference Optimization for Human-Centric Alignmentcited by 10
- 2024GCA-3D: Towards Generalized and Consistent Domain Adaptation of 3D Generatorscited by 4
Built on by
Citing papers per year: 2025: 10; 2026: 7.
17 papers.
Sort:
By area:
- 2025Visual Instance-aware Prompt Tuningcited by 29
- 2025VORTA: Efficient Video Diffusion via Routing Sparse Attentioncited by 23
- 2025Hierarchical Fine-grained Preference Optimization for Physically Plausible Video Generationcited by 21
- 2025Prompt-based Adaptation in Large-scale Vision Models: A Surveycited by 21
- 2025RULER-Bench: Probing Rule-based Reasoning Abilities of Next-level Video Generation Models for Vision Foundation Intelligencecited by 13
- 2025Identity-Preserving Image-to-Video Generation via Reward-Guided Optimizationcited by 8
- 2026Staying VIGILant: Mitigating Visual Laziness via Counterfactual Visual Alignment in MLLMscited by 8
- 2025CTR-LoRA: Curvature-Aware and Trust-Region Guided Low-Rank Adaptation for Large Language Modelscited by 6
- 2025MultiCrafter: High-Fidelity Multi-Subject Generation via Disentangled Attention and Identity-Aware Preference Alignmentcited by 4
- 2026DreamVideo-Omni: Omni-Motion Controlled Multi-Subject Video Customization with Latent Identity Reinforcement Learningcited by 4
- 2025LaVieID: Local Autoregressive Diffusion Transformers for Identity-Preserving Video Creationcited by 3
- 2026Stroke3D: Lifting 2D strokes into rigged 3D model via latent diffusion modelscited by 2
5 more
- 2026AnyID: Ultra-Fidelity Universal Identity-Preserving Video Generation from Any Visual Referencescited by 1
- 2026DomainShuttle: Freeform Open Domain Subject-driven Text-to-video Generationcited by 1
- 2026HOMIE: Human-object Centric Video Personalization via Multimodal Intelligent Enhancementcited by 1
- 2026Illuminating Visual Identity in Universal Multimodal Embeddingscited by 1
- 2025MagicView: Multi-View Consistent Identity Customization via Priors-Guided In-Context Learningcited by 0
- 2026Illuminating Visual Identity in Universal Multimodal Embeddings3 Aug 2026
- 2026HOMIE: Human-object Centric Video Personalization via Multimodal Intelligent Enhancement20 Jul 2026
- 2026Staying VIGILant: Mitigating Visual Laziness via Counterfactual Visual Alignment in MLLMs24 Jun 2026
- 2026DomainShuttle: Freeform Open Domain Subject-driven Text-to-video Generation24 Jun 2026
- 2026AnyID: Ultra-Fidelity Universal Identity-Preserving Video Generation from Any Visual References26 Mar 2026
- 2026DreamVideo-Omni: Omni-Motion Controlled Multi-Subject Video Customization with Latent Identity Reinforcement Learning12 Mar 2026
- 2026Stroke3D: Lifting 2D strokes into rigged 3D model via latent diffusion models10 Feb 2026
- 2025RULER-Bench: Probing Rule-based Reasoning Abilities of Next-level Video Generation Models for Vision Foundation Intelligence2 Dec 2025
- 2025MagicView: Multi-View Consistent Identity Customization via Priors-Guided In-Context Learning31 Oct 2025
- 2025Identity-Preserving Image-to-Video Generation via Reward-Guided Optimization16 Oct 2025
- 2025Prompt-based Adaptation in Large-scale Vision Models: A Survey15 Oct 2025
- 2025CTR-LoRA: Curvature-Aware and Trust-Region Guided Low-Rank Adaptation for Large Language Models11 Oct 2025
5 more
- 2025MultiCrafter: High-Fidelity Multi-Subject Generation via Disentangled Attention and Identity-Aware Preference Alignment26 Sep 2025
- 2025Hierarchical Fine-grained Preference Optimization for Physically Plausible Video Generation14 Aug 2025
- 2025LaVieID: Local Autoregressive Diffusion Transformers for Identity-Preserving Video Creation11 Aug 2025
- 2025Visual Instance-aware Prompt Tuning10 Jul 2025
- 2025VORTA: Efficient Video Diffusion via Routing Sparse Attention24 May 2025
- 2025VORTA: Efficient Video Diffusion via Routing Sparse Attentioncited by 23
- 2025Identity-Preserving Image-to-Video Generation via Reward-Guided Optimizationcited by 8
- 2026DreamVideo-Omni: Omni-Motion Controlled Multi-Subject Video Customization with Latent Identity Reinforcement Learningcited by 4
- 2025LaVieID: Local Autoregressive Diffusion Transformers for Identity-Preserving Video Creationcited by 3
- 2026Stroke3D: Lifting 2D strokes into rigged 3D model via latent diffusion modelscited by 2
- 2026DreamVideo-Omni: Omni-Motion Controlled Multi-Subject Video Customization with Latent Identity Reinforcement Learning12 Mar 2026
- 2026Stroke3D: Lifting 2D strokes into rigged 3D model via latent diffusion models10 Feb 2026
- 2025Identity-Preserving Image-to-Video Generation via Reward-Guided Optimization16 Oct 2025
- 2025LaVieID: Local Autoregressive Diffusion Transformers for Identity-Preserving Video Creation11 Aug 2025
- 2025VORTA: Efficient Video Diffusion via Routing Sparse Attention24 May 2025
- 2025Visual Instance-aware Prompt Tuningcited by 29
- 2025Prompt-based Adaptation in Large-scale Vision Models: A Surveycited by 21
- 2025CTR-LoRA: Curvature-Aware and Trust-Region Guided Low-Rank Adaptation for Large Language Modelscited by 6
- 2026AnyID: Ultra-Fidelity Universal Identity-Preserving Video Generation from Any Visual Referencescited by 1
- 2026DomainShuttle: Freeform Open Domain Subject-driven Text-to-video Generationcited by 1
- 2026HOMIE: Human-object Centric Video Personalization via Multimodal Intelligent Enhancementcited by 1
- 2026Illuminating Visual Identity in Universal Multimodal Embeddingscited by 1
- 2025MagicView: Multi-View Consistent Identity Customization via Priors-Guided In-Context Learningcited by 0
- 2026Illuminating Visual Identity in Universal Multimodal Embeddings3 Aug 2026
- 2026HOMIE: Human-object Centric Video Personalization via Multimodal Intelligent Enhancement20 Jul 2026
- 2026DomainShuttle: Freeform Open Domain Subject-driven Text-to-video Generation24 Jun 2026
- 2026AnyID: Ultra-Fidelity Universal Identity-Preserving Video Generation from Any Visual References26 Mar 2026
- 2025MagicView: Multi-View Consistent Identity Customization via Priors-Guided In-Context Learning31 Oct 2025
- 2025Prompt-based Adaptation in Large-scale Vision Models: A Survey15 Oct 2025
- 2025CTR-LoRA: Curvature-Aware and Trust-Region Guided Low-Rank Adaptation for Large Language Models11 Oct 2025
- 2025Visual Instance-aware Prompt Tuning10 Jul 2025
Similar, not cited
Close in wording, no citation either way
- 2025MagicMirror: ID-Preserved Video Generation in Video Diffusion Transformers
- 2025Identity-GRPO: Optimizing Multi-Human Identity-preserving Video Generation via Reinforcement Learning
- 2025Proteus-ID: ID-Consistent and Motion-Coherent Video Customization
- 2025DualReal: Adaptive Joint Training for Lossless Identity-Motion Fusion in Video Customization
- 2025VideoMage: Multi-Subject and Motion Customization of Text-to-Video Diffusion Models
- 2026A Comprehensive Ecosystem for Open-Domain Customized Video Generation
- 2025Discriminator-Free Direct Preference Optimization for Video Diffusion
- 2026Delving into the Temporal Challenges of Unified Video Protection Against Image-to-Video and Fine-Tuning-based Customization