ConceptMaster: Multi-Concept Video Customization on Diffusion Transformer Models Without Test-Time Tuning
On the map: Diffusion models → Video generation
Abstract (arXiv)
Text-to-video generation has made remarkable advancements through diffusion models. However, Multi-Concept Video Customization (MCVC) remains a significant challenge. We identify two key challenges for this task: 1) the identity decoupling issue, where directly adopting existing customization methods inevitably mix identity attributes when handling multiple concepts simultaneously, and 2) the scarcity of high-quality video-entity pairs, which is crucial for training a model that can well represent and decouple various customized concepts in video generation. To address these challenges, we introduce ConceptMaster, a novel framework that effectively addresses the identity decoupling issues while maintaining concept fidelity in video customization. Specifically, we propose to learn decoupled multi-concept embeddings and inject them into diffusion models in a standalone manner, which effectively guarantees the quality of customized videos with multiple identities, even for highly similar visual concepts. To overcome the scarcity of high-quality MCVC data, we establish a data construction pipeline, which enables collection of high-quality multi-concept video-entity data pairs across diverse scenarios. A multi-concept video evaluation set is further devised to comprehensively validate our method from three dimensions, including concept fidelity, identity decoupling ability, and video generation quality, across six different concept composition scenarios. Extensive experiments demonstrate that ConceptMaster significantly outperforms previous methods for video customization tasks, showing great potential to generate personalized and semantically accurate content for video diffusion models.
Key facts. Cited by 67 papers in the map (data through 7 Oct 2026). Placed in Video generation, one of 14 directions in Diffusion models. Builds on 64 of its 71 references that are in the map. First posted on arXiv 8 Jan 2025.
Builds on
64 of 71 references.
Closest ancestors · 14
Same direction, newest first
- 2024VideoCrafter2: Overcoming Data Limitations for High-Quality Video Diffusion Models17 Jan
- 2023DreamVideo: Composing Your Dream Videos with Customized Subject and Motion7 Dec
- 2023VideoBooth: Diffusion-based Video Generation with Image Prompts1 Dec
- 2023I2VGen-XL: High-Quality Image-to-Video Synthesis via Cascaded Diffusion Models7 Nov
- 2023DynamiCrafter: Animating Open-domain Images with Video Diffusion Priors18 Oct
- 2023ModelScope Text-to-Video Technical Report12 Aug
- 2023AnyDoor: Zero-shot Object-level Image Customization18 Jul
- 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuning10 Jul
- 2023Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Models18 Apr
- 2023Text2Video-Zero: Text-to-Image Diffusion Models are Zero-Shot Video Generators23 Mar
- 2023VideoFusion: Decomposed Diffusion Models for High-Quality Video Generation15 Mar
- 2023Structure and Content-Guided Video Synthesis with Diffusion Models6 Feb
2 more
Other references · 50
- 2017Attention Is All You Needcited by 59,932
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2020Denoising Diffusion Implicit Modelscited by 9,655
- 2023Segment Anythingcited by 8,158
- 2023Visual Instruction Tuningcited by 7,792
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
38 more
- 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,069
- 2022Scalable Diffusion Models with Transformerscited by 5,931
- 2022Classifier-Free Diffusion Guidancecited by 5,717
- 2022Flow Matching for Generative Modelingcited by 5,426
- 2018GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understandingcited by 4,854
- 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,151
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,550
- 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,286
- 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,274
- 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,385
- 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,231
- 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,755
- 2022Make-A-Video: Text-to-Video Generation without Text-Video Datacited by 1,725
- 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Modelscited by 1,439
- 2021Frozen in Time: A Joint Video and Image Encoder for End-to-End Retrievalcited by 1,175
- 2022Multi-Concept Customization of Text-to-Image Diffusioncited by 1,099
- 2022CogVideo: Large-scale Pretraining for Text-to-Video Generation via Transformerscited by 973
- 2023LISA: Reasoning Segmentation via Large Language Modelcited by 770
- 2022Phenaki: Variable Length Video Generation From Open Domain Textual Descriptioncited by 475
- 2023BLIP-Diffusion: Pre-trained Subject Representation for Controllable Text-to-Image Generation and Editingcited by 438
- 2024InstantID: Zero-shot Identity-Preserving Generation in Secondscited by 431
- 2023ELITE: Encoding Visual Concepts into Textual Embeddings for Customized Text-to-Image Generationcited by 414
- 2024Panda-70M: Captioning 70M Videos with Multiple Cross-Modality Teacherscited by 389
- 2023InstantBooth: Personalized Text-to-Image Generation without Test-Time Finetuningcited by 343
- 2023SVDiff: Compact Parameter Space for Diffusion Fine-Tuningcited by 338
- 2023Scaling Open-Vocabulary Object Detectioncited by 335
- 2023PhotoMaker: Customizing Realistic Human Photos via Stacked ID Embeddingcited by 324
- 2023FastComposer: Tuning-Free Multi-Subject Image Generation with Localized Attentioncited by 313
- 2022CelebV-HQ: A Large-Scale Video Facial Attributes Datasetcited by 246
- 2023Patch n' Pack: NaViT, a Vision Transformer for any Aspect Ratio and Resolutioncited by 226
- 2023Encoder-based Domain Tuning for Fast Personalization of Text-to-Image Modelscited by 203
- 2023Subject-Diffusion:Open Domain Personalized Text-to-Image Generation without Test-time Fine-tuningcited by 191
- 2023SSR-Encoder: Encoding Selective Subject Representation for Subject-Driven Generationcited by 142
- 2024MS-Diffusion: Multi-subject Zero-shot Image Personalization with Layout Guidancecited by 142
- 2024ID-Animator: Zero-Shot Identity-Preserving Human Video Generationcited by 122
- 2023Custom-Edit: Text-Guided Image Editing with Customized Diffusion Modelscited by 54
- 2024Story3D-Agent: Exploring 3D Storytelling Visualization with Large Language Modelscited by 9
Built on by
Citing papers per year: 2025: 42; 2026: 25.
67 papers.
Sort:
By area:
- 2025Phantom: Subject-consistent video generation via cross-modal alignmentcited by 126
- 2025Long Context Tuning for Video Generationcited by 110
- 2025Controllable Video Generation: A Surveycited by 93
- 2025UniVideo: Unified Understanding, Generation, and Editing for Videoscited by 85
- 2025HunyuanCustom: A Multimodal-Driven Architecture for Customized Video Generationcited by 84
- 2025OpenS2V-Nexus: A Detailed Benchmark and Million-Scale Dataset for Subject-to-Video Generationcited by 73
- 2025SkyReels-A2: Compose Anything in Video Diffusion Transformerscited by 72
- 2025HoloCine: Holistic Generation of Cinematic Multi-Shot Long Video Narrativescited by 51
- 2025FullDiT: Multi-Task Video Generative Foundation Model with Full Attentioncited by 45
- 2025OneStory: Coherent Multi-Shot Video Generation with Adaptive Memorycited by 31
- 2025Concat-ID: Towards Universal Identity-Preserving Video Synthesiscited by 28
- 2025DreamRelation: Relation-Centric Video Customizationcited by 23
38 more
- 2025MAGREF: Masked Guidance for Any-Reference Video Generation with Subject Disentanglementcited by 22
- 2025BindWeave: Subject-Consistent Video Generation via Cross-Modal Integrationcited by 22
- 2025InterActHuman: Multi-Concept Human Animation with Layout-Aligned Audio Conditionscited by 20
- 2025Hierarchical Fine-grained Preference Optimization for Physically Plausible Video Generationcited by 20
- 2025CINEMA: Coherent Multi-Subject Video Generation via MLLM-Based Guidancecited by 19
- 2025DreamActor-H1: High-Fidelity Human-Product Demonstration Video Generation via Motion-designed Diffusion Transformerscited by 19
- 2026DreamID-Omni: Unified Framework for Controllable Human-Centric Audio-Video Generationcited by 19
- 2025Phantom-Data : Towards a General Subject-Consistent Video Generation Datasetcited by 17
- 2025OmniVCus: Feedforward Subject-driven Video Customization with Multimodal Control Conditionscited by 17
- 2025PolyVivid: Vivid Multi-Subject Video Generation with Cross-Modal Interaction and Enhancementcited by 16
- 2025Cut2Next: Generating Next Shot via In-Context Tuningcited by 15
- 2025Simulating the Visual World with Artificial Intelligence: A Roadmapcited by 15
- 2025Video-As-Prompt: Unified Semantic Control for Video Generationcited by 13
- 2025Tora2: Motion and Appearance Customized Diffusion Transformer for Multi-Entity Video Generationcited by 12
- 2025Actial: Activate Spatial Reasoning Ability of Multimodal Large Language Modelscited by 10
- 2026RefAlign: Representation Alignment for Reference-to-Video Generationcited by 10
- 2025OmniInsert: Mask-Free Video Insertion of Any Reference via Diffusion Transformer Modelscited by 9
- 2025Identity-GRPO: Optimizing Multi-Human Identity-preserving Video Generation via Reinforcement Learningcited by 9
- 2025FilmWeaver: Weaving Consistent Multi-Shot Videos with Cache-Guided Autoregressive Diffusioncited by 9
- 2026MV-S2V: Multi-View Subject-Consistent Video Generationcited by 9
- 2025Any2Caption:Interpreting Any Condition to Caption for Controllable Video Generationcited by 8
- 2025AnimeShooter: A Multi-Shot Animation Dataset for Reference-Guided Video Generationcited by 8
- 2025Lynx: Towards High-Fidelity Personalized Video Generationcited by 8
- 2025Bind-Your-Avatar: Multi-Talking-Character Video Generation with Dynamic 3D-mask-based Embedding Routercited by 6
- 2025A Survey on Long-Video Storytelling Generation: Architectures, Consistency, and Cinematic Qualitycited by 6
- 2025MoFu: Scale-Aware Modulation and Fourier Fusion for Multi-Subject Video Generationcited by 6
- 2026OmniTransfer: All-in-one Framework for Spatio-temporal Video Transfercited by 6
- 2026LumosX: Relate Any Identities with Their Attributes for Personalized Video Generationcited by 6
- 2026Evolution of Video Generative Foundationscited by 6
- 2026Script-a-Video: Deep Structured Audio-visual Captions via Factorized Streams and Relational Groundingcited by 6
- 2025From Generated Human Videos to Physically Plausible Robot Trajectoriescited by 5
- 2025ContextAnyone: Context-Aware Diffusion for Character-Consistent Text-to-Video Generationcited by 5
- 2026DreamVideo-Omni: Omni-Motion Controlled Multi-Subject Video Customization with Latent Identity Reinforcement Learningcited by 4
- 2026MMControl: Unified Multi-Modal Control for Joint Audio-Video Generationcited by 4
- 2025AlcheMinT: Fine-grained Temporal Control for Multi-Reference Consistent Video Generationcited by 3
- 2025Over++: Generative Video Compositing for Layer Interaction Effectscited by 3
- 2026Tuning-free Visual Effect Transfer across Videoscited by 3
- 2026OmniCustom: Sync Audio-Video Customization Via Joint Audio-Video Generation Modelcited by 3
50 most cited of 67 All 67 (JSON)
- 2026One Editor, Many Edits: A Unified Training-Free Framework for Diverse Video Editing3 Sep 2026
- 2026KeyID: Decoupled Drafting and Keyframe Editing for Identity-Preserving Video Generation17 Aug 2026
- 2026Vera: Identity-Faithful Human Subject-to-Video Generation22 Jul 2026
- 2026HOMIE: Human-object Centric Video Personalization via Multimodal Intelligent Enhancement20 Jul 2026
- 2026Aura: Consistent Multi-Subject Video Generation via VLM-Grounded Semantic Alignment5 Jul 2026
- 2026DomainShuttle: Freeform Open Domain Subject-driven Text-to-video Generation24 Jun 2026
- 2026CineOrchestra: Unified Entity-Centric Conditioning for Cinematic Video Generation11 Jun 2026
- 2026TIDE: Task-Isolated Diffusion for Unified Video Editing and Generation6 Jun 2026
- 2026Spatial-Temporal Decoupled Reference Conditioning for Identity-Preserving Text-to-Video Generation1 Jun 2026
- 2026Omni-Customizer: End-to-End MultiModal Customization for Joint Audio-Video Generation17 May 2026
- 2026Generate Your Talking Avatar from Video Reference30 Apr 2026
- 2026MMControl: Unified Multi-Modal Control for Joint Audio-Video Generation21 Apr 2026
38 more
- 2026Script-a-Video: Deep Structured Audio-visual Captions via Factorized Streams and Relational Grounding13 Apr 2026
- 2026Evolution of Video Generative Foundations7 Apr 2026
- 2026RefAlign: Representation Alignment for Reference-to-Video Generation26 Mar 2026
- 2026LumosX: Relate Any Identities with Their Attributes for Personalized Video Generation20 Mar 2026
- 2026Identity as Presence: Towards Appearance and Voice Personalized Joint Audio-Video Generation18 Mar 2026
- 2026LibraGen: Playing a Balance Game in Subject-Driven Video Generation13 Mar 2026
- 2026DreamVideo-Omni: Omni-Motion Controlled Multi-Subject Video Customization with Latent Identity Reinforcement Learning12 Mar 2026
- 2026HECTOR: Hybrid Editable Compositional Object References for Video Generation9 Mar 2026
- 2026OmniCustom: Sync Audio-Video Customization Via Joint Audio-Video Generation Model12 Feb 2026
- 2026DreamID-Omni: Unified Framework for Controllable Human-Centric Audio-Video Generation12 Feb 2026
- 2026MV-S2V: Multi-View Subject-Consistent Video Generation25 Jan 2026
- 2026OmniTransfer: All-in-one Framework for Spatio-temporal Video Transfer20 Jan 2026
- 2026Tuning-free Visual Effect Transfer across Videos12 Jan 2026
- 2025MoFu: Scale-Aware Modulation and Fourier Fusion for Multi-Subject Video Generation26 Dec 2025
- 2025Over++: Generative Video Compositing for Layer Interaction Effects22 Dec 2025
- 2025FilmWeaver: Weaving Consistent Multi-Shot Videos with Cache-Guided Autoregressive Diffusion12 Dec 2025
- 2025AlcheMinT: Fine-grained Temporal Control for Multi-Reference Consistent Video Generation11 Dec 2025
- 2025OneStory: Coherent Multi-Shot Video Generation with Adaptive Memory8 Dec 2025
- 2025ContextAnyone: Context-Aware Diffusion for Character-Consistent Text-to-Video Generation8 Dec 2025
- 2025Bring Your Dreams to Life: Continual Text-to-Video Customization5 Dec 2025
- 2025From Generated Human Videos to Physically Plausible Robot Trajectories4 Dec 2025
- 2025Simulating the Visual World with Artificial Intelligence: A Roadmap11 Nov 2025
- 2025Actial: Activate Spatial Reasoning Ability of Multimodal Large Language Models3 Nov 2025
- 2025Video-As-Prompt: Unified Semantic Control for Video Generation23 Oct 2025
- 2025HoloCine: Holistic Generation of Cinematic Multi-Shot Long Video Narratives23 Oct 2025
- 2025Identity-GRPO: Optimizing Multi-Human Identity-preserving Video Generation via Reinforcement Learning16 Oct 2025
- 2025UniVideo: Unified Understanding, Generation, and Editing for Videos9 Oct 2025
- 2025UniMMVSR: A Unified Multi-Modal Framework for Cascaded Video Super-Resolution9 Oct 2025
- 2025BindWeave: Subject-Consistent Video Generation via Cross-Modal Integration1 Oct 2025
- 2025OmniInsert: Mask-Free Video Insertion of Any Reference via Diffusion Transformer Models22 Sep 2025
- 2025Lynx: Towards High-Fidelity Personalized Video Generation19 Sep 2025
- 2025Hierarchical Fine-grained Preference Optimization for Physically Plausible Video Generation14 Aug 2025
- 2025Cut2Next: Generating Next Shot via In-Context Tuning11 Aug 2025
- 2025Controllable Video Generation: A Survey22 Jul 2025
- 2025A Survey on Long-Video Storytelling Generation: Architectures, Consistency, and Cinematic Quality9 Jul 2025
- 2025Tora2: Motion and Appearance Customized Diffusion Transformer for Multi-Entity Video Generation8 Jul 2025
- 2025OmniVCus: Feedforward Subject-driven Video Customization with Multimodal Control Conditions29 Jun 2025
- 2025Bind-Your-Avatar: Multi-Talking-Character Video Generation with Dynamic 3D-mask-based Embedding Router24 Jun 2025
50 newest of 67 All 67 (JSON)
- 2025Long Context Tuning for Video Generationcited by 110
- 2025SkyReels-A2: Compose Anything in Video Diffusion Transformerscited by 72
- 2025BindWeave: Subject-Consistent Video Generation via Cross-Modal Integrationcited by 22
- 2025CINEMA: Coherent Multi-Subject Video Generation via MLLM-Based Guidancecited by 19
- 2025DreamActor-H1: High-Fidelity Human-Product Demonstration Video Generation via Motion-designed Diffusion Transformerscited by 19
- 2025Tora2: Motion and Appearance Customized Diffusion Transformer for Multi-Entity Video Generationcited by 12
- 2025OmniInsert: Mask-Free Video Insertion of Any Reference via Diffusion Transformer Modelscited by 9
- 2026LumosX: Relate Any Identities with Their Attributes for Personalized Video Generationcited by 6
- 2026DreamVideo-Omni: Omni-Motion Controlled Multi-Subject Video Customization with Latent Identity Reinforcement Learningcited by 4
- 2026MMControl: Unified Multi-Modal Control for Joint Audio-Video Generationcited by 4
- 2025AlcheMinT: Fine-grained Temporal Control for Multi-Reference Consistent Video Generationcited by 3
- 2026TIDE: Task-Isolated Diffusion for Unified Video Editing and Generationcited by 2
- 2026TIDE: Task-Isolated Diffusion for Unified Video Editing and Generation6 Jun 2026
- 2026MMControl: Unified Multi-Modal Control for Joint Audio-Video Generation21 Apr 2026
- 2026LumosX: Relate Any Identities with Their Attributes for Personalized Video Generation20 Mar 2026
- 2026DreamVideo-Omni: Omni-Motion Controlled Multi-Subject Video Customization with Latent Identity Reinforcement Learning12 Mar 2026
- 2025AlcheMinT: Fine-grained Temporal Control for Multi-Reference Consistent Video Generation11 Dec 2025
- 2025BindWeave: Subject-Consistent Video Generation via Cross-Modal Integration1 Oct 2025
- 2025OmniInsert: Mask-Free Video Insertion of Any Reference via Diffusion Transformer Models22 Sep 2025
- 2025Tora2: Motion and Appearance Customized Diffusion Transformer for Multi-Entity Video Generation8 Jul 2025
- 2025DreamActor-H1: High-Fidelity Human-Product Demonstration Video Generation via Motion-designed Diffusion Transformers12 Jun 2025
- 2025SkyReels-A2: Compose Anything in Video Diffusion Transformers3 Apr 2025
- 2025Long Context Tuning for Video Generation13 Mar 2025
- 2025CINEMA: Coherent Multi-Subject Video Generation via MLLM-Based Guidance13 Mar 2025
- 2025Simulating the Visual World with Artificial Intelligence: A Roadmapcited by 15
- 2026Evolution of Video Generative Foundationscited by 6
- 2026Evolution of Video Generative Foundations7 Apr 2026
- 2025Simulating the Visual World with Artificial Intelligence: A Roadmap11 Nov 2025
- 2025Phantom: Subject-consistent video generation via cross-modal alignmentcited by 126
- 2025Controllable Video Generation: A Surveycited by 93
- 2025UniVideo: Unified Understanding, Generation, and Editing for Videoscited by 85
- 2025HunyuanCustom: A Multimodal-Driven Architecture for Customized Video Generationcited by 84
- 2025OpenS2V-Nexus: A Detailed Benchmark and Million-Scale Dataset for Subject-to-Video Generationcited by 73
- 2025HoloCine: Holistic Generation of Cinematic Multi-Shot Long Video Narrativescited by 51
- 2025FullDiT: Multi-Task Video Generative Foundation Model with Full Attentioncited by 45
- 2025OneStory: Coherent Multi-Shot Video Generation with Adaptive Memorycited by 31
- 2025Concat-ID: Towards Universal Identity-Preserving Video Synthesiscited by 28
- 2025DreamRelation: Relation-Centric Video Customizationcited by 23
- 2025MAGREF: Masked Guidance for Any-Reference Video Generation with Subject Disentanglementcited by 22
- 2025InterActHuman: Multi-Concept Human Animation with Layout-Aligned Audio Conditionscited by 20
12 most cited of 49 All 49 (JSON)
- 2026One Editor, Many Edits: A Unified Training-Free Framework for Diverse Video Editing3 Sep 2026
- 2026KeyID: Decoupled Drafting and Keyframe Editing for Identity-Preserving Video Generation17 Aug 2026
- 2026Vera: Identity-Faithful Human Subject-to-Video Generation22 Jul 2026
- 2026HOMIE: Human-object Centric Video Personalization via Multimodal Intelligent Enhancement20 Jul 2026
- 2026Aura: Consistent Multi-Subject Video Generation via VLM-Grounded Semantic Alignment5 Jul 2026
- 2026DomainShuttle: Freeform Open Domain Subject-driven Text-to-video Generation24 Jun 2026
- 2026CineOrchestra: Unified Entity-Centric Conditioning for Cinematic Video Generation11 Jun 2026
- 2026Spatial-Temporal Decoupled Reference Conditioning for Identity-Preserving Text-to-Video Generation1 Jun 2026
- 2026Omni-Customizer: End-to-End MultiModal Customization for Joint Audio-Video Generation17 May 2026
- 2026Generate Your Talking Avatar from Video Reference30 Apr 2026
- 2026RefAlign: Representation Alignment for Reference-to-Video Generation26 Mar 2026
- 2026Identity as Presence: Towards Appearance and Voice Personalized Joint Audio-Video Generation18 Mar 2026
12 newest of 49 All 49 (JSON)
Similar, not cited
Close in wording, no citation either way
- 2024CustomCrafter: Customized Video Generation with Preserving Motion and Concept Composition Abilities
- 2024TweedieMix: Improving Multi-Concept Fusion for Diffusion-based Image/Video Generation
- 2025Dynamic Concepts Personalization from Single Videos
- 2026A Comprehensive Ecosystem for Open-Domain Customized Video Generation
- 2025VideoMage: Multi-Subject and Motion Customization of Text-to-Video Diffusion Models
- 2025Ingredients: Blending Custom Photos with Video Diffusion Transformers
- 2025MoCA: Identity-Preserving Text-to-Video Generation via Mixture of Cross Attention
- 2024CustomVideo: Customizing Text-to-Video Generation with Multiple Subjects