Movie Weaver: Tuning-Free Multi-Concept Video Personalization with Anchored Prompts
Not on the map. Why?
Abstract (arXiv)
Video personalization, which generates customized videos using reference images, has gained significant attention. However, prior methods typically focus on single-concept personalization, limiting broader applications that require multi-concept integration. Attempts to extend these models to multiple concepts often lead to identity blending, which results in composite characters with fused attributes from multiple sources. This challenge arises due to the lack of a mechanism to link each concept with its specific reference image. We address this with anchored prompts, which embed image anchors as unique tokens within text prompts, guiding accurate referencing during generation. Additionally, we introduce concept embeddings to encode the order of reference images. Our approach, Movie Weaver, seamlessly weaves multiple concepts-including face, body, and animal images-into one video, allowing flexible combinations in a single model. The evaluation shows that Movie Weaver outperforms existing methods for multi-concept video personalization in identity preservation and overall quality.
Key facts. Cited by 28 papers in the map (data through 7 Oct 2026). Builds on 57 of its 67 references that are in the map. First posted on arXiv 4 Feb 2025.
Builds on
57 of 67 references.
References · 57
- 2017Attention Is All You Needcited by 59,932
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2024The Llama 3 Herd of Modelscited by 14,192
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2023Segment Anythingcited by 8,158
- 2023Visual Instruction Tuningcited by 7,792
- 2022Scalable Diffusion Models with Transformerscited by 5,931
- 2022Flow Matching for Generative Modelingcited by 5,426
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
- 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,286
- 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,274
38 more
- 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,231
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,198
- 2022Imagen Video: High Definition Video Generation with Diffusion Modelscited by 1,765
- 2022Make-A-Video: Text-to-Video Generation without Text-Video Datacited by 1,725
- 2023Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Modelscited by 1,465
- 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Modelscited by 1,439
- 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuningcited by 1,418
- 2022Multi-Concept Customization of Text-to-Image Diffusioncited by 1,099
- 2024Movie Gen: A Cast of Media Foundation Modelscited by 614
- 2022Detecting Twenty-thousand Classes using Image-level Supervisioncited by 613
- 2023VideoCrafter1: Open Diffusion Models for High-Quality Video Generationcited by 530
- 2021ByT5: Towards a token-free future with pre-trained byte-to-byte modelscited by 504
- 2023VideoPoet: A Large Language Model for Zero-Shot Video Generationcited by 479
- 2022Phenaki: Variable Length Video Generation From Open Domain Textual Descriptioncited by 475
- 2022MagicVideo: Efficient Video Generation With Latent Diffusion Modelscited by 463
- 2024Lumiere: A Space-Time Diffusion Model for Video Generationcited by 450
- 2024InstantID: Zero-shot Identity-Preserving Generation in Secondscited by 431
- 2023ELITE: Encoding Visual Concepts into Textual Embeddings for Customized Text-to-Image Generationcited by 414
- 2023PhotoMaker: Customizing Realistic Human Photos via Stacked ID Embeddingcited by 324
- 2023FastComposer: Tuning-Free Multi-Subject Image Generation with Localized Attentioncited by 313
- 2023Emu: Enhancing Image Generation Models Using Photogenic Needles in a Haystackcited by 278
- 2023Mix-of-Show: Decentralized Low-Rank Adaptation for Multi-Concept Customization of Diffusion Modelscited by 261
- 2023Emu Video: Factorizing Text-to-Video Generation by Explicit Image Conditioningcited by 254
- 2023Break-A-Scene: Extracting Multiple Concepts from a Single Imagecited by 230
- 2023DreamVideo: Composing Your Dream Videos with Customized Subject and Motioncited by 186
- 2023VideoBooth: Diffusion-based Video Generation with Image Promptscited by 124
- 2024ID-Animator: Zero-Shot Identity-Preserving Human Video Generationcited by 122
- 2023Cones 2: Customizable Image Synthesis with Multiple Subjectscited by 101
- 2023GenTron: Diffusion Transformers for Image and Video Generationcited by 80
- 2024CustomVideo: Customizing Text-to-Video Generation with Multiple Subjectscited by 76
- 2023PhotoVerse: Tuning-Free Image Customization with Text-to-Image Diffusion Modelscited by 70
- 2025Multi-subject Open-set Personalization in Video Generationcited by 65
- 2024OMG: Occlusion-friendly Personalized Multi-concept Generation in Diffusion Modelscited by 64
- 2024Magic-Me: Identity-Specific Video Customized Diffusioncited by 58
- 2024CustomCrafter: Customized Video Generation with Preserving Motion and Concept Composition Abilitiescited by 58
- 2024MoA: Mixture-of-Attention for Subject-Context Disentanglement in Personalized Image Generationcited by 51
- 2024FreeCustom: Tuning-Free Customized Image Generation for Multi-Concept Compositioncited by 49
- 2024UniPortrait: A Unified Framework for Identity-Preserving Single- and Multi-Human Image Personalizationcited by 46
50 most cited of 57 All 57 (JSON)
Built on by
Citing papers per year: 2025: 14; 2026: 14.
28 papers.
Sort:
By area:
- 2025Phantom: Subject-consistent video generation via cross-modal alignmentcited by 126
- 2025Controllable Video Generation: A Surveycited by 93
- 2025UniVideo: Unified Understanding, Generation, and Editing for Videoscited by 85
- 2025OpenS2V-Nexus: A Detailed Benchmark and Million-Scale Dataset for Subject-to-Video Generationcited by 73
- 2025MoCha: Towards Movie-Grade Talking Character Synthesiscited by 31
- 2025Personalized Image Generation with Deep Generative Models: A Decade Surveycited by 20
- 2025DreamActor-H1: High-Fidelity Human-Product Demonstration Video Generation via Motion-designed Diffusion Transformerscited by 19
- 2025Phantom-Data : Towards a General Subject-Consistent Video Generation Datasetcited by 17
- 2026RefAlign: Representation Alignment for Reference-to-Video Generationcited by 10
- 2026MV-S2V: Multi-View Subject-Consistent Video Generationcited by 9
- 2025Identity-Preserving Text-to-Video Generation via Training-Free Prompt, Image, and Guidance Enhancementcited by 8
- 2025MoFu: Scale-Aware Modulation and Fourier Fusion for Multi-Subject Video Generationcited by 6
16 more
- 2026OmniTransfer: All-in-one Framework for Spatio-temporal Video Transfercited by 6
- 2026Script-a-Video: Deep Structured Audio-visual Captions via Factorized Streams and Relational Groundingcited by 6
- 2025From Generated Human Videos to Physically Plausible Robot Trajectoriescited by 5
- 2026Tuning-free Visual Effect Transfer across Videoscited by 3
- 2025Bring Your Dreams to Life: Continual Text-to-Video Customizationcited by 2
- 2026LibraGen: Playing a Balance Game in Subject-Driven Video Generationcited by 2
- 2026Omni-Customizer: End-to-End MultiModal Customization for Joint Audio-Video Generationcited by 2
- 2025Character Mixing for Video Generationcited by 1
- 2026Identity as Presence: Towards Appearance and Voice Personalized Joint Audio-Video Generationcited by 1
- 2025Unified Text-Image-to-Video Generation: A Training-Free Approach to Flexible Visual Conditioningcited by 0
- 2026Spatial-Temporal Decoupled Reference Conditioning for Identity-Preserving Text-to-Video Generationcited by 0
- 2026MultiAnimate: A Unified Framework for Controllable Multi-Character Animationcited by 0
- 2026HOMIE: Human-object Centric Video Personalization via Multimodal Intelligent Enhancementcited by 0
- 2026Vera: Identity-Faithful Human Subject-to-Video Generationcited by 0
- 2026RefCaptioner: Multi-Reference Image-Grounded Video Captioningcited by 0
- 2026Identity-Preserving Text-to-Video Generation via Agentic Enhancement and Semantic Repaircited by 0
- 2026Identity-Preserving Text-to-Video Generation via Agentic Enhancement and Semantic Repair21 Aug 2026
- 2026RefCaptioner: Multi-Reference Image-Grounded Video Captioning30 Jul 2026
- 2026Vera: Identity-Faithful Human Subject-to-Video Generation22 Jul 2026
- 2026HOMIE: Human-object Centric Video Personalization via Multimodal Intelligent Enhancement20 Jul 2026
- 2026MultiAnimate: A Unified Framework for Controllable Multi-Character Animation15 Jul 2026
- 2026Spatial-Temporal Decoupled Reference Conditioning for Identity-Preserving Text-to-Video Generation1 Jun 2026
- 2026Omni-Customizer: End-to-End MultiModal Customization for Joint Audio-Video Generation17 May 2026
- 2026Script-a-Video: Deep Structured Audio-visual Captions via Factorized Streams and Relational Grounding13 Apr 2026
- 2026RefAlign: Representation Alignment for Reference-to-Video Generation26 Mar 2026
- 2026Identity as Presence: Towards Appearance and Voice Personalized Joint Audio-Video Generation18 Mar 2026
- 2026LibraGen: Playing a Balance Game in Subject-Driven Video Generation13 Mar 2026
- 2026MV-S2V: Multi-View Subject-Consistent Video Generation25 Jan 2026
16 more
- 2026OmniTransfer: All-in-one Framework for Spatio-temporal Video Transfer20 Jan 2026
- 2026Tuning-free Visual Effect Transfer across Videos12 Jan 2026
- 2025MoFu: Scale-Aware Modulation and Fourier Fusion for Multi-Subject Video Generation26 Dec 2025
- 2025Bring Your Dreams to Life: Continual Text-to-Video Customization5 Dec 2025
- 2025From Generated Human Videos to Physically Plausible Robot Trajectories4 Dec 2025
- 2025UniVideo: Unified Understanding, Generation, and Editing for Videos9 Oct 2025
- 2025Character Mixing for Video Generation6 Oct 2025
- 2025Identity-Preserving Text-to-Video Generation via Training-Free Prompt, Image, and Guidance Enhancement1 Sep 2025
- 2025Controllable Video Generation: A Survey22 Jul 2025
- 2025Phantom-Data : Towards a General Subject-Consistent Video Generation Dataset23 Jun 2025
- 2025DreamActor-H1: High-Fidelity Human-Product Demonstration Video Generation via Motion-designed Diffusion Transformers12 Jun 2025
- 2025Unified Text-Image-to-Video Generation: A Training-Free Approach to Flexible Visual Conditioning27 May 2025
- 2025OpenS2V-Nexus: A Detailed Benchmark and Million-Scale Dataset for Subject-to-Video Generation26 May 2025
- 2025MoCha: Towards Movie-Grade Talking Character Synthesis30 Mar 2025
- 2025Personalized Image Generation with Deep Generative Models: A Decade Survey18 Feb 2025
- 2025Phantom: Subject-consistent video generation via cross-modal alignment16 Feb 2025
- 2025Phantom: Subject-consistent video generation via cross-modal alignmentcited by 126
- 2025Controllable Video Generation: A Surveycited by 93
- 2025UniVideo: Unified Understanding, Generation, and Editing for Videoscited by 85
- 2025OpenS2V-Nexus: A Detailed Benchmark and Million-Scale Dataset for Subject-to-Video Generationcited by 73
- 2025MoCha: Towards Movie-Grade Talking Character Synthesiscited by 31
- 2025Personalized Image Generation with Deep Generative Models: A Decade Surveycited by 20
- 2025Phantom-Data : Towards a General Subject-Consistent Video Generation Datasetcited by 17
- 2026RefAlign: Representation Alignment for Reference-to-Video Generationcited by 10
- 2026MV-S2V: Multi-View Subject-Consistent Video Generationcited by 9
- 2025Identity-Preserving Text-to-Video Generation via Training-Free Prompt, Image, and Guidance Enhancementcited by 8
- 2025MoFu: Scale-Aware Modulation and Fourier Fusion for Multi-Subject Video Generationcited by 6
- 2026OmniTransfer: All-in-one Framework for Spatio-temporal Video Transfercited by 6
12 most cited of 24 All 24 (JSON)
- 2026RefCaptioner: Multi-Reference Image-Grounded Video Captioning30 Jul 2026
- 2026Vera: Identity-Faithful Human Subject-to-Video Generation22 Jul 2026
- 2026HOMIE: Human-object Centric Video Personalization via Multimodal Intelligent Enhancement20 Jul 2026
- 2026MultiAnimate: A Unified Framework for Controllable Multi-Character Animation15 Jul 2026
- 2026Spatial-Temporal Decoupled Reference Conditioning for Identity-Preserving Text-to-Video Generation1 Jun 2026
- 2026Omni-Customizer: End-to-End MultiModal Customization for Joint Audio-Video Generation17 May 2026
- 2026RefAlign: Representation Alignment for Reference-to-Video Generation26 Mar 2026
- 2026Identity as Presence: Towards Appearance and Voice Personalized Joint Audio-Video Generation18 Mar 2026
- 2026MV-S2V: Multi-View Subject-Consistent Video Generation25 Jan 2026
- 2026OmniTransfer: All-in-one Framework for Spatio-temporal Video Transfer20 Jan 2026
- 2026Tuning-free Visual Effect Transfer across Videos12 Jan 2026
- 2025MoFu: Scale-Aware Modulation and Fourier Fusion for Multi-Subject Video Generation26 Dec 2025
12 newest of 24 All 24 (JSON)