mlsanityData to 7 Oct 2026

Movie Weaver: Tuning-Free Multi-Concept Video Personalization with Anchored Prompts

arXiv 2502.07802 ↗First posted 4 Feb 2025cs.CV cs.GR cs.LGcited by 28

Not on the map. Why?

Abstract (arXiv)

Video personalization, which generates customized videos using reference images, has gained significant attention. However, prior methods typically focus on single-concept personalization, limiting broader applications that require multi-concept integration. Attempts to extend these models to multiple concepts often lead to identity blending, which results in composite characters with fused attributes from multiple sources. This challenge arises due to the lack of a mechanism to link each concept with its specific reference image. We address this with anchored prompts, which embed image anchors as unique tokens within text prompts, guiding accurate referencing during generation. Additionally, we introduce concept embeddings to encode the order of reference images. Our approach, Movie Weaver, seamlessly weaves multiple concepts-including face, body, and animal images-into one video, allowing flexible combinations in a single model. The evaluation shows that Movie Weaver outperforms existing methods for multi-concept video personalization in identity preservation and overall quality.

Key facts. Cited by 28 papers in the map (data through 7 Oct 2026). Builds on 57 of its 67 references that are in the map. First posted on arXiv 4 Feb 2025.

Builds on

57 of 67 references.

References · 57

  1. 2017Attention Is All You Needcited by 59,932
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  3. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  4. 2024The Llama 3 Herd of Modelscited by 14,192
  5. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  6. 2023Segment Anythingcited by 8,158
  7. 2023Visual Instruction Tuningcited by 7,792
  8. 2022Scalable Diffusion Models with Transformerscited by 5,931
  9. 2022Flow Matching for Generative Modelingcited by 5,426
  10. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
  11. 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,286
  12. 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,274
38 more
  1. 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,231
  2. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,198
  3. 2022Imagen Video: High Definition Video Generation with Diffusion Modelscited by 1,765
  4. 2022Make-A-Video: Text-to-Video Generation without Text-Video Datacited by 1,725
  5. 2023Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Modelscited by 1,465
  6. 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Modelscited by 1,439
  7. 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuningcited by 1,418
  8. 2022Multi-Concept Customization of Text-to-Image Diffusioncited by 1,099
  9. 2024Movie Gen: A Cast of Media Foundation Modelscited by 614
  10. 2022Detecting Twenty-thousand Classes using Image-level Supervisioncited by 613
  11. 2023VideoCrafter1: Open Diffusion Models for High-Quality Video Generationcited by 530
  12. 2021ByT5: Towards a token-free future with pre-trained byte-to-byte modelscited by 504
  13. 2023VideoPoet: A Large Language Model for Zero-Shot Video Generationcited by 479
  14. 2022Phenaki: Variable Length Video Generation From Open Domain Textual Descriptioncited by 475
  15. 2022MagicVideo: Efficient Video Generation With Latent Diffusion Modelscited by 463
  16. 2024Lumiere: A Space-Time Diffusion Model for Video Generationcited by 450
  17. 2024InstantID: Zero-shot Identity-Preserving Generation in Secondscited by 431
  18. 2023ELITE: Encoding Visual Concepts into Textual Embeddings for Customized Text-to-Image Generationcited by 414
  19. 2023PhotoMaker: Customizing Realistic Human Photos via Stacked ID Embeddingcited by 324
  20. 2023FastComposer: Tuning-Free Multi-Subject Image Generation with Localized Attentioncited by 313
  21. 2023Emu: Enhancing Image Generation Models Using Photogenic Needles in a Haystackcited by 278
  22. 2023Mix-of-Show: Decentralized Low-Rank Adaptation for Multi-Concept Customization of Diffusion Modelscited by 261
  23. 2023Emu Video: Factorizing Text-to-Video Generation by Explicit Image Conditioningcited by 254
  24. 2023Break-A-Scene: Extracting Multiple Concepts from a Single Imagecited by 230
  25. 2023DreamVideo: Composing Your Dream Videos with Customized Subject and Motioncited by 186
  26. 2023VideoBooth: Diffusion-based Video Generation with Image Promptscited by 124
  27. 2024ID-Animator: Zero-Shot Identity-Preserving Human Video Generationcited by 122
  28. 2023Cones 2: Customizable Image Synthesis with Multiple Subjectscited by 101
  29. 2023GenTron: Diffusion Transformers for Image and Video Generationcited by 80
  30. 2024CustomVideo: Customizing Text-to-Video Generation with Multiple Subjectscited by 76
  31. 2023PhotoVerse: Tuning-Free Image Customization with Text-to-Image Diffusion Modelscited by 70
  32. 2025Multi-subject Open-set Personalization in Video Generationcited by 65
  33. 2024OMG: Occlusion-friendly Personalized Multi-concept Generation in Diffusion Modelscited by 64
  34. 2024Magic-Me: Identity-Specific Video Customized Diffusioncited by 58
  35. 2024CustomCrafter: Customized Video Generation with Preserving Motion and Concept Composition Abilitiescited by 58
  36. 2024MoA: Mixture-of-Attention for Subject-Context Disentanglement in Personalized Image Generationcited by 51
  37. 2024FreeCustom: Tuning-Free Customized Image Generation for Multi-Concept Compositioncited by 49
  38. 2024UniPortrait: A Unified Framework for Identity-Preserving Single- and Multi-Human Image Personalizationcited by 46

50 most cited of 57 All 57 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 14; 2026: 14.

28 papers.

Sort:

By area:

  1. 2025Phantom: Subject-consistent video generation via cross-modal alignmentcited by 126
  2. 2025Controllable Video Generation: A Surveycited by 93
  3. 2025UniVideo: Unified Understanding, Generation, and Editing for Videoscited by 85
  4. 2025OpenS2V-Nexus: A Detailed Benchmark and Million-Scale Dataset for Subject-to-Video Generationcited by 73
  5. 2025MoCha: Towards Movie-Grade Talking Character Synthesiscited by 31
  6. 2025Personalized Image Generation with Deep Generative Models: A Decade Surveycited by 20
  7. 2025DreamActor-H1: High-Fidelity Human-Product Demonstration Video Generation via Motion-designed Diffusion Transformerscited by 19
  8. 2025Phantom-Data : Towards a General Subject-Consistent Video Generation Datasetcited by 17
  9. 2026RefAlign: Representation Alignment for Reference-to-Video Generationcited by 10
  10. 2026MV-S2V: Multi-View Subject-Consistent Video Generationcited by 9
  11. 2025Identity-Preserving Text-to-Video Generation via Training-Free Prompt, Image, and Guidance Enhancementcited by 8
  12. 2025MoFu: Scale-Aware Modulation and Fourier Fusion for Multi-Subject Video Generationcited by 6
16 more
  1. 2026OmniTransfer: All-in-one Framework for Spatio-temporal Video Transfercited by 6
  2. 2026Script-a-Video: Deep Structured Audio-visual Captions via Factorized Streams and Relational Groundingcited by 6
  3. 2025From Generated Human Videos to Physically Plausible Robot Trajectoriescited by 5
  4. 2026Tuning-free Visual Effect Transfer across Videoscited by 3
  5. 2025Bring Your Dreams to Life: Continual Text-to-Video Customizationcited by 2
  6. 2026LibraGen: Playing a Balance Game in Subject-Driven Video Generationcited by 2
  7. 2026Omni-Customizer: End-to-End MultiModal Customization for Joint Audio-Video Generationcited by 2
  8. 2025Character Mixing for Video Generationcited by 1
  9. 2026Identity as Presence: Towards Appearance and Voice Personalized Joint Audio-Video Generationcited by 1
  10. 2025Unified Text-Image-to-Video Generation: A Training-Free Approach to Flexible Visual Conditioningcited by 0
  11. 2026Spatial-Temporal Decoupled Reference Conditioning for Identity-Preserving Text-to-Video Generationcited by 0
  12. 2026MultiAnimate: A Unified Framework for Controllable Multi-Character Animationcited by 0
  13. 2026HOMIE: Human-object Centric Video Personalization via Multimodal Intelligent Enhancementcited by 0
  14. 2026Vera: Identity-Faithful Human Subject-to-Video Generationcited by 0
  15. 2026RefCaptioner: Multi-Reference Image-Grounded Video Captioningcited by 0
  16. 2026Identity-Preserving Text-to-Video Generation via Agentic Enhancement and Semantic Repaircited by 0