mlsanityData to 14 Oct 2026

PolyVivid: Vivid Multi-Subject Video Generation with Cross-Modal Interaction and Enhancement

arXiv 2506.07848 ↗First posted 9 Jun 2025cs.CV cs.AIcited by 16

Not on the map. Why?

Abstract (arXiv)

Despite recent advances in video generation, existing models still lack fine-grained controllability, especially for multi-subject customization with consistent identity and interaction. In this paper, we propose PolyVivid, a multi-subject video customization framework that enables flexible and identity-consistent generation. To establish accurate correspondences between subject images and textual entities, we design a VLLM-based text-image fusion module that embeds visual identities into the textual space for precise grounding. To further enhance identity preservation and subject interaction, we propose a 3D-RoPE-based enhancement module that enables structured bidirectional fusion between text and image embeddings. Moreover, we develop an attention-inherited identity injection module to effectively inject fused identity features into the video generation process, mitigating identity drift. Finally, we construct an MLLM-based data pipeline that combines MLLM-based grounding, segmentation, and a clique-based subject consolidation strategy to produce high-quality multi-subject data, effectively enhancing subject distinction and reducing ambiguity in downstream video generation. Extensive experiments demonstrate that PolyVivid achieves superior performance in identity fidelity, video realism, and subject alignment, outperforming existing open-source and commercial baselines.

Key facts. Cited by 16 papers in the map (data through 14 Oct 2026). Builds on 43 of its 54 references that are in the map. First posted on arXiv 9 Jun 2025.

Builds on

43 of 54 references.

References · 43

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  3. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
  4. 2023Visual Instruction Tuningcited by 7,869
  5. 2022Scalable Diffusion Models with Transformerscited by 6,054
  6. 2025Qwen2.5-VL Technical Reportcited by 5,587
  7. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
  8. 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,332
  9. 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,300
  10. 2017Quo Vadis, Action Recognition? A New Model and the Kinetics Datasetcited by 3,270
  11. 2024SAM 2: Segment Anything in Images and Videoscited by 2,863
  12. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
31 more
  1. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,581
  2. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
  3. 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
  4. 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
  5. 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Modelscited by 1,464
  6. 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuningcited by 1,433
  7. 2023LISA: Reasoning Segmentation via Large Language Modelcited by 776
  8. 2025VACE: All-in-One Video Creation and Editingcited by 479
  9. 2024Sora: A Review on Background, Technology, Limitations, and Opportunities of Large Vision Modelscited by 477
  10. 2023BLIP-Diffusion: Pre-trained Subject Representation for Controllable Text-to-Image Generation and Editingcited by 442
  11. 2024YOLOv11: An Overview of the Key Architectural Enhancementscited by 425
  12. 2023Florence-2: Advancing a Unified Representation for a Variety of Vision Taskscited by 410
  13. 2024Panda-70M: Captioning 70M Videos with Multiple Cross-Modality Teacherscited by 393
  14. 2024OminiControl: Minimal and Universal Control for Diffusion Transformercited by 340
  15. 2024Identity-Preserving Text-to-Video Generation by Frequency Decompositioncited by 158
  16. 2024Koala-36M: A Large-scale Video Dataset Improving Consistency between Fine-grained Conditions and Video Contentcited by 135
  17. 2025Phantom: Subject-consistent video generation via cross-modal alignmentcited by 129
  18. 2023VideoBooth: Diffusion-based Video Generation with Image Promptscited by 126
  19. 2024ID-Animator: Zero-Shot Identity-Preserving Human Video Generationcited by 124
  20. 2025HunyuanCustom: A Multimodal-Driven Architecture for Customized Video Generationcited by 87
  21. 2024CustomVideo: Customizing Text-to-Video Generation with Multiple Subjectscited by 77
  22. 2025SkyReels-A2: Compose Anything in Video Diffusion Transformerscited by 73
  23. 2024Allegro: Open the Black Box of Commercial-Level Video Generation Modelcited by 70
  24. 2025ConceptMaster: Multi-Concept Video Customization on Diffusion Transformer Models Without Test-Time Tuningcited by 68
  25. 2025Multi-subject Open-set Personalization in Video Generationcited by 66
  26. 2024CustomCrafter: Customized Video Generation with Preserving Motion and Concept Composition Abilitiescited by 60
  27. 2024MotionMaster: Training-free Camera Motion Transfer For Video Generationcited by 51
  28. 2024Still-Moving: Customized Video Generation without Customized Video Datacited by 50
  29. 2024MoMA: Multimodal LLM Adapter for Fast Personalized Image Generationcited by 35
  30. 2024DisenStudio: Customized Multi-subject Text-to-Video Generation with Disentangled Spatial Controlcited by 20
  31. 2023Phasic Content Fusing Diffusion Model with Directional Distribution Consistency for Few-Shot Model Adaptioncited by 11

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 5; 2026: 11.

16 papers.

Sort:

By area:

Similar, not cited

Close in wording, no citation either way

  1. 2026HarmoView: Harmonizing Multi-View Constraints for Identity-Consistent Video Generation
  2. 2026GroupVideo: Multi-Identity Customized Text-to-Video Generation
  3. 2025AlcheMinT: Fine-grained Temporal Control for Multi-Reference Consistent Video Generation
  4. 2025OpenSubject: Leveraging Video-Derived Identity and Diversity Priors for Subject-driven Image Generation and Manipulation
  5. 2025Virtually Being: Customizing Camera-Controllable Video Diffusion Models with Multi-View Performance Captures
  6. 2026ARGUS: Stacked Multi-View Identity Mosaic Injection for Subject-Preserving Video Generation
  7. 2025VideoMage: Multi-Subject and Motion Customization of Text-to-Video Diffusion Models
  8. 2025Identity-Preserving Text-to-Video Generation via Training-Free Prompt, Image, and Guidance Enhancement