PolyVivid: Vivid Multi-Subject Video Generation with Cross-Modal Interaction and Enhancement
Not on the map. Why?
Abstract (arXiv)
Despite recent advances in video generation, existing models still lack fine-grained controllability, especially for multi-subject customization with consistent identity and interaction. In this paper, we propose PolyVivid, a multi-subject video customization framework that enables flexible and identity-consistent generation. To establish accurate correspondences between subject images and textual entities, we design a VLLM-based text-image fusion module that embeds visual identities into the textual space for precise grounding. To further enhance identity preservation and subject interaction, we propose a 3D-RoPE-based enhancement module that enables structured bidirectional fusion between text and image embeddings. Moreover, we develop an attention-inherited identity injection module to effectively inject fused identity features into the video generation process, mitigating identity drift. Finally, we construct an MLLM-based data pipeline that combines MLLM-based grounding, segmentation, and a clique-based subject consolidation strategy to produce high-quality multi-subject data, effectively enhancing subject distinction and reducing ambiguity in downstream video generation. Extensive experiments demonstrate that PolyVivid achieves superior performance in identity fidelity, video realism, and subject alignment, outperforming existing open-source and commercial baselines.
Key facts. Cited by 16 papers in the map (data through 14 Oct 2026). Builds on 43 of its 54 references that are in the map. First posted on arXiv 9 Jun 2025.
Builds on
43 of 54 references.
References · 43
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2023Visual Instruction Tuningcited by 7,869
- 2022Scalable Diffusion Models with Transformerscited by 6,054
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
- 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,332
- 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,300
- 2017Quo Vadis, Action Recognition? A New Model and the Kinetics Datasetcited by 3,270
- 2024SAM 2: Segment Anything in Images and Videoscited by 2,863
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
31 more
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,581
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
- 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
- 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
- 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Modelscited by 1,464
- 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuningcited by 1,433
- 2023LISA: Reasoning Segmentation via Large Language Modelcited by 776
- 2025VACE: All-in-One Video Creation and Editingcited by 479
- 2024Sora: A Review on Background, Technology, Limitations, and Opportunities of Large Vision Modelscited by 477
- 2023BLIP-Diffusion: Pre-trained Subject Representation for Controllable Text-to-Image Generation and Editingcited by 442
- 2024YOLOv11: An Overview of the Key Architectural Enhancementscited by 425
- 2023Florence-2: Advancing a Unified Representation for a Variety of Vision Taskscited by 410
- 2024Panda-70M: Captioning 70M Videos with Multiple Cross-Modality Teacherscited by 393
- 2024OminiControl: Minimal and Universal Control for Diffusion Transformercited by 340
- 2024Identity-Preserving Text-to-Video Generation by Frequency Decompositioncited by 158
- 2024Koala-36M: A Large-scale Video Dataset Improving Consistency between Fine-grained Conditions and Video Contentcited by 135
- 2025Phantom: Subject-consistent video generation via cross-modal alignmentcited by 129
- 2023VideoBooth: Diffusion-based Video Generation with Image Promptscited by 126
- 2024ID-Animator: Zero-Shot Identity-Preserving Human Video Generationcited by 124
- 2025HunyuanCustom: A Multimodal-Driven Architecture for Customized Video Generationcited by 87
- 2024CustomVideo: Customizing Text-to-Video Generation with Multiple Subjectscited by 77
- 2025SkyReels-A2: Compose Anything in Video Diffusion Transformerscited by 73
- 2024Allegro: Open the Black Box of Commercial-Level Video Generation Modelcited by 70
- 2025ConceptMaster: Multi-Concept Video Customization on Diffusion Transformer Models Without Test-Time Tuningcited by 68
- 2025Multi-subject Open-set Personalization in Video Generationcited by 66
- 2024CustomCrafter: Customized Video Generation with Preserving Motion and Concept Composition Abilitiescited by 60
- 2024MotionMaster: Training-free Camera Motion Transfer For Video Generationcited by 51
- 2024Still-Moving: Customized Video Generation without Customized Video Datacited by 50
- 2024MoMA: Multimodal LLM Adapter for Fast Personalized Image Generationcited by 35
- 2024DisenStudio: Customized Multi-subject Text-to-Video Generation with Disentangled Spatial Controlcited by 20
- 2023Phasic Content Fusing Diffusion Model with Directional Distribution Consistency for Few-Shot Model Adaptioncited by 11
Built on by
Citing papers per year: 2025: 5; 2026: 11.
16 papers.
Sort:
By area:
- 2025UltraGen: High-Resolution Video Generation with Hierarchical Attentioncited by 18
- 2026RefAlign: Representation Alignment for Reference-to-Video Generationcited by 10
- 2026MetaWorld: Scaling Multi-Agent Video World Model from Single-view Video Datacited by 10
- 2025Scaling Zero-Shot Reference-to-Video Generationcited by 9
- 2026Script-a-Video: Deep Structured Audio-visual Captions via Factorized Streams and Relational Groundingcited by 8
- 2026Evolution of Video Generative Foundationscited by 7
- 2025ID-Crafter: VLM-Grounded Online RL for Compositional Multi-Subject Video Generationcited by 6
- 2025PoseAnything: Universal Pose-guided Video Generation with Part-aware Temporal Coherencecited by 5
- 2026PresentAgent-2: Towards Generalist Multimodal Presentation Agentscited by 4
- 2025InstanceV: Instance-Level Video Generationcited by 3
- 2026Gloria: Consistent Character Video Generation via Content Anchorscited by 3
- 2026Aura: Consistent Multi-Subject Video Generation via VLM-Grounded Semantic Alignmentcited by 2
4 more
- 2026Cycle-World: Mitigating Error Accumulation in Long-term Video World Models via Reverse-Prediction Cycle Consistencycited by 1
- 2026HOMIE: Human-object Centric Video Personalization via Multimodal Intelligent Enhancementcited by 1
- 2026Spatial-Temporal Decoupled Reference Conditioning for Identity-Preserving Text-to-Video Generationcited by 0
- 2026Harnessing Intrinsic Subject-Aware Attention for Controllable Multi-Subject Video Generationcited by 0
- 2026Harnessing Intrinsic Subject-Aware Attention for Controllable Multi-Subject Video Generation10 Sep 2026
- 2026HOMIE: Human-object Centric Video Personalization via Multimodal Intelligent Enhancement20 Jul 2026
- 2026Cycle-World: Mitigating Error Accumulation in Long-term Video World Models via Reverse-Prediction Cycle Consistency13 Jul 2026
- 2026Aura: Consistent Multi-Subject Video Generation via VLM-Grounded Semantic Alignment5 Jul 2026
- 2026MetaWorld: Scaling Multi-Agent Video World Model from Single-view Video Data1 Jun 2026
- 2026Spatial-Temporal Decoupled Reference Conditioning for Identity-Preserving Text-to-Video Generation1 Jun 2026
- 2026PresentAgent-2: Towards Generalist Multimodal Presentation Agents12 May 2026
- 2026Script-a-Video: Deep Structured Audio-visual Captions via Factorized Streams and Relational Grounding13 Apr 2026
- 2026Evolution of Video Generative Foundations7 Apr 2026
- 2026Gloria: Consistent Character Video Generation via Content Anchors31 Mar 2026
- 2026RefAlign: Representation Alignment for Reference-to-Video Generation26 Mar 2026
- 2025PoseAnything: Universal Pose-guided Video Generation with Part-aware Temporal Coherence15 Dec 2025
4 more
- 2025Scaling Zero-Shot Reference-to-Video Generation7 Dec 2025
- 2025InstanceV: Instance-Level Video Generation28 Nov 2025
- 2025ID-Crafter: VLM-Grounded Online RL for Compositional Multi-Subject Video Generation1 Nov 2025
- 2025UltraGen: High-Resolution Video Generation with Hierarchical Attention21 Oct 2025
- 2025InstanceV: Instance-Level Video Generationcited by 3
- 2025InstanceV: Instance-Level Video Generation28 Nov 2025
- 2025UltraGen: High-Resolution Video Generation with Hierarchical Attentioncited by 18
- 2026RefAlign: Representation Alignment for Reference-to-Video Generationcited by 10
- 2025Scaling Zero-Shot Reference-to-Video Generationcited by 9
- 2025ID-Crafter: VLM-Grounded Online RL for Compositional Multi-Subject Video Generationcited by 6
- 2025PoseAnything: Universal Pose-guided Video Generation with Part-aware Temporal Coherencecited by 5
- 2026PresentAgent-2: Towards Generalist Multimodal Presentation Agentscited by 4
- 2026Gloria: Consistent Character Video Generation via Content Anchorscited by 3
- 2026Aura: Consistent Multi-Subject Video Generation via VLM-Grounded Semantic Alignmentcited by 2
- 2026HOMIE: Human-object Centric Video Personalization via Multimodal Intelligent Enhancementcited by 1
- 2026Spatial-Temporal Decoupled Reference Conditioning for Identity-Preserving Text-to-Video Generationcited by 0
- 2026Harnessing Intrinsic Subject-Aware Attention for Controllable Multi-Subject Video Generationcited by 0
- 2026Harnessing Intrinsic Subject-Aware Attention for Controllable Multi-Subject Video Generation10 Sep 2026
- 2026HOMIE: Human-object Centric Video Personalization via Multimodal Intelligent Enhancement20 Jul 2026
- 2026Aura: Consistent Multi-Subject Video Generation via VLM-Grounded Semantic Alignment5 Jul 2026
- 2026Spatial-Temporal Decoupled Reference Conditioning for Identity-Preserving Text-to-Video Generation1 Jun 2026
- 2026PresentAgent-2: Towards Generalist Multimodal Presentation Agents12 May 2026
- 2026Gloria: Consistent Character Video Generation via Content Anchors31 Mar 2026
- 2026RefAlign: Representation Alignment for Reference-to-Video Generation26 Mar 2026
- 2025PoseAnything: Universal Pose-guided Video Generation with Part-aware Temporal Coherence15 Dec 2025
- 2025Scaling Zero-Shot Reference-to-Video Generation7 Dec 2025
- 2025ID-Crafter: VLM-Grounded Online RL for Compositional Multi-Subject Video Generation1 Nov 2025
- 2025UltraGen: High-Resolution Video Generation with Hierarchical Attention21 Oct 2025
Similar, not cited
Close in wording, no citation either way
- 2026HarmoView: Harmonizing Multi-View Constraints for Identity-Consistent Video Generation
- 2026GroupVideo: Multi-Identity Customized Text-to-Video Generation
- 2025AlcheMinT: Fine-grained Temporal Control for Multi-Reference Consistent Video Generation
- 2025OpenSubject: Leveraging Video-Derived Identity and Diversity Priors for Subject-driven Image Generation and Manipulation
- 2025Virtually Being: Customizing Camera-Controllable Video Diffusion Models with Multi-View Performance Captures
- 2026ARGUS: Stacked Multi-View Identity Mosaic Injection for Subject-Preserving Video Generation
- 2025VideoMage: Multi-Subject and Motion Customization of Text-to-Video Diffusion Models
- 2025Identity-Preserving Text-to-Video Generation via Training-Free Prompt, Image, and Guidance Enhancement