GroupVideo: Multi-Identity Customized Text-to-Video Generation
Not on the map. Why?
Abstract (arXiv)
Current identity customized video generation methodologies are predominantly limited to single-identity scenarios, as the lack of explicit identity separation mechanisms often leads to identity confusion in multi-identity settings. Existing multi-identity approaches, which directly extend single-identity frameworks by concatenating face images as input conditions, frequently result in unnatural facial expressions and motions, manifesting as the "copy-paste" phenomenon. To overcome these limitations, we introduce GroupVideo, a novel framework that leverages multiple individual photographs to generate identitycustomized video. Built upon Video Diffusion Transformers, GroupVideo incorporates multimodal identity alignment: visual alignment jointly encodes multiple face images to provide robust identity references, while semantic alignment introduces a semantic perceiver to enhance the naturalness of motions. An ID localization module with spatial guidance is introduced to address identity blending and enhance identity fidelity, along with bounding box constraints and mask regularization loss, to focus on facial regions and improve training efficiency. In response to the shortage of multi-ID video datasets, we have curated a comprehensive high-quality dataset of 20,000 videos, thereby establishing a crucial resource to advance future research in multi-ID video generation. Extensive experiments demonstrate that GroupVideo outperforms existing methods in generating multi-character videos with consistent identities and natural motions.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 60 of its 78 references that are in the map. First posted on arXiv 23 Jul 2026.
Builds on
60 of 78 references.
References · 60
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
- 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,137
- 2022Scalable Diffusion Models with Transformerscited by 6,054
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
- 2022Generative Adversarial Networkscited by 5,627
- 2015You Only Look Once: Unified, Real-Time Object Detectioncited by 4,852
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
- 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,300
- 2020Taming Transformers for High-Resolution Image Synthesiscited by 3,253
- 2015FaceNet: A Unified Embedding for Face Recognition and Clusteringcited by 2,849
38 more
- 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,424
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
- 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,245
- 2023Qwen-VL: A Versatile Vision-Language Model for Understanding, Localization, Text Reading, and Beyondcited by 2,224
- 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
- 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
- 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Modelscited by 1,464
- 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuningcited by 1,433
- 2022Scaling Autoregressive Models for Content-Rich Text-to-Image Generationcited by 1,295
- 2022Multi-Concept Customization of Text-to-Image Diffusioncited by 1,106
- 2024WorldSimBench: Towards Video Generation Models as World Simulatorscited by 881
- 2023Animate Anyone: Consistent and Controllable Image-to-Video Synthesis for Character Animationcited by 688
- 2024Open-Sora: Democratizing Efficient Video Production for Allcited by 652
- 2023DynamiCrafter: Animating Open-domain Images with Video Diffusion Priorscited by 471
- 2023BLIP-Diffusion: Pre-trained Subject Representation for Controllable Text-to-Image Generation and Editingcited by 442
- 2024InstantID: Zero-shot Identity-Preserving Generation in Secondscited by 436
- 2023I2VGen-XL: High-Quality Image-to-Video Synthesis via Cascaded Diffusion Modelscited by 350
- 2023FastComposer: Tuning-Free Multi-Subject Image Generation with Localized Attentioncited by 313
- 2024Open-Sora Plan: Open-Source Large Video Generation Modelcited by 296
- 2023Mix-of-Show: Decentralized Low-Rank Adaptation for Multi-Concept Customization of Diffusion Modelscited by 261
- 2023HyperDreamBooth: HyperNetworks for Fast Personalization of Text-to-Image Modelscited by 225
- 2023DreamVideo: Composing Your Dream Videos with Customized Subject and Motioncited by 188
- 2024Identity-Preserving Text-to-Video Generation by Frequency Decompositioncited by 158
- 2024PuLID: Pure and Lightning ID Customization via Contrastive Alignmentcited by 144
- 2023VideoBooth: Diffusion-based Video Generation with Image Promptscited by 126
- 2024ID-Animator: Zero-Shot Identity-Preserving Human Video Generationcited by 124
- 2023CelebV-Text: A Large-Scale Facial Text-Video Datasetcited by 104
- 2023Cones 2: Customizable Image Synthesis with Multiple Subjectscited by 101
- 2024X-Portrait: Expressive Portrait Animation with Hierarchical Motion Attentioncited by 91
- 2024MoA: Mixture-of-Attention for Subject-Context Disentanglement in Personalized Image Generationcited by 51
- 2025TokLIP: Marry Visual Tokens to CLIP for Multimodal Comprehension and Generationcited by 51
- 2024Still-Moving: Customized Video Generation without Customized Video Datacited by 50
- 2024UniPortrait: A Unified Framework for Identity-Preserving Single- and Multi-Human Image Personalizationcited by 47
- 2024StableIdentity: Inserting Anybody into Anywhere at First Sightcited by 35
- 2025MagicMirror: ID-Preserved Video Generation in Video Diffusion Transformerscited by 34
- 2024InstantFamily: Masked Attention for Zero-shot Multi-ID Image Generationcited by 30
- 2025Concat-ID: Towards Universal Identity-Preserving Video Synthesiscited by 28
- 2023VideoDreamer: Customized Multi-Subject Text-to-Video Generation with Disen-Mix Finetuning on Language-Video Foundation Modelscited by 16
50 most cited of 60 All 60 (JSON)
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025MoCA: Identity-Preserving Text-to-Video Generation via Mixture of Cross Attention
- 2026DiffMagicFace: Identity Consistent Facial Editing of Real Videos
- 2026HarmoView: Harmonizing Multi-View Constraints for Identity-Consistent Video Generation
- 2025FantasyID: Face Knowledge Enhanced ID-Preserving Video Generation
- 2026AnyID: Ultra-Fidelity Universal Identity-Preserving Video Generation from Any Visual References
- 2025PolyVivid: Vivid Multi-Subject Video Generation with Cross-Modal Interaction and Enhancement
- 2025Identity-Preserving Text-to-Video Generation via Training-Free Prompt, Image, and Guidance Enhancement
- 2025Multi-identity Human Image Animation with Structural Video Diffusion