LumosX: Relate Any Identities with Their Attributes for Personalized Video Generation
On the map: Diffusion models → Video generation
Abstract (arXiv)
Recent advances in diffusion models have significantly improved text-to-video generation, enabling personalized content creation with fine-grained control over both foreground and background elements. However, precise face-attribute alignment across subjects remains challenging, as existing methods lack explicit mechanisms to ensure intra-group consistency. Addressing this gap requires both explicit modeling strategies and face-attribute-aware data resources. We therefore propose LumosX, a framework that advances both data and model design. On the data side, a tailored collection pipeline orchestrates captions and visual cues from independent videos, while multimodal large language models (MLLMs) infer and assign subject-specific dependencies. These extracted relational priors impose a finer-grained structure that amplifies the expressive control of personalized video generation and enables the construction of a comprehensive benchmark. On the modeling side, Relational Self-Attention and Relational Cross-Attention intertwine position-aware embeddings with refined attention dynamics to inscribe explicit subject-attribute dependencies, enforcing disciplined intra-group cohesion and amplifying the separation between distinct subject clusters. Comprehensive evaluations on our benchmark demonstrate that LumosX achieves state-of-the-art performance in fine-grained, identity-consistent, and semantically aligned personalized multi-subject video generation. Code and models are available at https://jiazheng-xing.github.io/lumosx-home/.
Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Placed in Video generation, one of 14 directions in Diffusion models. Builds on 47 of its 53 references that are in the map. First posted on arXiv 20 Mar 2026.
Builds on
47 of 53 references.
Closest ancestors · 8
Same direction, newest first
- 2025SkyReels-A2: Compose Anything in Video Diffusion Transformers3 Apr
- 2025ConceptMaster: Multi-Concept Video Customization on Diffusion Transformer Models Without Test-Time Tuning8 Jan
- 2025MagicMirror: ID-Preserved Video Generation in Video Diffusion Transformers7 Jan
- 2024CustomVideo: Customizing Text-to-Video Generation with Multiple Subjects18 Jan
- 2023DreamVideo: Composing Your Dream Videos with Customized Subject and Motion7 Dec
- 2023VideoBooth: Diffusion-based Video Generation with Image Prompts1 Dec
- 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuning10 Jul
- 2023Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Models18 Apr
Other references · 39
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2023Segment Anythingcited by 8,158
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
- 2022Scalable Diffusion Models with Transformerscited by 5,931
- 2022Classifier-Free Diffusion Guidancecited by 5,717
- 2022Flow Matching for Generative Modelingcited by 5,426
- 2025Qwen2.5-VL Technical Reportcited by 5,418
- 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,581
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
27 more
- 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,274
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
- 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,755
- 2022Make-A-Video: Text-to-Video Generation without Text-Video Datacited by 1,725
- 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,597
- 2022CogVideo: Large-scale Pretraining for Text-to-Video Generation via Transformerscited by 973
- 2023VILA: On Pre-training for Visual Language Modelscited by 686
- 2024Open-Sora: Democratizing Efficient Video Production for Allcited by 637
- 2017MoCoGAN: Decomposing Motion and Content for Video Generationcited by 523
- 2023Q-Align: Teaching LMMs for Visual Scoring via Discrete Text-Defined Levelscited by 489
- 2024YOLOv9: Learning What You Want to Learn Using Programmable Gradient Informationcited by 422
- 2023Florence-2: Advancing a Unified Representation for a Variety of Vision Taskscited by 403
- 2024Panda-70M: Captioning 70M Videos with Multiple Cross-Modality Teacherscited by 389
- 2016Generating Videos with Scene Dynamicscited by 376
- 2023Scaling Open-Vocabulary Object Detectioncited by 335
- 2020CurricularFace: Adaptive Curriculum Learning Loss for Deep Face Recognitioncited by 320
- 2024Identity-Preserving Text-to-Video Generation by Frequency Decompositioncited by 155
- 2025Less-to-More Generalization: Unlocking More Controllability by In-Context Generationcited by 153
- 2025Phantom: Subject-consistent video generation via cross-modal alignmentcited by 126
- 2023Scaling Laws of RoPE-based Extrapolationcited by 124
- 2024ID-Animator: Zero-Shot Identity-Preserving Human Video Generationcited by 122
- 2024Snap Video: Scaled Spatiotemporal Transformers for Text-to-Video Synthesiscited by 105
- 2025Multi-subject Open-set Personalization in Video Generationcited by 65
- 2024Magic-Me: Identity-Specific Video Customized Diffusioncited by 58
- 2024VideoCLIP-XL: Advancing Long Description Understanding for Video CLIP Modelscited by 40
- 2025Concat-ID: Towards Universal Identity-Preserving Video Synthesiscited by 28
- 2025FantasyID: Face Knowledge Enhanced ID-Preserving Video Generationcited by 18
Built on by
Citing papers per year: 2026: 6.
6 papers.
- 2026DirectorBench: Diagnosing Long-Form Video Generation with Personalized Multi-Agent Evaluationcited by 4
- 2026Squeezing Capacity from Multimodal Large Language Models for Subject-driven Generationcited by 0
- 2026Lumos-Nexus: Efficient Frequency Bridging with Homogeneous Latent Space for Video Unified Modelscited by 0
- 2026LightCrafter: PBR-Conditioned Video Diffusion Refinement for Controllable and Consistent Relightingcited by 0
- 2026HOMIE: Human-object Centric Video Personalization via Multimodal Intelligent Enhancementcited by 0
- 2026RefCaptioner: Multi-Reference Image-Grounded Video Captioningcited by 0
- 2026RefCaptioner: Multi-Reference Image-Grounded Video Captioning30 Jul 2026
- 2026HOMIE: Human-object Centric Video Personalization via Multimodal Intelligent Enhancement20 Jul 2026
- 2026LightCrafter: PBR-Conditioned Video Diffusion Refinement for Controllable and Consistent Relighting9 Jul 2026
- 2026Lumos-Nexus: Efficient Frequency Bridging with Homogeneous Latent Space for Video Unified Models29 May 2026
- 2026DirectorBench: Diagnosing Long-Form Video Generation with Personalized Multi-Agent Evaluation28 May 2026
- 2026Squeezing Capacity from Multimodal Large Language Models for Subject-driven Generation25 May 2026
Similar, not cited
Close in wording, no citation either way
- 2025AlcheMinT: Fine-grained Temporal Control for Multi-Reference Consistent Video Generation
- 2025MoCA: Identity-Preserving Text-to-Video Generation via Mixture of Cross Attention
- 2025CINEMA: Coherent Multi-Subject Video Generation via MLLM-Based Guidance
- 2025BindWeave: Subject-Consistent Video Generation via Cross-Modal Integration
- 2026Aura: Consistent Multi-Subject Video Generation via VLM-Grounded Semantic Alignment
- 2025MM-R1: Unleashing the Power of Unified Multimodal Large Language Models for Personalized Image Generation
- 2025VideoMage: Multi-Subject and Motion Customization of Text-to-Video Diffusion Models
- 2025IMAGE-ALCHEMY: Advancing subject fidelity in personalised text-to-image generation