BindWeave: Subject-Consistent Video Generation via Cross-Modal Integration
On the map: Diffusion models → Video generation
Abstract (arXiv)
Diffusion Transformer has shown remarkable abilities in generating high-fidelity videos, delivering visually coherent frames and rich details over extended durations. However, existing video generation models still fall short in subject-consistent video generation due to an inherent difficulty in parsing prompts that specify complex spatial relationships, temporal logic, and interactions among multiple subjects. To address this issue, we propose BindWeave, a unified framework that handles a broad range of subject-to-video scenarios from single-subject cases to complex multi-subject scenes with heterogeneous entities. To bind complex prompt semantics to concrete visual subjects, we introduce an MLLM-DiT framework in which a pretrained multimodal large language model performs deep cross-modal reasoning to ground entities and disentangle roles, attributes, and interactions, yielding subject-aware hidden states that condition the diffusion transformer for high-fidelity subject-consistent video generation. Experiments on the OpenS2V benchmark demonstrate that our method achieves superior performance across subject consistency, naturalness, and text relevance in generated videos, outperforming existing open-source and commercial models.
Key facts. Cited by 22 papers in the map (data through 7 Oct 2026). Placed in Video generation, one of 14 directions in Diffusion models. Builds on 36 of its 42 references that are in the map. First posted on arXiv 1 Oct 2025.
Builds on
36 of 42 references.
Closest ancestors · 11
Same direction, newest first
- 2025SkyReels-A2: Compose Anything in Video Diffusion Transformers3 Apr
- 2025VACE: All-in-One Video Creation and Editing10 Mar
- 2025Goku: Flow Based Video Generative Foundation Models7 Feb
- 2025ConceptMaster: Multi-Concept Video Customization on Diffusion Transformer Models Without Test-Time Tuning8 Jan
- 2024LTX-Video: Realtime Video Latent Diffusion30 Dec
- 2024OSV: One Step is Enough for High-Quality Image to Video Generation17 Sep
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformer12 Aug
- 2024Vidu: a Highly Consistent, Dynamic and Skilled Text-to-Video Generator with Diffusion Models7 May
- 2024CustomVideo: Customizing Text-to-Video Generation with Multiple Subjects18 Jan
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasets25 Nov
- 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuning10 Jul
Other references · 25
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
- 2022Scalable Diffusion Models with Transformerscited by 5,931
- 2022Classifier-Free Diffusion Guidancecited by 5,717
- 2025Qwen2.5-VL Technical Reportcited by 5,418
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,550
- 2020Taming Transformers for High-Resolution Image Synthesiscited by 3,229
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
13 more
- 2022Make-A-Video: Text-to-Video Generation without Text-Video Datacited by 1,725
- 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,597
- 2024Open-Sora: Democratizing Efficient Video Production for Allcited by 637
- 2024Movie Gen: A Cast of Media Foundation Modelscited by 614
- 2024Identity-Preserving Text-to-Video Generation by Frequency Decompositioncited by 155
- 2025Phantom: Subject-consistent video generation via cross-modal alignmentcited by 126
- 2024ID-Animator: Zero-Shot Identity-Preserving Human Video Generationcited by 122
- 2025HunyuanCustom: A Multimodal-Driven Architecture for Customized Video Generationcited by 84
- 2025OpenS2V-Nexus: A Detailed Benchmark and Million-Scale Dataset for Subject-to-Video Generationcited by 73
- 2025Multi-subject Open-set Personalization in Video Generationcited by 65
- 2025SeedVR: Seeding Infinity in Diffusion Transformer Towards Generic Video Restorationcited by 62
- 2024DisenStudio: Customized Multi-subject Text-to-Video Generation with Disentangled Spatial Controlcited by 20
- 2024Video Repurposing from User Generated Content: A Large-scale Dataset and Benchmarkcited by 9
Built on by
Citing papers per year: 2025: 3; 2026: 19.
22 papers.
Sort:
By area:
- 2026DreamID-Omni: Unified Framework for Controllable Human-Centric Audio-Video Generationcited by 19
- 2026RefAlign: Representation Alignment for Reference-to-Video Generationcited by 10
- 2025Scaling Zero-Shot Reference-to-Video Generationcited by 9
- 2026ARGUS: Stacked Multi-View Identity Mosaic Injection for Subject-Preserving Video Generationcited by 7
- 2026VideoArgus: Agentic Rubric-Grounded Unified Evaluation for Video Generation and Editingcited by 5
- 2026WildActor: Unconstrained Identity-Preserving Video Generationcited by 4
- 2025AlcheMinT: Fine-grained Temporal Control for Multi-Reference Consistent Video Generationcited by 3
- 2026FashionChameleon: Towards Real-Time and Interactive Human-Garment Video Customizationcited by 3
- 2026Omni-Customizer: End-to-End MultiModal Customization for Joint Audio-Video Generationcited by 2
- 2026TIDE: Task-Isolated Diffusion for Unified Video Editing and Generationcited by 2
- 2026Spectral Heat Flow for Conservative Token Condensation in Vision-Language Modelscited by 2
- 2025CustomX: Unified Character, Action, and Scene Customization in Video World Modelscited by 1
10 more
- 2026DomainShuttle: Freeform Open Domain Subject-driven Text-to-video Generationcited by 1
- 2026Aura: Consistent Multi-Subject Video Generation via VLM-Grounded Semantic Alignmentcited by 1
- 2026ONE-SHOT: Compositional Human-Environment Video Synthesis via Spatial-Decoupled Motion Injection and Hybrid Context Integrationcited by 0
- 2026Generate Your Talking Avatar from Video Referencecited by 0
- 2026Squeezing Capacity from Multimodal Large Language Models for Subject-driven Generationcited by 0
- 2026Spatial-Temporal Decoupled Reference Conditioning for Identity-Preserving Text-to-Video Generationcited by 0
- 2026HOMIE: Human-object Centric Video Personalization via Multimodal Intelligent Enhancementcited by 0
- 2026Vera: Identity-Faithful Human Subject-to-Video Generationcited by 0
- 2026Harnessing Intrinsic Subject-Aware Attention for Controllable Multi-Subject Video Generationcited by 0
- 2026MSR: Multiple Subject Reference for Video Generationcited by 0
- 2026MSR: Multiple Subject Reference for Video Generation16 Sep 2026
- 2026Harnessing Intrinsic Subject-Aware Attention for Controllable Multi-Subject Video Generation10 Sep 2026
- 2026VideoArgus: Agentic Rubric-Grounded Unified Evaluation for Video Generation and Editing6 Aug 2026
- 2026Vera: Identity-Faithful Human Subject-to-Video Generation22 Jul 2026
- 2026HOMIE: Human-object Centric Video Personalization via Multimodal Intelligent Enhancement20 Jul 2026
- 2026Spectral Heat Flow for Conservative Token Condensation in Vision-Language Models12 Jul 2026
- 2026Aura: Consistent Multi-Subject Video Generation via VLM-Grounded Semantic Alignment5 Jul 2026
- 2026DomainShuttle: Freeform Open Domain Subject-driven Text-to-video Generation24 Jun 2026
- 2026ARGUS: Stacked Multi-View Identity Mosaic Injection for Subject-Preserving Video Generation10 Jun 2026
- 2026TIDE: Task-Isolated Diffusion for Unified Video Editing and Generation6 Jun 2026
- 2026Spatial-Temporal Decoupled Reference Conditioning for Identity-Preserving Text-to-Video Generation1 Jun 2026
- 2026Squeezing Capacity from Multimodal Large Language Models for Subject-driven Generation25 May 2026
10 more
- 2026Omni-Customizer: End-to-End MultiModal Customization for Joint Audio-Video Generation17 May 2026
- 2026FashionChameleon: Towards Real-Time and Interactive Human-Garment Video Customization15 May 2026
- 2026Generate Your Talking Avatar from Video Reference30 Apr 2026
- 2026ONE-SHOT: Compositional Human-Environment Video Synthesis via Spatial-Decoupled Motion Injection and Hybrid Context Integration1 Apr 2026
- 2026RefAlign: Representation Alignment for Reference-to-Video Generation26 Mar 2026
- 2026WildActor: Unconstrained Identity-Preserving Video Generation28 Feb 2026
- 2026DreamID-Omni: Unified Framework for Controllable Human-Centric Audio-Video Generation12 Feb 2026
- 2025CustomX: Unified Character, Action, and Scene Customization in Video World Models18 Dec 2025
- 2025AlcheMinT: Fine-grained Temporal Control for Multi-Reference Consistent Video Generation11 Dec 2025
- 2025Scaling Zero-Shot Reference-to-Video Generation7 Dec 2025
- 2026DreamID-Omni: Unified Framework for Controllable Human-Centric Audio-Video Generationcited by 19
- 2026RefAlign: Representation Alignment for Reference-to-Video Generationcited by 10
- 2025Scaling Zero-Shot Reference-to-Video Generationcited by 9
- 2026ARGUS: Stacked Multi-View Identity Mosaic Injection for Subject-Preserving Video Generationcited by 7
- 2026WildActor: Unconstrained Identity-Preserving Video Generationcited by 4
- 2026FashionChameleon: Towards Real-Time and Interactive Human-Garment Video Customizationcited by 3
- 2026Omni-Customizer: End-to-End MultiModal Customization for Joint Audio-Video Generationcited by 2
- 2026DomainShuttle: Freeform Open Domain Subject-driven Text-to-video Generationcited by 1
- 2026Aura: Consistent Multi-Subject Video Generation via VLM-Grounded Semantic Alignmentcited by 1
- 2026ONE-SHOT: Compositional Human-Environment Video Synthesis via Spatial-Decoupled Motion Injection and Hybrid Context Integrationcited by 0
- 2026Generate Your Talking Avatar from Video Referencecited by 0
- 2026Spatial-Temporal Decoupled Reference Conditioning for Identity-Preserving Text-to-Video Generationcited by 0
12 most cited of 16 All 16 (JSON)
- 2026MSR: Multiple Subject Reference for Video Generation16 Sep 2026
- 2026Harnessing Intrinsic Subject-Aware Attention for Controllable Multi-Subject Video Generation10 Sep 2026
- 2026Vera: Identity-Faithful Human Subject-to-Video Generation22 Jul 2026
- 2026HOMIE: Human-object Centric Video Personalization via Multimodal Intelligent Enhancement20 Jul 2026
- 2026Aura: Consistent Multi-Subject Video Generation via VLM-Grounded Semantic Alignment5 Jul 2026
- 2026DomainShuttle: Freeform Open Domain Subject-driven Text-to-video Generation24 Jun 2026
- 2026ARGUS: Stacked Multi-View Identity Mosaic Injection for Subject-Preserving Video Generation10 Jun 2026
- 2026Spatial-Temporal Decoupled Reference Conditioning for Identity-Preserving Text-to-Video Generation1 Jun 2026
- 2026Omni-Customizer: End-to-End MultiModal Customization for Joint Audio-Video Generation17 May 2026
- 2026FashionChameleon: Towards Real-Time and Interactive Human-Garment Video Customization15 May 2026
- 2026Generate Your Talking Avatar from Video Reference30 Apr 2026
- 2026ONE-SHOT: Compositional Human-Environment Video Synthesis via Spatial-Decoupled Motion Injection and Hybrid Context Integration1 Apr 2026
12 newest of 16 All 16 (JSON)
Similar, not cited
Close in wording, no citation either way
- 2025CINEMA: Coherent Multi-Subject Video Generation via MLLM-Based Guidance
- 2024VIMI: Grounding Video Generation through Multi-modal Instruction
- 2026Uni-ViGU: Towards Unified Video Generation and Understanding via A Diffusion-Based Video Generator
- 2026DCDM: Divide-and-Conquer Diffusion Models for Consistency-Preserving Video Generation
- 2025Plan-X: Instruct Video Generation via Semantic Planning
- 2025SSG-Dit: A Spatial Signal Guided Framework for Controllable Video Generation
- 2026Beyond Text Conditioning: A Systematic Study of MLLM-DiT Fusion for Video Generation
- 2024DiTCtrl: Exploring Attention Control in Multi-Modal Diffusion Transformer for Tuning-Free Multi-Prompt Longer Video Generation