mlsanityData to 7 Oct 2026

BindWeave: Subject-Consistent Video Generation via Cross-Modal Integration

arXiv 2510.00438 ↗First posted 1 Oct 2025cs.CVcited by 22

On the map: Diffusion models → Video generation

Abstract (arXiv)

Diffusion Transformer has shown remarkable abilities in generating high-fidelity videos, delivering visually coherent frames and rich details over extended durations. However, existing video generation models still fall short in subject-consistent video generation due to an inherent difficulty in parsing prompts that specify complex spatial relationships, temporal logic, and interactions among multiple subjects. To address this issue, we propose BindWeave, a unified framework that handles a broad range of subject-to-video scenarios from single-subject cases to complex multi-subject scenes with heterogeneous entities. To bind complex prompt semantics to concrete visual subjects, we introduce an MLLM-DiT framework in which a pretrained multimodal large language model performs deep cross-modal reasoning to ground entities and disentangle roles, attributes, and interactions, yielding subject-aware hidden states that condition the diffusion transformer for high-fidelity subject-consistent video generation. Experiments on the OpenS2V benchmark demonstrate that our method achieves superior performance across subject consistency, naturalness, and text relevance in generated videos, outperforming existing open-source and commercial models.

Key facts. Cited by 22 papers in the map (data through 7 Oct 2026). Placed in Video generation, one of 14 directions in Diffusion models. Builds on 36 of its 42 references that are in the map. First posted on arXiv 1 Oct 2025.

Builds on

36 of 42 references.

Closest ancestors · 11

Same direction, newest first

  1. 2025SkyReels-A2: Compose Anything in Video Diffusion Transformers3 Apr
  2. 2025VACE: All-in-One Video Creation and Editing10 Mar
  3. 2025Goku: Flow Based Video Generative Foundation Models7 Feb
  4. 2025ConceptMaster: Multi-Concept Video Customization on Diffusion Transformer Models Without Test-Time Tuning8 Jan
  5. 2024LTX-Video: Realtime Video Latent Diffusion30 Dec
  6. 2024OSV: One Step is Enough for High-Quality Image to Video Generation17 Sep
  7. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformer12 Aug
  8. 2024Vidu: a Highly Consistent, Dynamic and Skilled Text-to-Video Generator with Diffusion Models7 May
  9. 2024CustomVideo: Customizing Text-to-Video Generation with Multiple Subjects18 Jan
  10. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasets25 Nov
  11. 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuning10 Jul

Other references · 25

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  4. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  5. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
  6. 2022Scalable Diffusion Models with Transformerscited by 5,931
  7. 2022Classifier-Free Diffusion Guidancecited by 5,717
  8. 2025Qwen2.5-VL Technical Reportcited by 5,418
  9. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
  10. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,550
  11. 2020Taming Transformers for High-Resolution Image Synthesiscited by 3,229
  12. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
13 more
  1. 2022Make-A-Video: Text-to-Video Generation without Text-Video Datacited by 1,725
  2. 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,597
  3. 2024Open-Sora: Democratizing Efficient Video Production for Allcited by 637
  4. 2024Movie Gen: A Cast of Media Foundation Modelscited by 614
  5. 2024Identity-Preserving Text-to-Video Generation by Frequency Decompositioncited by 155
  6. 2025Phantom: Subject-consistent video generation via cross-modal alignmentcited by 126
  7. 2024ID-Animator: Zero-Shot Identity-Preserving Human Video Generationcited by 122
  8. 2025HunyuanCustom: A Multimodal-Driven Architecture for Customized Video Generationcited by 84
  9. 2025OpenS2V-Nexus: A Detailed Benchmark and Million-Scale Dataset for Subject-to-Video Generationcited by 73
  10. 2025Multi-subject Open-set Personalization in Video Generationcited by 65
  11. 2025SeedVR: Seeding Infinity in Diffusion Transformer Towards Generic Video Restorationcited by 62
  12. 2024DisenStudio: Customized Multi-subject Text-to-Video Generation with Disentangled Spatial Controlcited by 20
  13. 2024Video Repurposing from User Generated Content: A Large-scale Dataset and Benchmarkcited by 9

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 3; 2026: 19.

22 papers.

Sort:

By area:

  1. 2026DreamID-Omni: Unified Framework for Controllable Human-Centric Audio-Video Generationcited by 19
  2. 2026RefAlign: Representation Alignment for Reference-to-Video Generationcited by 10
  3. 2025Scaling Zero-Shot Reference-to-Video Generationcited by 9
  4. 2026ARGUS: Stacked Multi-View Identity Mosaic Injection for Subject-Preserving Video Generationcited by 7
  5. 2026VideoArgus: Agentic Rubric-Grounded Unified Evaluation for Video Generation and Editingcited by 5
  6. 2026WildActor: Unconstrained Identity-Preserving Video Generationcited by 4
  7. 2025AlcheMinT: Fine-grained Temporal Control for Multi-Reference Consistent Video Generationcited by 3
  8. 2026FashionChameleon: Towards Real-Time and Interactive Human-Garment Video Customizationcited by 3
  9. 2026Omni-Customizer: End-to-End MultiModal Customization for Joint Audio-Video Generationcited by 2
  10. 2026TIDE: Task-Isolated Diffusion for Unified Video Editing and Generationcited by 2
  11. 2026Spectral Heat Flow for Conservative Token Condensation in Vision-Language Modelscited by 2
  12. 2025CustomX: Unified Character, Action, and Scene Customization in Video World Modelscited by 1
10 more
  1. 2026DomainShuttle: Freeform Open Domain Subject-driven Text-to-video Generationcited by 1
  2. 2026Aura: Consistent Multi-Subject Video Generation via VLM-Grounded Semantic Alignmentcited by 1
  3. 2026ONE-SHOT: Compositional Human-Environment Video Synthesis via Spatial-Decoupled Motion Injection and Hybrid Context Integrationcited by 0
  4. 2026Generate Your Talking Avatar from Video Referencecited by 0
  5. 2026Squeezing Capacity from Multimodal Large Language Models for Subject-driven Generationcited by 0
  6. 2026Spatial-Temporal Decoupled Reference Conditioning for Identity-Preserving Text-to-Video Generationcited by 0
  7. 2026HOMIE: Human-object Centric Video Personalization via Multimodal Intelligent Enhancementcited by 0
  8. 2026Vera: Identity-Faithful Human Subject-to-Video Generationcited by 0
  9. 2026Harnessing Intrinsic Subject-Aware Attention for Controllable Multi-Subject Video Generationcited by 0
  10. 2026MSR: Multiple Subject Reference for Video Generationcited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2025CINEMA: Coherent Multi-Subject Video Generation via MLLM-Based Guidance
  2. 2024VIMI: Grounding Video Generation through Multi-modal Instruction
  3. 2026Uni-ViGU: Towards Unified Video Generation and Understanding via A Diffusion-Based Video Generator
  4. 2026DCDM: Divide-and-Conquer Diffusion Models for Consistency-Preserving Video Generation
  5. 2025Plan-X: Instruct Video Generation via Semantic Planning
  6. 2025SSG-Dit: A Spatial Signal Guided Framework for Controllable Video Generation
  7. 2026Beyond Text Conditioning: A Systematic Study of MLLM-DiT Fusion for Video Generation
  8. 2024DiTCtrl: Exploring Attention Control in Multi-Modal Diffusion Transformer for Tuning-Free Multi-Prompt Longer Video Generation