mlsanityData to 14 Oct 2026

Comp-Attn: Present-and-Align Attention for Compositional Video Generation

arXiv 2503.14428 ↗First posted 18 Mar 2025cs.CV cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

In the domain of text-to-video (T2V) generation, reliably synthesizing compositional content involving multiple subjects with intricate relations is still underexplored. The main challenges are twofold: 1) Subject presence, where not all subjects can be presented in the video; 2) Inter-subject relations, where the interaction and spatial relationship between subjects are misaligned. Existing methods adopt techniques, such as inference-time latent optimization or layout control, which fail to address both issues simultaneously. To tackle these problems, we propose Comp-Attn, a composition-aware cross-attention variant that follows a Present-and-Align paradigm: it decouples the two challenges by enforcing subject presence at the condition level and achieving relational alignment at the attention-distribution level. Specifically, 1) We introduce Subject-aware Condition Interpolation (SCI) to reinforce subject-specific conditions and ensure each subject's presence; 2) We propose Layout-forcing Attention Modulation (LAM), which dynamically enforces the attention distribution to align with the relational layout of multiple subjects. Comp-Attn can be seamlessly integrated into various T2V baselines in a training-free manner, boosting T2V-CompBench scores by 15.7% and 11.7% on Wan2.1-T2V-14B and Wan2.2-T2V-A14B with only a 5% increase in inference time. Meanwhile, it also achieves strong performance on VBench and T2I-CompBench, demonstrating its scalability in general video generation and compositional text-to-image (T2I) tasks.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 43 of its 52 references that are in the map. First posted on arXiv 18 Mar 2025.

Builds on

43 of 52 references.

References · 43

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
  3. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
  4. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
  5. 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
  6. 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
  7. 2023Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Modelscited by 1,476
  8. 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuningcited by 1,433
  9. 2022Scaling Autoregressive Models for Content-Rich Text-to-Image Generationcited by 1,295
  10. 2024ChatGLM: A Family of Large Language Models from GLM-130B to GLM-4 All Toolscited by 1,121
  11. 2022CogVideo: Large-scale Pretraining for Text-to-Video Generation via Transformerscited by 985
  12. 2024WorldSimBench: Towards Video Generation Models as World Simulatorscited by 881
31 more
  1. 2023Attend-and-Excite: Attention-Based Semantic Guidance for Text-to-Image Diffusion Modelscited by 702
  2. 2024Diffusion Forcing: Next-token Prediction Meets Full-Sequence Diffusioncited by 681
  3. 2023Text2Video-Zero: Text-to-Image Diffusion Models are Zero-Shot Video Generatorscited by 670
  4. 2023ModelScope Text-to-Video Technical Reportcited by 658
  5. 2024Open-Sora: Democratizing Efficient Video Production for Allcited by 652
  6. 2024LTX-Video: Realtime Video Latent Diffusioncited by 581
  7. 2024VideoCrafter2: Overcoming Data Limitations for High-Quality Video Diffusion Modelscited by 579
  8. 2024Open-Sora Plan: Open-Source Large Video Generation Modelcited by 296
  9. 2023T2I-CompBench++: An Enhanced and Comprehensive Benchmark for Compositional Text-to-image Generationcited by 260
  10. 2024T2V-CompBench: A Comprehensive Benchmark for Compositional Text-to-video Generationcited by 185
  11. 2023Linguistic Binding in Diffusion Models: Enhancing Attribute Correspondence through Attention Map Alignmentcited by 171
  12. 2024Tora: Trajectory-oriented Diffusion Transformer for Video Generationcited by 164
  13. 2023Dense Text-to-Image Generation with Attention Modulationcited by 163
  14. 2024Identity-Preserving Text-to-Video Generation by Frequency Decompositioncited by 158
  15. 2023VideoDirectorGPT: Consistent Multi-scene Video Generation via LLM-Guided Planningcited by 141
  16. 2023LLM-grounded Video Diffusion Modelscited by 83
  17. 2024ChronoMagic-Bench: A Benchmark for Metamorphic Evaluation of Text-to-Time-lapse Video Generationcited by 75
  18. 2024DiTCtrl: Exploring Attention Control in Multi-Modal Diffusion Transformer for Tuning-Free Multi-Prompt Longer Video Generationcited by 74
  19. 2024CreatiLayout: Siamese Multimodal Diffusion Transformer for Creative Layout-to-Image Generationcited by 60
  20. 2024WF-VAE: Enhancing Video VAE by Wavelet-Driven Energy Flow for Latent Video Diffusion Modelcited by 57
  21. 2024T2V-Turbo-v2: Enhancing Video Generation Model Post-Training through Data, Reward, and Conditional Guidance Designcited by 54
  22. 2025ConceptAttention: Diffusion Transformers Learn Highly Interpretable Featurescited by 52
  23. 2024MagicTime: Time-lapse Video Generation Models as Metamorphic Simulatorscited by 51
  24. 2024VideoTetris: Towards Compositional Text-to-Video Generationcited by 51
  25. 2024Compositional Text-to-Image Generation with Dense Blob Representationscited by 38
  26. 2024Token Merging for Training-Free Semantic Binding in Text-to-Image Synthesiscited by 35
  27. 2024OD-VAE: An Omni-dimensional Video Compressor for Improving Latent Video Diffusion Modelcited by 30
  28. 2024GenMAC: Compositional Text-to-Video Generation with Multi-Agent Collaborationcited by 17
  29. 2025BlobGEN-Vid: Compositional Text-to-Video Generation with Blob Video Representationscited by 15
  30. 2024Compositional Video Generation as Flow Equalizationcited by 12
  31. 2024Enhancing MMDiT-Based Text-to-Image Models for Similar Subject Generationcited by 11

Built on by

Not cited yet.