TS-Attn: Temporal-wise Separable Attention for Multi-Event Video Generation
Not on the map. Why?
Abstract (arXiv)
Generating high-quality videos from complex temporal descriptions that contain multiple sequential actions is a key unsolved problem. Existing methods are constrained by an inherent trade-off: using multiple short prompts fed sequentially into the model improves action fidelity but compromises temporal consistency, while a single complex prompt preserves consistency at the cost of prompt-following capability. We attribute this problem to two primary causes: 1) temporal misalignment between video content and the prompt, and 2) conflicting attention coupling between motion-related visual objects and their associated text conditions. To address these challenges, we propose a novel, training-free attention mechanism, Temporal-wise Separable Attention (TS-Attn), which dynamically rearranges attention distribution to ensure temporal awareness and global coherence in multi-event scenarios. TS-Attn can be seamlessly integrated into various pre-trained text-to-video models, boosting StoryEval-Bench scores by 33.5% and 16.4% on Wan2.1-T2V-14B and Wan2.2-T2V-A14B with only a 2% increase in inference time. It also supports plug-and-play usage across models for multi-event image-to-video generation. The source code and project page are available at https://github.com/Hong-yu-Zhang/TS-Attn.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 40 of its 42 references that are in the map. First posted on arXiv 21 Apr 2026.
Builds on
40 of 42 references.
References · 40
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2022Scalable Diffusion Models with Transformerscited by 6,054
- 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,719
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,581
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
- 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
- 2023Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Modelscited by 1,476
- 2025Qwen-Image Technical Reportcited by 1,044
- 2023Text2Video-Zero: Text-to-Image Diffusion Models are Zero-Shot Video Generatorscited by 670
- 2023ModelScope Text-to-Video Technical Reportcited by 658
- 2024Open-Sora: Democratizing Efficient Video Production for Allcited by 652
28 more
- 2024LTX-Video: Realtime Video Latent Diffusioncited by 581
- 2024VideoCrafter2: Overcoming Data Limitations for High-Quality Video Diffusion Modelscited by 579
- 2024Latte: Latent Diffusion Transformer for Video Generationcited by 546
- 2024Pyramidal Flow Matching for Efficient Video Generative Modelingcited by 366
- 2024Open-Sora Plan: Open-Source Large Video Generation Modelcited by 296
- 2025MAGI-1: Autoregressive Video Generation at Scalecited by 276
- 2025SkyReels-V2: Infinite-length Film Generative Modelcited by 229
- 2023FreeNoise: Tuning-Free Longer Video Diffusion via Noise Reschedulingcited by 180
- 2023VideoDirectorGPT: Consistent Multi-scene Video Generation via LLM-Guided Planningcited by 141
- 2023Gen-L-Video: Multi-Text to Long Video Generation via Temporal Co-Denoisingcited by 139
- 2025HunyuanCustom: A Multimodal-Driven Architecture for Customized Video Generationcited by 87
- 2024DiTCtrl: Exploring Attention Control in Multi-Modal Diffusion Transformer for Tuning-Free Multi-Prompt Longer Video Generationcited by 74
- 2023I2V-Adapter: A General Image-to-Video Adapter for Diffusion Modelscited by 70
- 2025Vchitect-2.0: Parallel Transformer for Scaling Up Video Diffusion Modelscited by 60
- 2025ConceptAttention: Diffusion Transformers Learn Highly Interpretable Featurescited by 52
- 2024VideoTetris: Towards Compositional Text-to-Video Generationcited by 51
- 2023MEVG: Multi-event Video Generation with Text-to-Video Modelscited by 40
- 2024Mind the Time: Temporally-Controlled Multi-Event Video Generationcited by 40
- 2025ShotAdapter: Text-to-Multi-Shot Video Generation with Diffusion Modelscited by 38
- 2026Rethinking Video Generation Model for the Embodied Worldcited by 33
- 2024Is Your World Simulator a Good Story Presenter? A Consecutive Events-Based Benchmark for Future Long Video Generationcited by 30
- 2024TALC: Time-Aligned Captions for Multi-Scene Text-to-Video Generationcited by 25
- 2025FlexiAct: Towards Flexible Action Control in Heterogeneous Scenarioscited by 25
- 2025MAGREF: Masked Guidance for Any-Reference Video Generation with Subject Disentanglementcited by 23
- 2025CINEMA: Coherent Multi-Subject Video Generation via MLLM-Based Guidancecited by 19
- 2024DreamRunner: Fine-Grained Compositional Story-to-Video Generation with Retrieval-Augmented Motion Adaptationcited by 7
- 2025Tuning-Free Multi-Event Long Video Generation via Synchronized Coupled Samplingcited by 6
- 2024MAVIN: Multi-Action Video Generation with Diffusion Models via Transition Video Infillingcited by 4
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026TIE: Time Interval Encoding for Video Generation over Eventscited by 3
- 2026Better Call CineCrew: Consistent Ultra-Long Narrative-to-Film Generationcited by 3
- 2026Delta Forcing: Trust Region Steering for Interactive Autoregressive Video Generationcited by 2
- 2026The Missing Temporal Link: Temporal Context Routing for Script-Driven Audio-Video Generationcited by 0
- 2026Better Call CineCrew: Consistent Ultra-Long Narrative-to-Film Generation7 Sep 2026
- 2026The Missing Temporal Link: Temporal Context Routing for Script-Driven Audio-Video Generation2 Sep 2026
- 2026Delta Forcing: Trust Region Steering for Interactive Autoregressive Video Generation14 May 2026
- 2026TIE: Time Interval Encoding for Video Generation over Events11 May 2026