Prompt Relay: Inference-Time Temporal Control for Multi-Event Video Generation
On the map: Diffusion models → Video generation
Abstract (arXiv)
Video diffusion models have achieved remarkable progress in generating high-quality videos. However, these models struggle to represent the temporal succession of multiple events in real-world videos and lack explicit mechanisms to control when semantic concepts appear, how long they persist, and the order in which multiple events occur. Such control is especially important for movie-grade video synthesis, where coherent storytelling depends on precise timing, duration, and transitions between events. When using a single paragraph-style prompt to describe a sequence of complex events, models often exhibit semantic entanglement, where concepts intended for different moments in the video bleed into one another, resulting in poor text-video alignment. To address these limitations, we propose Prompt Relay, an inference-time, plug-and-play method to enable fine-grained temporal control in multi-event video generation, requiring no architectural modifications and no additional computational overhead. Prompt Relay introduces a penalty into the cross-attention mechanism, so that each temporal segment attends only to its assigned prompt, allowing the model to represent one semantic concept at a time and thereby improving temporal prompt alignment, reducing semantic interference, and enhancing visual quality.
Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Placed in Video generation, one of 14 directions in Diffusion models. Builds on 28 of its 29 references that are in the map. First posted on arXiv 11 Apr 2026.
Builds on
28 of 29 references.
Closest ancestors · 8
Same direction, newest first
- 2026SwitchCraft: Training-Free Multi-Event Video Generation with Attention Controls27 Feb
- 2025Go-with-the-Flow: Motion-Controllable Video Diffusion Models Using Real-Time Warped Noise14 Jan
- 2024DiTCtrl: Exploring Attention Control in Multi-Modal Diffusion Transformer for Tuning-Free Multi-Prompt Longer Video Generation24 Dec
- 2024MotionFlow: Attention-Driven Motion Transfer in Video Diffusion Models6 Dec
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformer12 Aug
- 2024StoryDiffusion: Consistent Self-Attention for Long-Range Image and Video Generation2 May
- 2024CameraCtrl: Enabling Camera Control for Text-to-Video Generation2 Apr
- 2023MEVG: Multi-event Video Generation with Text-to-Video Models7 Dec
Other references · 20
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
- 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,409
- 2023MasaCtrl: Tuning-Free Mutual Self-Attention Control for Consistent Image Synthesis and Editingcited by 722
- 2023Attend-and-Excite: Attention-Based Semantic Guidance for Text-to-Image Diffusion Modelscited by 696
- 2023MotionCtrl: A Unified and Flexible Motion Controller for Video Generationcited by 568
- 2023VideoComposer: Compositional Video Synthesis with Motion Controllabilitycited by 461
- 2025GEN3C: 3D-Informed World-Consistent Video Generation with Precise Camera Controlcited by 325
- 2023Video-P2P: Video Editing with Cross-attention Controlcited by 312
- 2025ReCamMaster: Camera-Controlled Generative Rendering from A Single Videocited by 278
- 2025LongLive: Real-time Interactive Long Video Generationcited by 237
- 2025Phantom: Subject-consistent video generation via cross-modal alignmentcited by 126
8 more
- 2025Mixture of Contexts for Long Video Generationcited by 90
- 2025HunyuanCustom: A Multimodal-Driven Architecture for Customized Video Generationcited by 84
- 2025VideoPainter: Any-length Video Inpainting and Editing with Plug-and-Play Context Controlcited by 83
- 2024Mind the Time: Temporally-Controlled Multi-Event Video Generationcited by 39
- 2024Motion Inversion for Video Customizationcited by 30
- 2025Concat-ID: Towards Universal Identity-Preserving Video Synthesiscited by 28
- 2025Dynamic Concepts Personalization from Single Videoscited by 20
- 2025Stencil: Subject-Driven Generation with Context Guidancecited by 2
Built on by
Citing papers per year: 2026: 6.
6 papers.
- 2026Delta Forcing: Trust Region Steering for Interactive Autoregressive Video Generationcited by 1
- 2026TPD: Temporal Prior Decoupling for Text-to-Video Diffusion Modelscited by 0
- 2026KeyID: Decoupled Drafting and Keyframe Editing for Identity-Preserving Video Generationcited by 0
- 2026TimeSteer: Inference-Time Speech Scheduling in Joint Audio-Visual Diffusion Modelscited by 0
- 2026The Missing Temporal Link: Temporal Context Routing for Script-Driven Audio-Video Generationcited by 0
- 2026No Corners Cut: State-Grounded Transitions for Mid-Stream Prompt Switches in Video Generationcited by 0
- 2026No Corners Cut: State-Grounded Transitions for Mid-Stream Prompt Switches in Video Generation30 Sep 2026
- 2026The Missing Temporal Link: Temporal Context Routing for Script-Driven Audio-Video Generation2 Sep 2026
- 2026TimeSteer: Inference-Time Speech Scheduling in Joint Audio-Visual Diffusion Models1 Sep 2026
- 2026KeyID: Decoupled Drafting and Keyframe Editing for Identity-Preserving Video Generation17 Aug 2026
- 2026TPD: Temporal Prior Decoupling for Text-to-Video Diffusion Models29 Jul 2026
- 2026Delta Forcing: Trust Region Steering for Interactive Autoregressive Video Generation14 May 2026
Similar, not cited
Close in wording, no citation either way
- 2025TempoControl: Temporal Attention Guidance for Text-to-Video Models
- 2025Video-As-Prompt: Unified Semantic Control for Video Generation
- 2025Anchored Video Generation: Decoupling Scene Construction and Temporal Synthesis in Text-to-Video Diffusion Models
- 2026SWIFT: Prompt-Adaptive Memory for Efficient Interactive Long Video Generation
- 2024Video Diffusion Transformers are In-Context Learners
- 2026CineOrchestra: Unified Entity-Centric Conditioning for Cinematic Video Generation
- 2026CineWeaver: Training-Free Reference-Controllable Multi-Shot Long Video Generation for Cinematic Storytelling
- 2024VideoStudio: Generating Consistent-Content and Multi-Scene Videos