TIE: Time Interval Encoding for Video Generation over Events
Not on the map. Why?
Abstract (arXiv)
Director-style prompting, robotic action prediction, and interactive video agents demand temporal grounding over concurrent events -- a regime in which 68% of general clips and over 99% of robotics/gameplay clips contain overlapping events, yet existing multi-event generators rest on a single-active-prompt assumption. However, modern video generators, such as Diffusion Transformers (DiT), represent time as discrete points through point-wise positional encodings. This formulation creates a fundamental dimension mismatch: temporally extended intervals and overlapping events are mathematically unrepresentable to the attention mechanism. In this paper, we propose Time Interval Encoding (TIE), a principled, plug-and-play interval-aware generalization of rotary embeddings that elevates time intervals to first-class primitives inside DiT cross-attention. Rather than introducing another heuristic interval embedding, we show that, within RoPE-compatible bilinear attention, TIE is characterized by two basic principles: Temporal Integrability, which requires an event to aggregate positional evidence over its full duration, and Duration Invariance, which removes the trivial bias toward longer intervals. Under a uniform kernel, this characterization yields an efficient closed-form sinc-based solution that preserves the standard attention interface and naturally attenuates boundary noise through interval integration. Empirically, TIE preserves the visual quality of the base DiT model while substantially improving temporal controllability. In our experiments on the OmniEvents dataset, it improves human-verified Temporal Constraint Satisfaction Rate from 77.34% to 96.03% and reduces temporal boundary error from 0.261s to 0.073s, while also improving trajectory-level temporal alignment metrics. The code and dataset are available at https://github.com/MatrixTeam-AI/TIE.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 38 of its 46 references that are in the map. First posted on arXiv 11 May 2026.
Builds on
38 of 46 references.
References · 38
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2022Scalable Diffusion Models with Transformerscited by 6,054
- 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,703
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
- 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
- 2022Make-A-Video: Text-to-Video Generation without Text-Video Datacited by 1,742
- 2023Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Modelscited by 1,476
- 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuningcited by 1,433
- 2018Towards Accurate Generative Models of Video: A New Metric & Challengescited by 1,234
- 2024Genie: Generative Interactive Environmentscited by 747
- 2023GAIA-1: A Generative World Model for Autonomous Drivingcited by 637
26 more
- 2024Latte: Latent Diffusion Transformer for Video Generationcited by 546
- 2023Learning Universal Policies via Text-Guided Video Generationcited by 522
- 2022Phenaki: Variable Length Video Generation From Open Domain Textual Descriptioncited by 484
- 2025VACE: All-in-One Video Creation and Editingcited by 479
- 2023VideoComposer: Compositional Video Synthesis with Motion Controllabilitycited by 464
- 2023Learning Interactive Real-World Simulatorscited by 458
- 2024Diffusion Models Are Real-Time Game Enginescited by 296
- 2025LongLive: Real-time Interactive Long Video Generationcited by 265
- 2024VideoScore: Building Automatic Metrics to Simulate Fine-grained Human Feedback for Video Generationcited by 197
- 2024RoboDreamer: Learning Compositional World Models for Robot Imaginationcited by 195
- 2023FreeNoise: Tuning-Free Longer Video Diffusion via Noise Reschedulingcited by 180
- 2023NUWA-XL: Diffusion over Diffusion for eXtremely Long Video Generationcited by 171
- 2024Direct-a-Video: Customized Video Generation with User-Directed Camera Movement and Object Motioncited by 167
- 2023VideoDirectorGPT: Consistent Multi-scene Video Generation via LLM-Guided Planningcited by 141
- 2023Gen-L-Video: Multi-Text to Long Video Generation via Temporal Co-Denoisingcited by 139
- 2023VDT: General-purpose Video Diffusion Transformers via Mask Modelingcited by 103
- 2021MultiSports: A Multi-Person Video Dataset of Spatio-Temporally Localized Sports Actionscited by 84
- 2024DiTCtrl: Exploring Attention Control in Multi-Modal Diffusion Transformer for Tuning-Free Multi-Prompt Longer Video Generationcited by 74
- 2025EnerVerse: Envisioning Embodied Future Space for Robotics Manipulationcited by 61
- 2023MEVG: Multi-event Video Generation with Text-to-Video Modelscited by 40
- 2024Mind the Time: Temporally-Controlled Multi-Event Video Generationcited by 40
- 2025VideoGen-of-Thought: Step-by-step generating multi-shot video with minimal manual interventioncited by 36
- 2024DreamFactory: Pioneering Multi-Scene Long Video Generation with a Multi-Agent Frameworkcited by 35
- 2024Is Your World Simulator a Good Story Presenter? A Consecutive Events-Based Benchmark for Future Long Video Generationcited by 30
- 2023StoryBench: A Multifaceted Benchmark for Continuous Story Visualizationcited by 29
- 2026TS-Attn: Temporal-wise Separable Attention for Multi-Event Video Generationcited by 4
Built on by
Citing papers per year: 2026: 3.
3 papers.
Similar, not cited
Close in wording, no citation either way
- 2026ArrowGEV: Grounding Events in Video via Learning the Arrow of Time
- 2025RoboEnvision: A Long-Horizon Video Generation Model for Multi-Task Robot Manipulation
- 2026Understanding and Mitigating the Video-Action Generalization Gap via Temporal Ratio
- 2026EA-WM: Event-Aware Generative World Model with Structured Kinematic-to-Visual Action Fields
- 2026Prompt Relay: Inference-Time Temporal Control for Multi-Event Video Generation
- 2025Image Generation as a Visual Planner for Robotic Manipulation
- 2025VideoExpert: Augmented LLM for Temporal-Sensitive Video Understanding
- 2026TEMPO: Learning Temporal Context for Dynamic Robot Manipulation