ContextMaster: Interactive Multi-Shot Video Creation via Fixed-Budget Sparse Context Routing
Not on the map. Why?
Abstract (arXiv)
Recent video models increasingly support generation, reference conditioning, and editing within a single model, yet typically expose them as separate operations over fixed inputs. Practical creation unfolds across multiple shots, requiring one model to generate from text, follow a reference, or edit source footage while maintaining shared history. We formalize this setting as interactive multi-shot video creation (IMVC) and introduce ContextMaster, a unified model with a role-aware context representation for these operations. An interactive model must retain access to an expanding history without allowing the context read cost at each denoising step to grow. ContextMaster combines reusable clean context states with fixed budget sparse context routing and uses ConstraintSink to keep task constraints visible. To address the dual challenges of sparse context access and inference with few denoising steps, we propose a two-stage privileged context distillation framework, which transfers full context behavior from a dense teacher through consistency distillation and then refines deployment rollouts with distribution matching. Experiments on the three primitive tasks demonstrate improved task fulfillment and consistency across shots over specialized baselines. User studies further validate flexibly composed workflows, while the model reaches 16 FPS on a single GPU.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 42 of its 50 references that are in the map. First posted on arXiv 5 Aug 2026.
Builds on
42 of 50 references.
References · 42
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
- 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,703
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
- 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
- 2023One-step Diffusion with Distribution Matching Distillationcited by 1,019
- 2025Self Forcing: Bridging the Train-Test Gap in Autoregressive Video Diffusioncited by 625
- 2025VACE: All-in-One Video Creation and Editingcited by 479
- 2025LongLive: Real-time Interactive Long Video Generationcited by 265
- 2025Sparse VideoGen: Accelerating Video Diffusion Transformers with Spatial-Temporal Sparsitycited by 217
- 2025Context as Memory: Scene-Consistent Interactive Long Video Generation with Memory Retrievalcited by 163
- 2026Seedance 2.0: Advancing Video Generation for World Complexitycited by 160
30 more
- 2025Phantom: Subject-consistent video generation via cross-modal alignmentcited by 129
- 2025Infinity-RoPE: Action-Controllable Infinite Video Generation Emerges From Autoregressive Self-Rolloutcited by 86
- 2025Scaling Instruction-Based Video Editing with a High-Quality Synthetic Datasetcited by 79
- 2025UNIC: Unified In-Context Video Editingcited by 55
- 2025HoloCine: Holistic Generation of Cinematic Multi-Shot Long Video Narrativescited by 54
- 2025HuMo: Human-Centric Video Generation via Collaborative Multi-Modal Conditioningcited by 47
- 2025TileLang: A Composable Tiled Programming Model for AI Systemscited by 43
- 2025MultiShotMaster: A Controllable Multi-Shot Video Generation Frameworkcited by 36
- 2026Kiwi-Edit: Versatile Video Editing via Instruction and Reference Guidancecited by 36
- 2025OneStory: Coherent Multi-Shot Video Generation with Adaptive Memorycited by 35
- 2025InstructX: Towards Unified Visual Editing with MLLM Guidancecited by 32
- 2026ShotStream: Streaming Multi-Shot Video Generation for Interactive Storytellingcited by 28
- 2026DreamID-Omni: Unified Framework for Controllable Human-Centric Audio-Video Generationcited by 20
- 2026LiveEdit: Towards Real-Time Diffusion-Based Streaming Video Editingcited by 15
- 2025BLADE: Block-Sparse Attention Meets Step Distillation for Efficient Video Generationcited by 13
- 2026Geometry-Aware Implicit Memory for Video World Modelscited by 13
- 2026CausalCine: Real-Time Autoregressive Generation for Multi-Shot Video Narrativescited by 10
- 2026DreamID-V:Bridging the Image-to-Video Gap for High-Fidelity Face Swapping via Diffusion Transformercited by 9
- 2026Aurora: Unified Video Editing with a Tool-Using Agentcited by 9
- 2025VideoCoF: Unified Video Editing with Temporal Reasonercited by 8
- 2025Towards Reason-Informed Video Editing in Unified Models with Self-Reflective Learningcited by 7
- 2026OmniTransfer: All-in-one Framework for Spatio-temporal Video Transfercited by 6
- 2026UnityShots: Memory-Driven Multi-Shot Audio-Video Generation with Boundary-Aware Gatingcited by 6
- 2026OmniShotCut: Holistic Relational Shot Boundary Detection with Shot-Query Transformercited by 5
- 2026DreamVideo-Omni: Omni-Motion Controlled Multi-Subject Video Customization with Latent Identity Reinforcement Learningcited by 4
- 2026LIVEditor-14B: Lightning Unified Video Editing via In-Context Sparse Attentioncited by 4
- 2026Rethinking Position Embedding as a Context Controller for Multi-Reference and Multi-Shot Video Generationcited by 3
- 2026CoInteract: Physically-Consistent Human-Object Interaction Video Synthesis via Spatially-Structured Co-Generationcited by 3
- 2026ReBind: Multi-Reference Video Editing via Structured Instructions with Explicit Reference Relationshipscited by 3
- 2026StreamEdit: Training-Free Video Editing via Few-Step Streaming Video Generationcited by 2
Built on by
Not cited yet.