SneakPeek: Future-Guided Instructional Streaming Video Generation
Not on the map. Why?
Abstract (arXiv)
Instructional video generation is an emerging task that aims to synthesize coherent demonstrations of procedural activities from textual descriptions. Such capability has broad implications for content creation, education, and human-AI interaction, yet existing video diffusion models struggle to maintain temporal consistency and controllability across long sequences of multiple action steps. We introduce a pipeline for future-driven streaming instructional video generation, dubbed SneakPeek, a diffusion-based autoregressive framework designed to generate precise, stepwise instructional videos conditioned on an initial image and structured textual prompts. Our approach introduces three key innovations to enhance consistency and controllability: (1) predictive causal adaptation, where a causal model learns to perform next-frame prediction and anticipate future keyframes; (2) future-guided self-forcing with a dual-region KV caching scheme to address the exposure bias issue at inference time; (3) multi-prompt conditioning, which provides fine-grained and procedural control over multi-step instructions. Together, these components mitigate temporal drift, preserve motion consistency, and enable interactive video generation where future prompt updates dynamically influence ongoing streaming video generation. Experimental results demonstrate that our method produces temporally coherent and semantically faithful instructional videos that accurately follow complex, multi-step task descriptions.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 48 of its 50 references that are in the map. First posted on arXiv 15 Dec 2025.
Builds on
48 of 50 references.
References · 48
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2022Scalable Diffusion Models with Transformerscited by 5,931
- 2022FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awarenesscited by 3,611
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,198
- 2025Cosmos World Foundation Model Platform for Physical AIcited by 833
- 2018Scaling Egocentric Vision: The EPIC-KITCHENS Datasetcited by 789
- 2024Diffusion Forcing: Next-token Prediction Meets Full-Sequence Diffusioncited by 634
- 2024Movie Gen: A Cast of Media Foundation Modelscited by 614
- 2025Self Forcing: Bridging the Train-Test Gap in Autoregressive Video Diffusioncited by 569
- 2023InternVid: A Large-scale Video-Text Dataset for Multimodal Understanding and Generationcited by 488
- 2023Ego-Exo4D: Understanding Skilled Human Activity from First- and Third-Person Perspectivescited by 477
36 more
- 2024Sora: A Review on Background, Technology, Limitations, and Opportunities of Large Vision Modelscited by 467
- 2024From Slow Bidirectional to Fast Autoregressive Video Diffusion Modelscited by 401
- 2022Assembly101: A Large-Scale Multi-View Video Dataset for Understanding Procedural Activitiescited by 284
- 2025MAGI-1: Autoregressive Video Generation at Scalecited by 262
- 2024StreamingT2V: Consistent, Dynamic, and Extendable Long Video Generation from Textcited by 242
- 2022Egocentric Video-Language Pretrainingcited by 231
- 2025SkyReels-V2: Infinite-length Film Generative Modelcited by 218
- 2019Cross-task weakly supervised learning from instructional videoscited by 199
- 2023NUWA-XL: Diffusion over Diffusion for eXtremely Long Video Generationcited by 170
- 2025Frame Context Packing and Drift Prevention in Next-Frame-Prediction Video Diffusion Modelscited by 126
- 2019Generalization in Generation: A closer look at Exposure Biascited by 123
- 2022EgoTaskQA: Understanding Human Tasks in Egocentric Videoscited by 112
- 2024Snap Video: Scaled Spatiotemporal Transformers for Text-to-Video Synthesiscited by 105
- 2023VDT: General-purpose Video Diffusion Transformers via Mask Modelingcited by 102
- 2025Seaweed-7B: Cost-Effective Training of Video Generation Foundation Modelcited by 81
- 2023GenTron: Diffusion Transformers for Image and Video Generationcited by 80
- 2024Progressive Autoregressive Video Diffusion Modelscited by 65
- 2025RIFLEx: A Free Lunch for Length Extrapolation in Video Diffusion Transformerscited by 63
- 2023InstructVid2Vid: Controllable Video Editing with Natural Language Instructionscited by 44
- 2025StreamDiT: Real-Time Streaming Text-to-Video Generationcited by 43
- 2023Multimodal Procedural Planning via Dual Text-Image Promptingcited by 40
- 2025VEGGIE: Instructional Editing and Reasoning Video Concepts with Grounded Generationcited by 39
- 2024ViD-GPT: Introducing GPT-style Autoregressive Generation in Video Diffusion Modelscited by 33
- 2023EgoDistill: Egocentric Head Motion Distillation for Efficient Video Understandingcited by 32
- 2023LEGO: Learning EGOcentric Action Frame Generation via Visual Instruction Tuningcited by 28
- 2024EgoGen: An Egocentric Synthetic Data Generatorcited by 27
- 2025Exo2Ego: Exocentric Knowledge Guided MLLM for Egocentric Video Understandingcited by 25
- 2022EgoEnv: Human-centric environment representations from egocentric videocited by 22
- 2024EffiVED:Efficient Video Editing via Text-instruction Diffusion Modelscited by 21
- 2023VIDiff: Translating Videos via Multi-Modal Instructions with Diffusion Modelscited by 19
- 2025Memory-efficient Streaming VideoLLMs for Real-time Procedural Video Understandingcited by 18
- 2024Progress-Aware Video Frame Captioningcited by 10
- 2024ShowHowTo: Generating Scene-Conditioned Step-by-Step Visual Instructionscited by 7
- 2023Replay: Multi-modal Multi-view Acted Videos for Casual Holographycited by 6
- 2024HANDI: Hand-Centric Text-and-Image Conditioned Video Generationcited by 5
- 2025Long-horizon Visual Instruction Generation with Logic and Attribute Self-reflectioncited by 4
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025Show Me: Unifying Instructional Image and Video Generation with Diffusion Models
- 2026TempAct: Advancing Temporal Plausibility in Autoregressive Video Generation via Planner-Executor RL
- 2025Playing with Transformer at 30+ FPS via Next-Frame Diffusion
- 2023GenHowTo: Learning to Generate Actions and State Transformations from Instructional Videos
- 2026EditStream: A Unified Autoregressive Framework for Interactive Video Generation and Editing
- 2024Optical-Flow Guided Prompt Optimization for Coherent Video Generation
- 2026Causal-rCM: A Unified Teacher-Forcing and Self-Forcing Open Recipe for Autoregressive Diffusion Distillation in Streaming Video Generation and Interactive World Models
- 2026UniTemp: Unlocking Video Generation in Any Temporal Order via Bidirectional Distillation