mlsanityData to 7 Oct 2026

SneakPeek: Future-Guided Instructional Streaming Video Generation

arXiv 2512.13019 ↗First posted 15 Dec 2025cs.CVcited by 1

Not on the map. Why?

Abstract (arXiv)

Instructional video generation is an emerging task that aims to synthesize coherent demonstrations of procedural activities from textual descriptions. Such capability has broad implications for content creation, education, and human-AI interaction, yet existing video diffusion models struggle to maintain temporal consistency and controllability across long sequences of multiple action steps. We introduce a pipeline for future-driven streaming instructional video generation, dubbed SneakPeek, a diffusion-based autoregressive framework designed to generate precise, stepwise instructional videos conditioned on an initial image and structured textual prompts. Our approach introduces three key innovations to enhance consistency and controllability: (1) predictive causal adaptation, where a causal model learns to perform next-frame prediction and anticipate future keyframes; (2) future-guided self-forcing with a dual-region KV caching scheme to address the exposure bias issue at inference time; (3) multi-prompt conditioning, which provides fine-grained and procedural control over multi-step instructions. Together, these components mitigate temporal drift, preserve motion consistency, and enable interactive video generation where future prompt updates dynamically influence ongoing streaming video generation. Experimental results demonstrate that our method produces temporally coherent and semantically faithful instructional videos that accurately follow complex, multi-step task descriptions.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 48 of its 50 references that are in the map. First posted on arXiv 15 Dec 2025.

Builds on

48 of 50 references.

References · 48

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2022Scalable Diffusion Models with Transformerscited by 5,931
  3. 2022FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awarenesscited by 3,611
  4. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
  5. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,198
  6. 2025Cosmos World Foundation Model Platform for Physical AIcited by 833
  7. 2018Scaling Egocentric Vision: The EPIC-KITCHENS Datasetcited by 789
  8. 2024Diffusion Forcing: Next-token Prediction Meets Full-Sequence Diffusioncited by 634
  9. 2024Movie Gen: A Cast of Media Foundation Modelscited by 614
  10. 2025Self Forcing: Bridging the Train-Test Gap in Autoregressive Video Diffusioncited by 569
  11. 2023InternVid: A Large-scale Video-Text Dataset for Multimodal Understanding and Generationcited by 488
  12. 2023Ego-Exo4D: Understanding Skilled Human Activity from First- and Third-Person Perspectivescited by 477
36 more
  1. 2024Sora: A Review on Background, Technology, Limitations, and Opportunities of Large Vision Modelscited by 467
  2. 2024From Slow Bidirectional to Fast Autoregressive Video Diffusion Modelscited by 401
  3. 2022Assembly101: A Large-Scale Multi-View Video Dataset for Understanding Procedural Activitiescited by 284
  4. 2025MAGI-1: Autoregressive Video Generation at Scalecited by 262
  5. 2024StreamingT2V: Consistent, Dynamic, and Extendable Long Video Generation from Textcited by 242
  6. 2022Egocentric Video-Language Pretrainingcited by 231
  7. 2025SkyReels-V2: Infinite-length Film Generative Modelcited by 218
  8. 2019Cross-task weakly supervised learning from instructional videoscited by 199
  9. 2023NUWA-XL: Diffusion over Diffusion for eXtremely Long Video Generationcited by 170
  10. 2025Frame Context Packing and Drift Prevention in Next-Frame-Prediction Video Diffusion Modelscited by 126
  11. 2019Generalization in Generation: A closer look at Exposure Biascited by 123
  12. 2022EgoTaskQA: Understanding Human Tasks in Egocentric Videoscited by 112
  13. 2024Snap Video: Scaled Spatiotemporal Transformers for Text-to-Video Synthesiscited by 105
  14. 2023VDT: General-purpose Video Diffusion Transformers via Mask Modelingcited by 102
  15. 2025Seaweed-7B: Cost-Effective Training of Video Generation Foundation Modelcited by 81
  16. 2023GenTron: Diffusion Transformers for Image and Video Generationcited by 80
  17. 2024Progressive Autoregressive Video Diffusion Modelscited by 65
  18. 2025RIFLEx: A Free Lunch for Length Extrapolation in Video Diffusion Transformerscited by 63
  19. 2023InstructVid2Vid: Controllable Video Editing with Natural Language Instructionscited by 44
  20. 2025StreamDiT: Real-Time Streaming Text-to-Video Generationcited by 43
  21. 2023Multimodal Procedural Planning via Dual Text-Image Promptingcited by 40
  22. 2025VEGGIE: Instructional Editing and Reasoning Video Concepts with Grounded Generationcited by 39
  23. 2024ViD-GPT: Introducing GPT-style Autoregressive Generation in Video Diffusion Modelscited by 33
  24. 2023EgoDistill: Egocentric Head Motion Distillation for Efficient Video Understandingcited by 32
  25. 2023LEGO: Learning EGOcentric Action Frame Generation via Visual Instruction Tuningcited by 28
  26. 2024EgoGen: An Egocentric Synthetic Data Generatorcited by 27
  27. 2025Exo2Ego: Exocentric Knowledge Guided MLLM for Egocentric Video Understandingcited by 25
  28. 2022EgoEnv: Human-centric environment representations from egocentric videocited by 22
  29. 2024EffiVED:Efficient Video Editing via Text-instruction Diffusion Modelscited by 21
  30. 2023VIDiff: Translating Videos via Multi-Modal Instructions with Diffusion Modelscited by 19
  31. 2025Memory-efficient Streaming VideoLLMs for Real-time Procedural Video Understandingcited by 18
  32. 2024Progress-Aware Video Frame Captioningcited by 10
  33. 2024ShowHowTo: Generating Scene-Conditioned Step-by-Step Visual Instructionscited by 7
  34. 2023Replay: Multi-modal Multi-view Acted Videos for Casual Holographycited by 6
  35. 2024HANDI: Hand-Centric Text-and-Image Conditioned Video Generationcited by 5
  36. 2025Long-horizon Visual Instruction Generation with Logic and Attribute Self-reflectioncited by 4

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2025Show Me: Unifying Instructional Image and Video Generation with Diffusion Models
  2. 2026TempAct: Advancing Temporal Plausibility in Autoregressive Video Generation via Planner-Executor RL
  3. 2025Playing with Transformer at 30+ FPS via Next-Frame Diffusion
  4. 2023GenHowTo: Learning to Generate Actions and State Transformations from Instructional Videos
  5. 2026EditStream: A Unified Autoregressive Framework for Interactive Video Generation and Editing
  6. 2024Optical-Flow Guided Prompt Optimization for Coherent Video Generation
  7. 2026Causal-rCM: A Unified Teacher-Forcing and Self-Forcing Open Recipe for Autoregressive Diffusion Distillation in Streaming Video Generation and Interactive World Models
  8. 2026UniTemp: Unlocking Video Generation in Any Temporal Order via Bidirectional Distillation