mlsanityData to 7 Oct 2026

FrameMorrow: Future-guided Frame Selection with Prospective Tokens for Long-Horizon Video Generation

arXiv 2609.38839 ↗First posted 30 Sep 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Long-horizon video generation requires models to effectively leverage an increasingly long generation history. As the generated history grows, retaining all previous content becomes increasingly expensive and redundant, making effective historical selection essential. Existing approaches often determine historical relevance based on the current content. However, information relevant to the present is not necessarily useful for future generation, while seemingly less relevant history may become important later. Our key insight is that historical information should be selected according to its relevance to future information needs. Capturing these needs does not require generating the full future; instead, a compact representation of what becomes important next is sufficient to guide historical selection. Building on this insight, we propose FrameMorrow, a prospective frame selector that predicts a small set of prospective tokens representing future information needs and uses them to identify relevant information from history. FrameMorrow selects explicit historical frames rather than model-specific internal states, enabling plug-and-play integration across diverse generators, including closed-source models, with little additional inference cost. We evaluate FrameMorrow across five benchmarks and 11 generative models spanning long-video generation, interactive generation, and action-conditioned world models. Extensive experiments demonstrate consistent improvements in long-range consistency, visual quality, and action alignment across diverse generation settings.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 30 of its 34 references that are in the map. First posted on arXiv 30 Sep 2026.

Builds on

30 of 34 references.

References · 30

  1. 2025Self Forcing: Bridging the Train-Test Gap in Autoregressive Video Diffusioncited by 569
  2. 2024From Slow Bidirectional to Fast Autoregressive Video Diffusion Modelscited by 401
  3. 2024OpenVid-1M: A Large-Scale High-Quality Dataset for Text-to-video Generationcited by 332
  4. 2025LongLive: Real-time Interactive Long Video Generationcited by 237
  5. 2026Causal Forcing: Autoregressive Diffusion Distillation Done Right for High-Quality Real-Time Interactive Video Generationcited by 159
  6. 2025WorldMem: Long-term Consistent World Simulation with Memorycited by 152
  7. 2025M-LLM Based Video Frame Selection for Efficient Video Understandingcited by 87
  8. 2026Matrix-Game 3.0: Real-Time and Streaming Interactive World Model with Long-Horizon Memorycited by 86
  9. 2024Frame-Voyager: Learning to Query Frames for Video Large Language Modelscited by 80
  10. 2025Infinity-RoPE: Action-Controllable Infinite Video Generation Emerges From Autoregressive Self-Rolloutcited by 78
  11. 2025Yume-1.5: A Text-Controlled Interactive World Generation Modelcited by 77
  12. 2025Deep Forcing: Training-Free Long Video Generation with Deep Sink and Participative Compressioncited by 72
18 more
  1. 2025MemFlow: Flowing Adaptive Memory for Consistent and Efficient Long Video Narrativescited by 40
  2. 2025StoryMem: Multi-shot Long Video Storytelling with Memorycited by 35
  3. 2025OneStory: Coherent Multi-Shot Video Generation with Adaptive Memorycited by 31
  4. 2026LongLive-2.0: An NVFP4 Parallel Infrastructure for Long Video Generationcited by 25
  5. 2026ShotStream: Streaming Multi-Shot Video Generation for Interactive Storytellingcited by 22
  6. 2026Past- and Future-Informed KV Cache Policy with Salience Estimation in Autoregressive Video Diffusioncited by 13
  7. 2026LongLive-RAG: A General Retrieval-Augmented Framework for Long Video Generationcited by 12
  8. 2026Dual Latent Memory for Visual Multi-agent Systemcited by 9
  9. 2026SkillGraph: Self-Evolving Multi-Agent Collaboration with Multimodal Graph Topologycited by 8
  10. 2025FrameOracle: Learning What to See and How Much to See in Videoscited by 7
  11. 2025FeRA: Frequency-Energy Constrained Routing for Effective Diffusion Adaptation Fine-Tuningcited by 7
  12. 2026Mem-World: Memory-Augmented Action-Conditioned World Models for Persistent Robot Manipulationcited by 6
  13. 2025EgoLCD: Egocentric Video Generation with Long Context Diffusioncited by 5
  14. 2026DySink: Dynamic Frame Sinks for Autoregressive Long Video Generationcited by 5
  15. 2026Future Forcing: Future-aware Training-free KV Cache Policy for Autoregressive Video Generationcited by 4
  16. 2026Memento: Reconstruct to Remember for Consistent Long Video Generationcited by 4
  17. 2026LayerRecall: A State-Conditioned Memory Router for Long-Horizon Consistency in Video Generationcited by 2
  18. 2026SPOT-E: Test-Time Entropy Shaping with Visual Spotlights for Frozen VLMscited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026The Past Frames the Future: Memory for Autoregressive Video Generation
  2. 2025Memorize-and-Generate: Towards Long-Term Consistency in Real-Time Video Generation
  3. 2024A Survey on Future Frame Synthesis: Bridging Deterministic and Generative Approaches
  4. 2026A Mechanistic View on Video Generation as World Models: State and Dynamics
  5. 2026Focused Forcing: Content-Aware Per-Frame KV Selection for Efficient Autoregressive Video Diffusion
  6. 2025VRAG: Learning World Models for Interactive Video Generation
  7. 2026A Frame is Worth One Token: Efficient Generative World Modeling with Delta Tokens
  8. 2026MemLearner: Learning to Query Context memory for Video World Models