mlsanityData to 14 Oct 2026

GeoStream: Toward Precise Camera Controlled Streaming Video Generation

arXiv 2606.15162 ↗First posted 13 Jun 2026cs.CVcited by 4

On the map: World models → Video-generation world models and simulators

Abstract (arXiv)

Accurate interactive camera control is essential for video-based world models, but most existing approaches learn camera motion implicitly, leading to inaccurate control under out-of-distribution trajectories. Explicit geometric conditioning improves controllability, but existing methods are non-autoregressive and rely on a static 3D cache built from an initial frame, which becomes ineffective once the viewpoint moves beyond the original frustum. We propose GeoStream, a framework that enables precise metric-scale camera control in autoregressive streaming video generation. Our method maintains a self-refreshing 3D cache that is periodically updated online from the model's own outputs: we estimate depth from the most recently generated frame, unproject to 3D, and reproject into the target view to produce point reprojections as geometric conditioning for subsequent synthesis. By the same principle, the conditioning seen during training is also rendered from the student's own generated frames, yielding a fully on-policy distillation that naturally aligns the train and inference conditioning distributions. Unlike prior work that uses off-policy condition noising, our approach trains the model against the exact error distribution it encounters at inference, mitigating both standard autoregressive drift and the second-order geometric feedback loop that arises when the cache itself is derived from generated outputs. Quantitative and qualitative results show that our approach substantially improves camera controllability.

Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Placed in Video-generation world models and simulators, one of 11 directions in World models. Builds on 35 of its 84 references that are in the map. First posted on arXiv 13 Jun 2026.

Builds on

35 of 84 references.

Closest ancestors · 7

Same direction, newest first

  1. 2026Advancing Open-source World Models28 Jan
  2. 2026VerseCrafter: Dynamic Realistic Video World Model with 4D Geometric Control8 Jan
  3. 2025Memory Forcing: Spatio-Temporal Memory for Consistent Scene Generation on Minecraft3 Oct
  4. 2025Video World Models with Long-term Spatial Memory5 Jun
  5. 2025MAGI-1: Autoregressive Video Generation at Scale19 May
  6. 2025Wan: Open and Advanced Large-Scale Video Generative Models26 Mar
  7. 2024Genie: Generative Interactive Environments23 Feb

Other references · 28

  1. 2023MotionCtrl: A Unified and Flexible Motion Controller for Video Generationcited by 580
  2. 2026World Action Models are Zero-shot Policiescited by 465
  3. 2024ViewCrafter: Taming Video Diffusion Models for High-fidelity Novel View Synthesiscited by 403
  4. 2025π3: Permutation-Equivariant Visual Geometry Learningcited by 319
  5. 2025Video Depth Anything: Consistent Depth Estimation for Super-Long Videoscited by 207
  6. 2025Self-Forcing++: Towards Minute-Scale High-Quality Video Generationcited by 192
  7. 2025Diffusion as Shader: 3D-aware Video Diffusion for Versatile Video Generation Controlcited by 185
  8. 2026Causal Forcing: Autoregressive Diffusion Distillation Done Right for High-Quality Real-Time Interactive Video Generationcited by 184
  9. 2025UniDepthV2: Universal Monocular Metric Depth Estimation Made Simplercited by 173
  10. 2025VGGT-Long: Chunk it, Loop it, Align it -- Pushing VGGT's Limits on Kilometer-scale Long RGB Sequencescited by 115
  11. 2025Geo4D: Leveraging Video Generators for Geometric 4D Scene Reconstructioncited by 67
  12. 2024World-consistent Video Diffusion with Explicit 3D Modelingcited by 65
16 more
  1. 2026InfiniteVGGT: Visual Geometry Grounded Transformer for Endless Streamscited by 56
  2. 2025FlexWorld: Progressively Expanding 3D Scenes for Flexiable-View Synthesiscited by 37
  3. 2026World-VLA-Loop: Closed-Loop Learning of Video World Model and VLA Policycited by 37
  4. 2025EX-4D: EXtreme Viewpoint 4D Video Synthesis via Depth Watertight Meshcited by 32
  5. 2025FlashWorld: High-quality 3D Scene Generation within Secondscited by 32
  6. 2026LoL: Longer than Longer, Scaling Video Generation to Hourcited by 32
  7. 2025The Role of World Models in Shaping Autonomous Driving: A Comprehensive Surveycited by 29
  8. 2025Scalable Policy Evaluation with Video World Modelscited by 24
  9. 2025Taming Video Models for 3D and 4D Generation via Zero-Shot Camera Controlcited by 18
  10. 2025WorldWeaver: Generating Long-Horizon Video Worlds via Rich Perceptioncited by 16
  11. 2024Latent-Reframe: Enabling Camera Control for Video Diffusion Model without Trainingcited by 13
  12. 2026ReRoPE: Repurposing RoPE for Relative Camera Controlcited by 13
  13. 2026One2Scene: Geometric Consistent Explorable 3D Scene Generation from a Single Imagecited by 11
  14. 2026LaVR: Scene Latent Conditioned Generative Video Trajectory Re-Rendering using Large 4D Reconstruction Modelscited by 10
  15. 2025UniGeo: Taming Video Diffusion for Unified Consistent Geometry Estimationcited by 9
  16. 2026S2DiT: Sandwich Diffusion Transformer for Mobile Streaming Video Generationcited by 7

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 4.

4 papers.

Similar, not cited

Close in wording, no citation either way

  1. 20264DStreamCtrl: Interactive Video Generation with Online 4D Control
  2. 2026Stream4D: 4D-Consistency for Streaming Autoregressive Diffusion Video Models
  3. 2026Geo-Align: Video Generation Alignment via Metric Geometry Reward
  4. 2026WorldStereo: Bridging Camera-Guided Video Generation and Scene Reconstruction via 3D Geometric Memories
  5. 2026UCM: Unified Modeling of Camera Control and Memory with Time-aware Positional Encoding Warping for World Models
  6. 2026MoVerse: Real-Time Video World Modeling with Panoramic Gaussian Scaffold
  7. 2025Taming Camera-Controlled Video Generation with Verifiable Geometry Reward
  8. 2026World-T3: Test-Time Training as Persistent Memory for Real-Time Video World Models