GeoStream: Toward Precise Camera Controlled Streaming Video Generation
On the map: World models → Video-generation world models and simulators
Abstract (arXiv)
Accurate interactive camera control is essential for video-based world models, but most existing approaches learn camera motion implicitly, leading to inaccurate control under out-of-distribution trajectories. Explicit geometric conditioning improves controllability, but existing methods are non-autoregressive and rely on a static 3D cache built from an initial frame, which becomes ineffective once the viewpoint moves beyond the original frustum. We propose GeoStream, a framework that enables precise metric-scale camera control in autoregressive streaming video generation. Our method maintains a self-refreshing 3D cache that is periodically updated online from the model's own outputs: we estimate depth from the most recently generated frame, unproject to 3D, and reproject into the target view to produce point reprojections as geometric conditioning for subsequent synthesis. By the same principle, the conditioning seen during training is also rendered from the student's own generated frames, yielding a fully on-policy distillation that naturally aligns the train and inference conditioning distributions. Unlike prior work that uses off-policy condition noising, our approach trains the model against the exact error distribution it encounters at inference, mitigating both standard autoregressive drift and the second-order geometric feedback loop that arises when the cache itself is derived from generated outputs. Quantitative and qualitative results show that our approach substantially improves camera controllability.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Placed in Video-generation world models and simulators, one of 11 directions in World models. Builds on 35 of its 84 references that are in the map. First posted on arXiv 13 Jun 2026.
Builds on
35 of 84 references.
Closest ancestors · 7
Same direction, newest first
- 2026Advancing Open-source World Models28 Jan
- 2026VerseCrafter: Dynamic Realistic Video World Model with 4D Geometric Control8 Jan
- 2025Memory Forcing: Spatio-Temporal Memory for Consistent Scene Generation on Minecraft3 Oct
- 2025Video World Models with Long-term Spatial Memory5 Jun
- 2025MAGI-1: Autoregressive Video Generation at Scale19 May
- 2025Wan: Open and Advanced Large-Scale Video Generative Models26 Mar
- 2024Genie: Generative Interactive Environments23 Feb
Other references · 28
- 2023MotionCtrl: A Unified and Flexible Motion Controller for Video Generationcited by 580
- 2026World Action Models are Zero-shot Policiescited by 465
- 2024ViewCrafter: Taming Video Diffusion Models for High-fidelity Novel View Synthesiscited by 403
- 2025π3: Permutation-Equivariant Visual Geometry Learningcited by 319
- 2025Video Depth Anything: Consistent Depth Estimation for Super-Long Videoscited by 207
- 2025Self-Forcing++: Towards Minute-Scale High-Quality Video Generationcited by 192
- 2025Diffusion as Shader: 3D-aware Video Diffusion for Versatile Video Generation Controlcited by 185
- 2026Causal Forcing: Autoregressive Diffusion Distillation Done Right for High-Quality Real-Time Interactive Video Generationcited by 184
- 2025UniDepthV2: Universal Monocular Metric Depth Estimation Made Simplercited by 173
- 2025VGGT-Long: Chunk it, Loop it, Align it -- Pushing VGGT's Limits on Kilometer-scale Long RGB Sequencescited by 115
- 2025Geo4D: Leveraging Video Generators for Geometric 4D Scene Reconstructioncited by 67
- 2024World-consistent Video Diffusion with Explicit 3D Modelingcited by 65
16 more
- 2026InfiniteVGGT: Visual Geometry Grounded Transformer for Endless Streamscited by 56
- 2025FlexWorld: Progressively Expanding 3D Scenes for Flexiable-View Synthesiscited by 37
- 2026World-VLA-Loop: Closed-Loop Learning of Video World Model and VLA Policycited by 37
- 2025EX-4D: EXtreme Viewpoint 4D Video Synthesis via Depth Watertight Meshcited by 32
- 2025FlashWorld: High-quality 3D Scene Generation within Secondscited by 32
- 2026LoL: Longer than Longer, Scaling Video Generation to Hourcited by 32
- 2025The Role of World Models in Shaping Autonomous Driving: A Comprehensive Surveycited by 29
- 2025Scalable Policy Evaluation with Video World Modelscited by 24
- 2025Taming Video Models for 3D and 4D Generation via Zero-Shot Camera Controlcited by 18
- 2025WorldWeaver: Generating Long-Horizon Video Worlds via Rich Perceptioncited by 16
- 2024Latent-Reframe: Enabling Camera Control for Video Diffusion Model without Trainingcited by 13
- 2026ReRoPE: Repurposing RoPE for Relative Camera Controlcited by 13
- 2026One2Scene: Geometric Consistent Explorable 3D Scene Generation from a Single Imagecited by 11
- 2026LaVR: Scene Latent Conditioned Generative Video Trajectory Re-Rendering using Large 4D Reconstruction Modelscited by 10
- 2025UniGeo: Taming Video Diffusion for Unified Consistent Geometry Estimationcited by 9
- 2026S2DiT: Sandwich Diffusion Transformer for Mobile Streaming Video Generationcited by 7
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026MemoBench: Benchmarking World Modeling in Dynamically Changing Environmentscited by 12
- 2026From RGB Generation to Dense Field Readout: Pixel-Space Dense Prediction with Text-to-Image Modelscited by 1
- 2026FlashRender: Few-Step Generative Rendering via Camera-Controlled Video MeanFlowcited by 0
- 2026Honeycomb: Constant-Size Scene Memory Representation for Video World Modelscited by 0
- 2026Honeycomb: Constant-Size Scene Memory Representation for Video World Models29 Sep 2026
- 2026FlashRender: Few-Step Generative Rendering via Camera-Controlled Video MeanFlow3 Sep 2026
- 2026From RGB Generation to Dense Field Readout: Pixel-Space Dense Prediction with Text-to-Image Models7 Jul 2026
- 2026MemoBench: Benchmarking World Modeling in Dynamically Changing Environments25 Jun 2026
Similar, not cited
Close in wording, no citation either way
- 20264DStreamCtrl: Interactive Video Generation with Online 4D Control
- 2026Stream4D: 4D-Consistency for Streaming Autoregressive Diffusion Video Models
- 2026Geo-Align: Video Generation Alignment via Metric Geometry Reward
- 2026WorldStereo: Bridging Camera-Guided Video Generation and Scene Reconstruction via 3D Geometric Memories
- 2026UCM: Unified Modeling of Camera Control and Memory with Time-aware Positional Encoding Warping for World Models
- 2026MoVerse: Real-Time Video World Modeling with Panoramic Gaussian Scaffold
- 2025Taming Camera-Controlled Video Generation with Verifiable Geometry Reward
- 2026World-T3: Test-Time Training as Persistent Memory for Real-Time Video World Models