Kepler4D: Controllable Future Video Generation via 4D Scene State Evolution
On the map: World models → Video-generation world models and simulators
Abstract (arXiv)
Video world models aim to preserve scene structure and predict how dynamic objects evolve beyond visual observations. We present Kepler4D, a framework for future video generation through explicit 4D scene state evolution. Given a monocular video, Kepler4D constructs a shared 3D representation of background geometry, object motion histories, coarse spatial supports, and semantic context. Chain-of-Motion summarizes observed motion and uses a vision-language model to select structured speed and heading decisions and decide whether to bound object-center height from below. A deterministic rollout converts these decisions into future object trajectories for inspection and editing before synthesis. We render the evolving proxies into geometric controls for a pretrained video generator, separating coarse object motion from the synthesis of appearance and articulation. Experiments on real-world videos demonstrate that Kepler4D enables controllable object motion and plausible future rollout while preserving scene consistency.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Video-generation world models and simulators, one of 11 directions in World models. First posted on arXiv 2 Oct 2026.
Builds on
No reference list yet.
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026VerseCrafter: Dynamic Realistic Video World Model with 4D Geometric Control
- 2025WorldReel: 4D Video Generation with Consistent Geometry and Motion Modeling
- 20264DStreamCtrl: Interactive Video Generation with Online 4D Control
- 2026Beyond Pixels: From Video Priors to 4D Worlds
- 20264Director: Controlling Video World Models with Rigid 3D Geometry
- 2025Dream4D: Lifting Camera-Controlled I2V towards Spatiotemporally Consistent 4D Generation
- 2025CoCo4D: Comprehensive and Complex 4D Scene Generation
- 2025Free4D: Tuning-free 4D Scene Generation with Spatial-Temporal Consistency