mlsanityData to 7 Oct 2026

Kepler4D: Controllable Future Video Generation via 4D Scene State Evolution

arXiv 2610.04152 ↗First posted 2 Oct 2026cs.CVcited by 0

On the map: World models → Video-generation world models and simulators

Abstract (arXiv)

Video world models aim to preserve scene structure and predict how dynamic objects evolve beyond visual observations. We present Kepler4D, a framework for future video generation through explicit 4D scene state evolution. Given a monocular video, Kepler4D constructs a shared 3D representation of background geometry, object motion histories, coarse spatial supports, and semantic context. Chain-of-Motion summarizes observed motion and uses a vision-language model to select structured speed and heading decisions and decide whether to bound object-center height from below. A deterministic rollout converts these decisions into future object trajectories for inspection and editing before synthesis. We render the evolving proxies into geometric controls for a pretrained video generator, separating coarse object motion from the synthesis of appearance and articulation. Experiments on real-world videos demonstrate that Kepler4D enables controllable object motion and plausible future rollout while preserving scene consistency.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Video-generation world models and simulators, one of 11 directions in World models. First posted on arXiv 2 Oct 2026.

Builds on

No reference list yet.

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026VerseCrafter: Dynamic Realistic Video World Model with 4D Geometric Control
  2. 2025WorldReel: 4D Video Generation with Consistent Geometry and Motion Modeling
  3. 20264DStreamCtrl: Interactive Video Generation with Online 4D Control
  4. 2026Beyond Pixels: From Video Priors to 4D Worlds
  5. 20264Director: Controlling Video World Models with Rigid 3D Geometry
  6. 2025Dream4D: Lifting Camera-Controlled I2V towards Spatiotemporally Consistent 4D Generation
  7. 2025CoCo4D: Comprehensive and Complex 4D Scene Generation
  8. 2025Free4D: Tuning-free 4D Scene Generation with Spatial-Temporal Consistency