IOI: Decoupling Kinematics and Physics for Interactive World Models
On the map: World models → Embodied and robot world models
Abstract (arXiv)
Developing generalist embodied agents requires interactive environments providing visually realistic feedback and accurate action-conditioned dynamics. Interactive world models address this by simulating such complex dynamics. However, purely data-driven methods struggle to ensure precise control alignment and physically plausible visual feedback due to a lack of explicit structural constraints. To address this, we propose IOI, a hybrid interactive world model integrating analytical kinematic priors with learned physical dynamics. Unlike data-driven approaches prone to spatiotemporal drift, IOI introduces explicit kinematic guidance, computing forward kinematics from action sequences for accurate motion trajectories. These trajectories are rendered into synchronized front, side, and top orthographic projections, eliminating the need for extrinsic camera calibration. A Multi-view Kinematic Aggregation and Injection module fuses these geometric cues and injects them into the video generator, providing geometry-consistent guidance. Conditioning video generation on these deterministic trajectories establishes a synergy between the analytical simulator and the world model. Decoupling deterministic motion into the kinematic prior frees the generator to model stochastic physical interactions. Experiments on the RoboTwin benchmark validate IOI across kinematic fidelity, out-of-distribution (OOD) generalization, and policy evaluation. IOI achieves state-of-the-art simulation performance and robust zero-shot generalization to unseen OOD tasks. Furthermore, IOI serves as a reliable policy evaluator, yielding success rates closely aligning with ground-truth physics simulators. On real-world platforms, policies trained on IOI-synthesized data match those trained on teleoperation demonstrations, solidifying its practical value for embodied policy learning.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Embodied and robot world models, one of 11 directions in World models. First posted on arXiv 22 Jun 2026.
Builds on
0 of 0 references.
No references here yet.
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026ACWM-Phys: Investigating Generalized Physical Interaction in Action-Conditioned Video World Models
- 2026GeniWorld: A Generalizable Interactive World Model for Robotic Manipulation via Visual Actions
- 2026WorldSimProbe: Diagnosing Simulator Faithfulness in Action-Conditioned World Models for Embodied Manipulation
- 2025Towards High-Consistency Embodied World Model with Multi-View Trajectory Videos
- 2026Interactive World Simulator for Robot Policy Training and Evaluation
- 2026Kinema4D: Kinematic 4D World Modeling for Spatiotemporal Embodied Simulation
- 2026Robotic Video World Models: A Survey of Applications, Research Challenges, Future Directions
- 2026iMaC: Translating Actions into Motion and Contact Images for Embodied World Models