KeyWorld: Key Frame Reasoning Enables Effective and Efficient World Models
On the map: World models → Embodied and robot world models
Abstract (arXiv)
Robotic world models are a promising paradigm for forecasting future environment states, yet their inference speed and the physical plausibility of generated trajectories remain critical bottlenecks, limiting their real-world applications. This stems from the redundancy of the prevailing frame-to-frame generation approach, where the model conducts costly computation on similar frames, as well as neglecting the semantic importance of key transitions. To address this inefficiency, we propose KeyWorld, a framework that improves text-conditioned robotic world models by concentrating transformers computation on a few semantic key frames while employing a lightweight convolutional model to fill the intermediate frames. Specifically, KeyWorld first identifies significant transitions by iteratively simplifying the robot's motion trajectories, obtaining the ground truth key frames. Then, a DiT model is trained to reason and generate these physically meaningful key frames from textual task descriptions. Finally, a lightweight interpolator efficiently reconstructs the full video by inpainting all intermediate frames. Evaluations on the LIBERO benchmark demonstrate that KeyWorld achieves a 5.68× acceleration compared to the frame-to-frame generation baseline, and focusing on the motion-aware key frames further contributes to the physical validity of the generated videos, especially on complex tasks. Our approach highlights a practical path toward deploying world models in real-time robotic control and other domains requiring both efficient and effective world models. Code is released at https://anonymous.4open.science/r/Keyworld-E43D.
Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Placed in Embodied and robot world models, one of 11 directions in World models. Builds on 18 of its 24 references that are in the map. First posted on arXiv 25 Sep 2025.
Builds on
18 of 24 references.
Closest ancestors · 4
Same direction, newest first
- 2025RoboScape: Physics-informed Embodied World Model29 Jun
- 2025WorldVLA: Towards Autoregressive Action World Model26 Jun
- 2024iVideoGPT: Interactive VideoGPTs are Scalable World Models24 May
- 2024RoboDreamer: Learning Compositional World Models for Robot Imagination18 Apr
Other references · 14
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
- 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,061
- 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,410
- 2025Cosmos World Foundation Model Platform for Physical AIcited by 864
- 2023TD-MPC2: Scalable, Robust World Models for Continuous Controlcited by 512
- 2025Unified Video Action Modelcited by 205
- 2024Understanding World or Predicting Future? A Comprehensive Survey of World Modelscited by 166
- 2022FILM: Frame Interpolation for Large Motioncited by 153
- 2024WorldDreamer: Towards General World Models for Video Generation via Predicting Masked Tokenscited by 89
- 2024Real-World Robot Applications of Foundation Models: A Reviewcited by 61
- 2025RoboEnvision: A Long-Horizon Video Generation Model for Multi-Task Robot Manipulationcited by 16
Built on by
Citing papers per year: 2025: 1; 2026: 6.
7 papers.
- 2026Agentic Environment Engineering for Large Language Models: A Survey of Environment Modeling, Synthesis, Evaluation, and Applicationcited by 8
- 2026SKIP: Sparse Keyframe Interpolation Paradigm for Efficient Embodied World Modelscited by 2
- 2026DVG-WM: Disentangled Video Generation Enables Efficient Embodied World Model for Robotic Manipulationcited by 2
- 2025Semantic Communications with World Modelscited by 1
- 2026Improving Robotic Imitation Learning via Trajectory Standardizationcited by 0
- 2026Toward Unified Robot Learning: Bridging Representation, Vision-Language-Action, and World Modelscited by 0
- 2026STRIKE: Learning Visual State Transitions for Physical World Modelingcited by 0
- 2026STRIKE: Learning Visual State Transitions for Physical World Modeling7 Oct 2026
- 2026Toward Unified Robot Learning: Bridging Representation, Vision-Language-Action, and World Models3 Sep 2026
- 2026DVG-WM: Disentangled Video Generation Enables Efficient Embodied World Model for Robotic Manipulation30 Jun 2026
- 2026Improving Robotic Imitation Learning via Trajectory Standardization22 Jun 2026
- 2026Agentic Environment Engineering for Large Language Models: A Survey of Environment Modeling, Synthesis, Evaluation, and Application10 Jun 2026
- 2026SKIP: Sparse Keyframe Interpolation Paradigm for Efficient Embodied World Models30 May 2026
- 2025Semantic Communications with World Models27 Oct 2025
Similar, not cited
Close in wording, no citation either way
- 2026Causal World Modeling for Robot Control
- 2026Reconstruction or Semantics? What Makes a Latent Space Useful for Robotic World Models
- 2025Target-Bench: Can Video World Models Achieve Mapless Path Planning with Semantic Targets?
- 2026RoboWorld: Fast and Reliable Neural Simulators for Generalist Robot Policy Evaluation
- 2026LaWAM: Latent World Action Models for Efficient Dynamics-Aware Robot Policies
- 2026DELE-w0.5: Inferring Action from Future Latent State for Robotic Manipulation
- 2026One from Infinity: Actualizing Futures from Pretrained World Models into Robot Actions
- 2026Motubrain: An Advanced World Action Model for Robot Control