mlsanityData to 14 Oct 2026

KeyWorld: Key Frame Reasoning Enables Effective and Efficient World Models

arXiv 2509.21027 ↗First posted 25 Sep 2025cs.RO cs.CVcited by 7

On the map: World models → Embodied and robot world models

Abstract (arXiv)

Robotic world models are a promising paradigm for forecasting future environment states, yet their inference speed and the physical plausibility of generated trajectories remain critical bottlenecks, limiting their real-world applications. This stems from the redundancy of the prevailing frame-to-frame generation approach, where the model conducts costly computation on similar frames, as well as neglecting the semantic importance of key transitions. To address this inefficiency, we propose KeyWorld, a framework that improves text-conditioned robotic world models by concentrating transformers computation on a few semantic key frames while employing a lightweight convolutional model to fill the intermediate frames. Specifically, KeyWorld first identifies significant transitions by iteratively simplifying the robot's motion trajectories, obtaining the ground truth key frames. Then, a DiT model is trained to reason and generate these physically meaningful key frames from textual task descriptions. Finally, a lightweight interpolator efficiently reconstructs the full video by inpainting all intermediate frames. Evaluations on the LIBERO benchmark demonstrate that KeyWorld achieves a 5.68× acceleration compared to the frame-to-frame generation baseline, and focusing on the motion-aware key frames further contributes to the physical validity of the generated videos, especially on complex tasks. Our approach highlights a practical path toward deploying world models in real-time robotic control and other domains requiring both efficient and effective world models. Code is released at https://anonymous.4open.science/r/Keyworld-E43D.

Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Placed in Embodied and robot world models, one of 11 directions in World models. Builds on 18 of its 24 references that are in the map. First posted on arXiv 25 Sep 2025.

Builds on

18 of 24 references.

Closest ancestors · 4

Same direction, newest first

  1. 2025RoboScape: Physics-informed Embodied World Model29 Jun
  2. 2025WorldVLA: Towards Autoregressive Action World Model26 Jun
  3. 2024iVideoGPT: Interactive VideoGPTs are Scalable World Models24 May
  4. 2024RoboDreamer: Learning Compositional World Models for Robot Imagination18 Apr

Other references · 14

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
  3. 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,061
  4. 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,410
  5. 2025Cosmos World Foundation Model Platform for Physical AIcited by 864
  6. 2023TD-MPC2: Scalable, Robust World Models for Continuous Controlcited by 512
  7. 2025Unified Video Action Modelcited by 205
  8. 2024Understanding World or Predicting Future? A Comprehensive Survey of World Modelscited by 166
  9. 2022FILM: Frame Interpolation for Large Motioncited by 153
  10. 2024WorldDreamer: Towards General World Models for Video Generation via Predicting Masked Tokenscited by 89
  11. 2024Real-World Robot Applications of Foundation Models: A Reviewcited by 61
  12. 2025RoboEnvision: A Long-Horizon Video Generation Model for Multi-Task Robot Manipulationcited by 16
2 more
  1. 2023Reward-Consistent Dynamics Models are Strongly Generalizable for Offline Reinforcement Learningcited by 12
  2. 2023FusionFrames: Efficient Architectural Aspects for Text-to-Video Generation Pipelinecited by 8

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 6.

7 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Causal World Modeling for Robot Control
  2. 2026Reconstruction or Semantics? What Makes a Latent Space Useful for Robotic World Models
  3. 2025Target-Bench: Can Video World Models Achieve Mapless Path Planning with Semantic Targets?
  4. 2026RoboWorld: Fast and Reliable Neural Simulators for Generalist Robot Policy Evaluation
  5. 2026LaWAM: Latent World Action Models for Efficient Dynamics-Aware Robot Policies
  6. 2026DELE-w0.5: Inferring Action from Future Latent State for Robotic Manipulation
  7. 2026One from Infinity: Actualizing Futures from Pretrained World Models into Robot Actions
  8. 2026Motubrain: An Advanced World Action Model for Robot Control