EA-WM: Event-Aware Generative World Model with Structured Kinematic-to-Visual Action Fields
On the map: World models → Embodied and robot world models
also in 1 more
Abstract (arXiv)
Pretrained video diffusion models provide powerful spatiotemporal generative priors, making them a natural foundation for robotic world models. While recent world-action models jointly optimize future videos and actions, they predominantly treat video generation as an auxiliary representation for policy learning. Consequently, they insufficiently explore the inverse problem: leveraging action signals to guide video synthesis, thereby often failing to preserve precise robot spatial geometry and fine-grained robot-object interaction dynamics in the generated rollouts. To bridge this gap, we present EA-WM, an Event-Aware Generative World Model that effectively closes the loop between kinematic control and visual perception. Rather than injecting joint or end-effector actions as abstract, low-dimensional tokens, EA-WM projects actions and kinematic states directly into the target camera view as Structured Kinematic-to-Visual Action Fields. To fully exploit this geometrically grounded representation, we introduce event-aware bidirectional fusion blocks that modulate cross-branch attention, capturing object state changes and interaction dynamics. Evaluated on the comprehensive WorldArena benchmark, EA-WM achieves state-of-the-art performance, outperforming existing baselines by a significant margin.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Placed in Embodied and robot world models, one of 11 directions in World models. Builds on 29 of its 30 references that are in the map. First posted on arXiv 7 May 2026.
Builds on
29 of 30 references.
Closest ancestors · 11
Same direction, newest first
- 2026Action Images: End-to-End Policy Learning via Multiview Video Generation7 Apr
- 2026World Guidance: World Modeling in Condition Space for Action Generation25 Feb
- 2026World Action Models are Zero-shot Policies17 Feb
- 2025Motus: A Unified Latent Action World Model15 Dec
- 2025Scalable Policy Evaluation with Video World Models14 Nov
- 2025WorldGym: World Model as An Environment for Policy Evaluation31 May
- 2025WorldEval: World Model as Real-World Robot Policies Evaluator25 May
- 2025DreamGen: Unlocking Generalization in Robot Learning through Video World Models19 May
- 2025Unified World Models: Coupling Video and Action Diffusion for Pretraining on Large Robotic Datasets3 Apr
- 2024IRASim: A Fine-Grained World Model for Robot Manipulation20 Jun
- 2024iVideoGPT: Interactive VideoGPTs are Scalable World Models24 May
Other references · 18
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,526
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,198
- 2025Cosmos World Foundation Model Platform for Physical AIcited by 833
- 2025SpatialVLA: Exploring Spatial Representations for Visual-Language-Action Modelcited by 502
- 2024Lumiere: A Space-Time Diffusion Model for Video Generationcited by 450
- 2026Cosmos Policy: Fine-Tuning Video Models for Visuomotor Control and Planningcited by 274
- 2025Unified Video Action Modelcited by 195
- 2025mimic-video: Video-Action Models for Generalizable Robot Control Beyond VLAscited by 133
- 2025Video Generators are Robot Policiescited by 86
- 2025Universal Actions for Enhanced Embodied Foundation Modelscited by 80
- 2026WorldArena: A Unified Benchmark for Evaluating Perception and Functional Utility of Embodied World Modelscited by 68
6 more
- 2025VideoVLA: Video Generators Can Be Generalizable Robot Manipulatorscited by 61
- 2025Wan-S2V: Audio-Driven Cinematic Video Generationcited by 60
- 2024AVID: Adapting Video Diffusion Models to World Modelscited by 35
- 2025ViPRA: Video Prediction for Robot Actionscited by 24
- 2024Render and Diffuse: Aligning Image and Action Spaces for Diffusion-based Behaviour Cloningcited by 19
- 2024Generative Image as Action Modelscited by 18
Built on by
Citing papers per year: 2026: 3.
3 papers.
- 2026How Should World Models Be Evaluated for Embodied Decision-Making? A Decision-Making-Centric Positioncited by 9
- 2026IMPACT: Attention Is the Interaction Map for Scalable Interaction-Aware World Model Trainingcited by 1
- 2026Do Robotic World Models Really Follow Actions? Diagnosing and Aligning Action-Conditioned Generation for Policy Learningcited by 0
- 2026IMPACT: Attention Is the Interaction Map for Scalable Interaction-Aware World Model Training31 Aug 2026
- 2026Do Robotic World Models Really Follow Actions? Diagnosing and Aligning Action-Conditioned Generation for Policy Learning25 Aug 2026
- 2026How Should World Models Be Evaluated for Embodied Decision-Making? A Decision-Making-Centric Position13 Jun 2026
Similar, not cited
Close in wording, no citation either way
- 2026InternW0-Δ: A World Action Model Bridging Predictive Dynamics and Actions with 20K+ Hours of Open Data
- 2026AHA-WAM:Asynchronous Horizon-Adaptive World-Action Modeling with Observation-Guided Context Routing
- 2026Spatially Aware World Action Model via Geometric Latent Diffusion
- 2026Foresight Without Seeing: Latent Futures for World Action Models
- 2026KineWorld: Action-Induced Transport Fields for Embodied World Modeling
- 2026Causal World Modeling for Robot Control
- 2026LaWAM: Latent World Action Models for Efficient Dynamics-Aware Robot Policies
- 2026GigaWorld-Policy: An Efficient Action-Centered World--Action Model