Learning 4D Geometric Priors for Inference-Efficient World Action Models
On the map: World models → Embodied and robot world models
Abstract (arXiv)
World Action Models (WAMs) have shown strong potential for robotic manipulation by jointly modeling visual future dynamics and executable action sequences. However, existing video-action co-training methods primarily optimize appearance-oriented video latents, which may insufficiently capture the temporally evolving geometry required for precise manipulation. We propose MECo-WAM, a Multi-Expert Co-Training World Action Model that injects action-relevant 4D geometric priors into video-action representations while preserving the original lightweight inference graph. During training, MECo-WAM combines video and action experts with a lightweight 4D expert supervised by relational targets from a frozen VGGT encoder. Asymmetric expert visibility prevents non-causal shortcuts from auxiliary geometry to action generation. To transfer geometric knowledge into the deployed video-action pathway, we introduce decayed 4D read-mask attention, which provides restricted current-frame geometric guidance early in training and progressively removes this dependency. We further propose action-aware temporal geometric distillation, which aligns within-frame geometric relations and their temporal evolution while emphasizing visual regions most relevant to robot actions. At deployment, all auxiliary 4D components are removed. Experiments on LIBERO (98.2%), RoboTwin 2.0 (92.6%), and challenging real-world manipulation tasks show that MECo-WAM improves manipulation performance without increasing inference cost.
Key facts. Cited by 15 papers in the map (data through 14 Oct 2026). Placed in Embodied and robot world models, one of 11 directions in World models. Builds on 25 of its 42 references that are in the map. First posted on arXiv 6 Jul 2026.
Builds on
25 of 42 references.
Closest ancestors · 9
Same direction, newest first
- 2026WAM4D: Fast 4D World Action Model via Spatial Register Tokens12 Jun
- 2026World Action Models: The Next Frontier in Embodied AI12 May
- 2026Motubrain: An Advanced World Action Model for Robot Control30 Apr
- 2026Unified 4D World Action Modeling from Video Priors with Asynchronous Denoising29 Apr
- 2026GigaWorld-Policy: An Efficient Action-Centered World--Action Model18 Mar
- 2026Fast-WAM: Do World Action Models Need Test-time Future Imagination?17 Mar
- 2026World Action Models are Zero-shot Policies17 Feb
- 2026Causal World Modeling for Robot Control29 Jan
- 2025Towards High-Consistency Embodied World Model with Multi-View Trajectory Videos17 Nov
Other references · 16
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,407
- 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,761
- 2025Fine-Tuning Vision-Language-Action Models: Optimizing Speed and Successcited by 883
- 2025FAST: Efficient Action Tokenization for Vision-Language-Action Modelscited by 665
- 2025SpatialVLA: Exploring Spatial Representations for Visual-Language-Action Modelcited by 519
- 2025X-VLA: Soft-Prompted Transformer as Scalable Cross-Embodiment Vision-Language-Action Modelcited by 303
- 2026Cosmos Policy: Fine-Tuning Video Models for Visuomotor Control and Planningcited by 300
- 2025mimic-video: Video-Action Models for Generalizable Robot Control Beyond VLAscited by 142
- 2025Unified Vision-Language-Action Modelcited by 134
- 2025Discrete Diffusion VLA: Bringing Discrete Diffusion to Action Decoding in Vision-Language-Action Policiescited by 90
- 2026DiT4DiT: Jointly Modeling Video Dynamics and Actions for Generalizable Robot Controlcited by 76
4 more
- 2025GeoVLA: Empowering 3D Representations in Vision-Language-Action Modelscited by 70
- 2026Next Forcing: Causal World Modeling with Multi-Chunk Predictioncited by 18
- 2026Any3D-VLA: Enhancing VLA Robustness via Diverse Point Cloudscited by 13
- 2026DeMaVLA: A Vision-Language-Action Foundation Model for Generalizable Deformable Manipulationcited by 9
Built on by
Citing papers per year: 2026: 15.
15 papers.
Sort:
By area:
- 20264D-WAM: Infusing Spatiotemporal Awareness into World Action Models through Trajectory Fieldscited by 13
- 2026ST-WAM: Semantic-Temporal World Action Model for Robust Manipulation under Visual Distribution Shiftscited by 11
- 2026StageWAM: Joint-Embedding Stage Prediction for World-Action Models in Robot Manipulationcited by 3
- 2026DC-WAM: Dynamic-Centric Visual Supervision and Reasoning for World-Action Modelscited by 2
- 2026WNM-3D: A World Navigation Model with 3D Scene Conditioning for Closed-Loop VLNcited by 2
- 2026DIDO: Distilling Interaction-Centric Dynamics into One-Step Denoising for World Action Modelscited by 2
- 2026Acting in Meters: Learning Metric Interactions for Precise Robotic Manipulationcited by 0
- 2026CSWAM: Better Causal Semantic Representations for Out-of-Distribution Generalization in World Action Modelscited by 0
- 2026MaskHarness-WAM: Instance-Grounded Harnessing for Long-Horizon Robot Manipulationcited by 0
- 2026MT-WAM: Reorienting the One-Pass Predictive Representation Toward Action Generationcited by 0
- 2026An Action Is Worth One Patch: Unified World-Action Modeling with PatchWAMcited by 0
- 2026Copper-Policy: Focus on the Representation for Robust Robot Manipulationcited by 0
- 2026What Visual Representations Do World Action Models Need?9 Oct 2026
- 2026MVG-WAM: Multiple View Geometry-Aware World-Action Modeling for Robotic Manipulation29 Sep 2026
- 2026Spatial Grafting: Grounding 3D Features for Flow-Matching Robot Policies28 Sep 2026
- 2026Copper-Policy: Focus on the Representation for Robust Robot Manipulation26 Sep 2026
- 2026An Action Is Worth One Patch: Unified World-Action Modeling with PatchWAM22 Sep 2026
- 2026MT-WAM: Reorienting the One-Pass Predictive Representation Toward Action Generation18 Sep 2026
- 2026MaskHarness-WAM: Instance-Grounded Harnessing for Long-Horizon Robot Manipulation17 Sep 2026
- 2026CSWAM: Better Causal Semantic Representations for Out-of-Distribution Generalization in World Action Models16 Sep 2026
- 2026Acting in Meters: Learning Metric Interactions for Precise Robotic Manipulation16 Sep 2026
- 2026DIDO: Distilling Interaction-Centric Dynamics into One-Step Denoising for World Action Models14 Sep 2026
- 2026StageWAM: Joint-Embedding Stage Prediction for World-Action Models in Robot Manipulation11 Aug 2026
- 20264D-WAM: Infusing Spatiotemporal Awareness into World Action Models through Trajectory Fields8 Aug 2026
3 more
- 2026WNM-3D: A World Navigation Model with 3D Scene Conditioning for Closed-Loop VLN7 Aug 2026
- 2026ST-WAM: Semantic-Temporal World Action Model for Robust Manipulation under Visual Distribution Shifts31 Jul 2026
- 2026DC-WAM: Dynamic-Centric Visual Supervision and Reasoning for World-Action Models28 Jul 2026
- 20264D-WAM: Infusing Spatiotemporal Awareness into World Action Models through Trajectory Fieldscited by 13
- 2026ST-WAM: Semantic-Temporal World Action Model for Robust Manipulation under Visual Distribution Shiftscited by 11
- 2026StageWAM: Joint-Embedding Stage Prediction for World-Action Models in Robot Manipulationcited by 3
- 2026DC-WAM: Dynamic-Centric Visual Supervision and Reasoning for World-Action Modelscited by 2
- 2026DIDO: Distilling Interaction-Centric Dynamics into One-Step Denoising for World Action Modelscited by 2
- 2026Acting in Meters: Learning Metric Interactions for Precise Robotic Manipulationcited by 0
- 2026CSWAM: Better Causal Semantic Representations for Out-of-Distribution Generalization in World Action Modelscited by 0
- 2026An Action Is Worth One Patch: Unified World-Action Modeling with PatchWAMcited by 0
- 2026Copper-Policy: Focus on the Representation for Robust Robot Manipulationcited by 0
- 2026Spatial Grafting: Grounding 3D Features for Flow-Matching Robot Policiescited by 0
- 2026MVG-WAM: Multiple View Geometry-Aware World-Action Modeling for Robotic Manipulationcited by 0
- 2026What Visual Representations Do World Action Models Need?cited by 0
- 2026What Visual Representations Do World Action Models Need?9 Oct 2026
- 2026MVG-WAM: Multiple View Geometry-Aware World-Action Modeling for Robotic Manipulation29 Sep 2026
- 2026Spatial Grafting: Grounding 3D Features for Flow-Matching Robot Policies28 Sep 2026
- 2026Copper-Policy: Focus on the Representation for Robust Robot Manipulation26 Sep 2026
- 2026An Action Is Worth One Patch: Unified World-Action Modeling with PatchWAM22 Sep 2026
- 2026CSWAM: Better Causal Semantic Representations for Out-of-Distribution Generalization in World Action Models16 Sep 2026
- 2026Acting in Meters: Learning Metric Interactions for Precise Robotic Manipulation16 Sep 2026
- 2026DIDO: Distilling Interaction-Centric Dynamics into One-Step Denoising for World Action Models14 Sep 2026
- 2026StageWAM: Joint-Embedding Stage Prediction for World-Action Models in Robot Manipulation11 Aug 2026
- 20264D-WAM: Infusing Spatiotemporal Awareness into World Action Models through Trajectory Fields8 Aug 2026
- 2026ST-WAM: Semantic-Temporal World Action Model for Robust Manipulation under Visual Distribution Shifts31 Jul 2026
- 2026DC-WAM: Dynamic-Centric Visual Supervision and Reasoning for World-Action Models28 Jul 2026
Similar, not cited
Close in wording, no citation either way
- 2026InternW0-Δ: A World Action Model Bridging Predictive Dynamics and Actions with 20K+ Hours of Open Data
- 2026Geometric Action Model for Robot Policy Learning
- 2026ACG-WAM: World-Action Modeling via Action-Conditioned Geometric Latent Prediction
- 2026GaussianWAM: Distilling Geometry and Semantics from 3D Gaussian Fields into World-Action Models
- 2026LD4WAM: Learning Latent Dynamics from Human Videos for World Action Models
- 2026GEM-4D: Geometry-Enhanced Video World Models for Robot Manipulation
- 2026LAWM-3D: Learning 3D-Aware Latent Actions from Human Videos for Generalizable Robot World Models
- 2026MVISTA-4D: View-Consistent 4D World Model with Test-Time Action Inference for Robotic Manipulation