ACG-WAM: World-Action Modeling via Action-Conditioned Geometric Latent Prediction
On the map: World models → Embodied and robot world models
Abstract (arXiv)
World action models jointly learn visual predictionand robot actions, providing a way to use observations ofscene evolution for policy learning. Their video and actionlosses, however, provide no explicit target for the geometricconsequences of a demonstrated action sequence. Moreover,visual features taken after temporal attention can contain futureobservations, making them unsuitable as the sole current visualinput to an auxiliary predictor. We introduce ACG-WAMand its auxiliary objective, the Action-Conditioned GeometricJoint-Embedding Predictive Architecture (ACG-JEPA), whichpredicts geometric features at several horizons from the currentobservation and intervening actions, using the future slot of afrozen VGGT encoding of each current and future image pairas the target. We apply this supervision from the head and wristcameras to a shared visual embedding before temporal mixing,and remove the teacher and auxiliary modules at inference.On 50 RoboTwin 2.0 tasks, ACG-WAM achieves 93.46%success in clean scenes, with the best randomized success(92.68%) and mean across both settings (93.07%) among thecompared methods; across three tasks on a real robot, itachieves 85.00% success and 91.67% partial completion score,exceeding Motus by 10.00 and 9.17 percentage points, respec-tively. Code:https://github.com/RoboOpus/ACG-WAM.Website:https://RoboOpus.github.io/ACG-WAM.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Embodied and robot world models, one of 11 directions in World models. First posted on arXiv 3 Oct 2026.
Builds on
No reference list yet.
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026GigaWorld-Policy: An Efficient Action-Centered World--Action Model
- 2026SG-WAM: Self-Guided World Modeling in Geometry-Aware Policy Space
- 2026InternW0-Δ: A World Action Model Bridging Predictive Dynamics and Actions with 20K+ Hours of Open Data
- 2026JEPA-WAM: Learning Vision-Language-Action Policies with Joint-Embedding World Modeling
- 2026Spatially Aware World Action Model via Geometric Latent Diffusion
- 2026GigaWorld-Policy-0.5: A Faster and Stronger WAM Empowered by AutoResearch
- 2026Foresight Without Seeing: Latent Futures for World Action Models
- 2026Geometric Action Model for Robot Policy Learning