mlsanityData to 7 Oct 2026

XGenAct: Geometry-Enhanced World Action Models through Cross-Task Generation

arXiv 2610.03516 ↗First posted 2 Oct 2026cs.RO cs.CV cs.LGcited by 0

On the map: World models → Embodied and robot world models

Abstract (arXiv)

World action models (WAMs) have advanced robot control by predicting how observations and actions evolve over time. Despite this progress, RGB and action based future prediction does not explicitly address the spatial understanding needed for robot manipulation. Existing efforts often add a limited set of spatial prediction tasks through specialized heads or branches, leaving both the range of spatial supervision and the model architecture fragmented. We introduce XGenAct, a world action model that represents RGB observations, robot actions, metric depth, surface normals, and functional role segmentation as RGB videos through deterministic codecs. By sampling perception and action tasks during training, XGenAct uses one video diffusion transformer and one objective to learn temporal prediction across these spaces without modality specific learned heads. On held out RLBench tasks, structured perception training improves average closed loop success over RGB only training, and XGenAct achieves 52% success in the five task external comparison, versus 26% for the strongest evaluated baselines. It also predicts future depth and segmentation more accurately than the evaluated pipelines that generate RGB first and then apply a frozen perception expert.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Embodied and robot world models, one of 11 directions in World models. First posted on arXiv 2 Oct 2026.

Builds on

No reference list yet.

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026InternW0-Δ: A World Action Model Bridging Predictive Dynamics and Actions with 20K+ Hours of Open Data
  2. 2026EA-WM: Event-Aware Generative World Model with Structured Kinematic-to-Visual Action Fields
  3. 2026Spatially Aware World Action Model via Geometric Latent Diffusion
  4. 2026DELE-w0.5: Inferring Action from Future Latent State for Robotic Manipulation
  5. 2026GE-Act 2.0: Pretraining and Scaling a World-Action Model for Robotic Manipulation
  6. 2026DC-WAM: Dynamic-Centric Visual Supervision and Reasoning for World-Action Models
  7. 2026An Action Is Worth One Patch: Unified World-Action Modeling with PatchWAM
  8. 2026DreamWAM: Beyond RGB Future Prediction for World Action Models