mlsanityData to 7 Oct 2026

GaussianDream++: Efficient 3D Gaussian World Modeling for Robotic Manipulation

arXiv 2608.25659 ↗First posted 26 Aug 2026cs.ROcited by 0

On the map: World models → Embodied and robot world models

also in 1 more
Abstract (arXiv)

Vision-Language-Action (VLA) policies have advanced language-conditioned robotic manipulation, yet action-imitation objectives provide only weak supervision for metric 3D structure and short-horizon physical evolution. Geometry-enhanced policies mainly improve current-scene grounding, whereas predictive policies often model future dynamics in RGB or latent spaces and may incur substantial deployment cost. GaussianDream demonstrates that training-time current Gaussian reconstruction and future Gaussian prediction provide effective 3D supervision, but its dense VGGT/TGE-based prefix jointly carries state, dynamics, and action-conditioning information. We present methodname, a compact, policy-native extension that inserts World State Tokens and World Prediction Tokens directly into the VLA backbone. A training-only World Representation Head decodes these tokens into a Current World and coupled Future Prediction over shared Gaussian primitives, while static--dynamic factorization preserves persistent structure and focuses residual motion on interaction-relevant regions. At inference, the head, renderer, auxiliary objectives, and VGGT/TGE pathway are removed, leaving only 20 world tokens without online Gaussian decoding or rollout. method achieves 98.6% on LIBERO and 87.8% on LIBERO-Plus, with clear gains under Camera and Layout shifts. Real-robot experiments further improve average success from 29.2% to 52.5% over reproduced π0.5 while maintaining efficient closed-loop control.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Embodied and robot world models, one of 11 directions in World models. Builds on 28 of its 34 references that are in the map. First posted on arXiv 26 Aug 2026.

Builds on

28 of 34 references.

Closest ancestors · 6

Same direction, newest first

  1. 2026Fast-WAM: Do World Action Models Need Test-time Future Imagination?17 Mar
  2. 2026World Action Models are Zero-shot Policies17 Feb
  3. 2026Causal World Modeling for Robot Control29 Jan
  4. 2025Motus: A Unified Latent Action World Model15 Dec
  5. 2025WorldVLA: Towards Autoregressive Action World Model26 Jun
  6. 20243D-VLA: A 3D Vision-Language-Action Generative World Model14 Mar

Other references · 22

  1. 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 2,993
  2. 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
  3. 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,297
  4. 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,653
  5. 2024Octo: An Open-Source Generalist Robot Policycited by 1,427
  6. 2025Fine-Tuning Vision-Language-Action Models: Optimizing Speed and Successcited by 844
  7. 2026Cosmos Policy: Fine-Tuning Video Models for Visuomotor Control and Planningcited by 274
  8. 2025Interactive Post-Training for Vision-Language-Action Modelscited by 129
  9. 2025Spatial Forcing: Implicit Spatial Representation Alignment for Vision-language-action Modelcited by 125
  10. 2025GeoVLA: Empowering 3D Representations in Vision-Language-Action Modelscited by 68
  11. 2026ACoT-VLA: Action Chain-of-Thought for Vision-Language-Action Modelscited by 30
  12. 2026StarVLA-α: Reducing Complexity in Vision-Language-Action Systemscited by 27
10 more
  1. 2025GeoAware-VLA: Implicit Geometry Aware Vision-Language-Action Modelcited by 24
  2. 2025SwiftVLA: Unlocking Spatiotemporal Dynamics for Lightweight VLA Models at Minimal Overheadcited by 23
  3. 2025QDepth-VLA: Quantized Depth Prediction as Auxiliary Supervision for Vision-Language-Action Modelscited by 19
  4. 2025StereoVLA: Enhancing Vision-Language-Action Models with Stereo Visioncited by 16
  5. 2025GeoPredict: Leveraging Predictive Kinematics and 3D Gaussian Geometry for Precise VLA Manipulationcited by 15
  6. 2026LaMP: Learning Vision-Language-Action Policy with 3D Scene Flow as Latent Motion Priorcited by 11
  7. 2025VLA-4D: Embedding 4D Awareness into Vision-Language-Action Models for SpatioTemporally Coherent Robotic Manipulationcited by 7
  8. 2026PointACT: Vision-Language-Action Models with Multi-Scale Point-Action Interactioncited by 6
  9. 2026Robotic Manipulation is Vision-to-Geometry Mapping: Vision-Geometry Backbones over Language and Video Modelscited by 3
  10. 2026G3VLA: Geometric inductive bias for Vision-Language-Action Modelscited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026GaussianDream: A Feed-Forward 3D Gaussian World Model for Robotic Manipulation
  2. 2025GWM: Towards Scalable Gaussian World Models for Robotic Manipulation
  3. 2026GaussianWAM: Distilling Geometry and Semantics from 3D Gaussian Fields into World-Action Models
  4. 2026Geometric Action Model for Robot Policy Learning
  5. 2026PhysMani: Physics-principled 3D World Model for Dynamic Object Manipulation
  6. 2026AWM-VLA: AlignedWorld Modeling for Efficient and Explainable Vision-Language-Action Policies
  7. 2025GAF: Gaussian Action Field as a 4D Representation for Dynamic World Modeling in Robotic Manipulation
  8. 2026Intercepting the Future: Latent-Space Predictive World Model for Dynamic VLA Manipulation