mlsanityData to 14 Oct 2026

GE-Act 2.0: Pretraining and Scaling a World-Action Model for Robotic Manipulation

arXiv 2609.05588 ↗First posted 4 Sep 2026cs.RO cs.CVcited by 5

On the map: World models → Embodied and robot world models

Abstract (arXiv)

World-action models (WAM) predict future states to guide robot actions, enabling learning from both action-free video and action-labeled interaction. Most inherit pretrained video generators, leaving WAM pretraining and scaling underexplored. We introduce Genie Envisioner Act 2.0 (GE-Act 2.0), a world-action model whose trainable generative and action components are all initialized from scratch on manipulation data. It combines a control-oriented autoencoder (CoAE), a single-step visual planner (SVP), and an inverse dynamics model (IDM). CoAE retains action- and instruction-relevant information under aggressive compression, while SVP produces a complete future state in one differentiable pass, so visual planning and inverse dynamics can be pretrained separately on complementary data. The components are then jointly trained with knowledge-aligned selective optimization (KASO), which reduces mismatched supervision by selecting only predicted futures judged behaviorally compatible with the recorded action. We evaluate pretrained checkpoints directly, without per-task fine-tuning, on 100 tasks across 20 manipulation skill groups with held-out scenes, backgrounds, lighting, and object instances. Scaling co-training data from 300 to 30,000 hours raises success from 17.1% to 44.1% on G1-OP and from 13.4% to 31.1% on G2-90D; despite comprising less than 2% of the co-training data, G2-90D improves by 17.7 points, suggesting cross-embodiment transfer. Gains span 19/20 and 18/20 skill groups, and skill-specific coverage strongly correlates with zero-shot out-of-distribution (OOD) success (Pearson r=0.80; Spearman rho=0.85). Under the same protocol, the model grounds object, color, shape, and position references in at least 90% of trials and follows explicit instructions even when they conflict with an already-committed behavior or a conventional scene association.

Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Placed in Embodied and robot world models, one of 11 directions in World models. Builds on 68 of its 76 references that are in the map. First posted on arXiv 4 Sep 2026.

Builds on

68 of 76 references.

Closest ancestors · 14

Same direction, newest first

  1. 2026ABot-M0.5: Unified Mobility-and-Manipulation World Action Model1 Jul
  2. 2026τ0-WM: A Unified Video-Action World Model for Robotic Manipulation31 May
  3. 2026World Action Models: The Next Frontier in Embodied AI12 May
  4. 2026Motubrain: An Advanced World Action Model for Robot Control30 Apr
  5. 2026StarVLA: A Lego-like Codebase for Vision-Language-Action Model Developing6 Apr
  6. 2026GigaWorld-Policy: An Efficient Action-Centered World--Action Model18 Mar
  7. 2026World Action Models are Zero-shot Policies17 Feb
  8. 2026Causal World Modeling for Robot Control29 Jan
  9. 2025Act2Goal: From World Model To General Goal-conditioned Policy29 Dec
  10. 2025Ctrl-World: A Controllable Generative World Model for Robot Manipulation11 Oct
  11. 2025DreamGen: Unlocking Generalization in Robot Learning through Video World Models19 May
  12. 2025EnerVerse: Envisioning Embodied Future Space for Robotics Manipulation3 Jan
2 more
  1. 2024IGOR: Image-GOal Representations are the Atomic Control Units for Foundation Models in Embodied AI17 Oct
  2. 2024IRASim: A Fine-Grained World Model for Robot Manipulation20 Jun

Other references · 54

  1. 2022Flow Matching for Generative Modelingcited by 5,702
  2. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
  3. 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,109
  4. 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,887
  5. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
  6. 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,407
  7. 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,061
  8. 2023Consistency Modelscited by 1,822
  9. 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,761
  10. 2019Dream to Control: Learning Behaviors by Latent Imaginationcited by 1,653
  11. 2024Octo: An Open-Source Generalist Robot Policycited by 1,484
  12. 2025DINOv3cited by 1,414
38 more
  1. 2018Learning Latent Dynamics for Planning from Pixelscited by 1,264
  2. 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,225
  3. 2025SigLIP 2: Multilingual Vision-Language Encoders with Improved Semantic Understanding, Localization, and Dense Featurescited by 1,188
  4. 2023One-step Diffusion with Distribution Matching Distillationcited by 1,019
  5. 2025Cosmos World Foundation Model Platform for Physical AIcited by 864
  6. 2023Latent Consistency Models: Synthesizing High-Resolution Images with Few-Step Inferencecited by 846
  7. 2024Show-o: One Single Transformer to Unify Multimodal Understanding and Generationcited by 752
  8. 2024Genie: Generative Interactive Environmentscited by 747
  9. 2024Representation Alignment for Generation: Training Diffusion Transformers Is Easier Than You Thinkcited by 703
  10. 2024LTX-Video: Realtime Video Latent Diffusioncited by 581
  11. 2025Mean Flows for One-step Generative Modelingcited by 561
  12. 2025RoboTwin 2.0: A Scalable Data Generator and Benchmark with Strong Domain Randomization for Robust Bimanual Robotic Manipulationcited by 518
  13. 2023Consistency Trajectory Models: Learning Probability Flow ODE Trajectory of Diffusioncited by 459
  14. 2024Janus: Decoupling Visual Encoding for Unified Multimodal Understanding and Generationcited by 457
  15. 2023InstaFlow: One Step is Enough for High-Quality Diffusion-Based Text-to-Image Generationcited by 395
  16. 2025Reconstruction vs. Generation: Taming Optimization Dilemma in Latent Diffusion Modelscited by 393
  17. 2024One Step Diffusion via Shortcut Modelscited by 391
  18. 2023Unleashing Large-Scale Video Generative Pre-training for Visual Robot Manipulationcited by 364
  19. 2024Latent Action Pretraining from Videoscited by 321
  20. 2025LIBERO-Plus: In-depth Robustness Analysis of Vision-Language-Action Modelscited by 303
  21. 2024GR-2: A Generative Video-Language-Action Model with Web-Scale Knowledge for Robot Manipulationcited by 296
  22. 2024Video Prediction Policy: A Generalist Robot Policy with Predictive Visual Representationscited by 289
  23. 2024Deep Compression Autoencoder for Efficient High-Resolution Diffusion Modelscited by 217
  24. 2023Any-point Trajectory Modeling for Policy Learningcited by 215
  25. 2025Diffusion Adversarial Post-Training for One-Step Video Generationcited by 151
  26. 2025Knowledge Insulating Vision-Language-Action Models: Train Fast, Run Fast, Generalize Bettercited by 146
  27. 2025Genie Envisioner: A Unified World Foundation Platform for Robotic Manipulationcited by 137
  28. 2026V-JEPA 2.1: Unlocking Dense Features in Video Self-Supervised Learningcited by 117
  29. 2025Improved Mean Flows: On the Challenges of Fastforward Generative Modelscited by 110
  30. 2026WorldArena: A Unified Benchmark for Evaluating Perception and Functional Utility of Embodied World Modelscited by 76
  31. 2022Progressive Distillation for Fast Sampling of Diffusion Modelscited by 69
  32. 2024Moto: Latent Motion Token as the Bridging Language for Learning Robot Manipulation from Videoscited by 69
  33. 2026Qwen-RobotManip Technical Report: Alignment Unlocks Scale for Robotic Manipulation Foundation Modelscited by 50
  34. 2025EnerVerse-AC: Envisioning Embodied Environments with Action Conditioncited by 42
  35. 2026Native Video-Action Pretraining for Generalizable Robot Controlcited by 36
  36. 2026ACoT-VLA: Action Chain-of-Thought for Vision-Language-Action Modelscited by 33
  37. 2025Towards Scalable Pre-training of Visual Tokenizers for Generationcited by 28
  38. 2026From Foundation to Application: Improving VLA Models in Practicecited by 26

50 most cited of 54 All 54 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 5.

5 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026World Models for Robotic Manipulation: A Survey
  2. 2026InternW0-Δ: A World Action Model Bridging Predictive Dynamics and Actions with 20K+ Hours of Open Data
  3. 2026DELE-w0.5: Inferring Action from Future Latent State for Robotic Manipulation
  4. 2026Say, Dream, and Act: Learning Video World Models for Instruction-Driven Robot Manipulation
  5. 2026Direct Experience World-Model Optimization: Learning the World Beyond Action Imitation
  6. 2024Predictive Inverse Dynamics Models are Scalable Learners for Robotic Manipulation
  7. 2026HarmoWAM: Harmonizing Generalizable and Precise Manipulation via Adaptive World Action Models
  8. 2026Rethinking World-Action Model for Compositional and In-Context Robotic Manipulation