GE-Act 2.0: Pretraining and Scaling a World-Action Model for Robotic Manipulation
On the map: World models → Embodied and robot world models
Abstract (arXiv)
World-action models (WAM) predict future states to guide robot actions, enabling learning from both action-free video and action-labeled interaction. Most inherit pretrained video generators, leaving WAM pretraining and scaling underexplored. We introduce Genie Envisioner Act 2.0 (GE-Act 2.0), a world-action model whose trainable generative and action components are all initialized from scratch on manipulation data. It combines a control-oriented autoencoder (CoAE), a single-step visual planner (SVP), and an inverse dynamics model (IDM). CoAE retains action- and instruction-relevant information under aggressive compression, while SVP produces a complete future state in one differentiable pass, so visual planning and inverse dynamics can be pretrained separately on complementary data. The components are then jointly trained with knowledge-aligned selective optimization (KASO), which reduces mismatched supervision by selecting only predicted futures judged behaviorally compatible with the recorded action. We evaluate pretrained checkpoints directly, without per-task fine-tuning, on 100 tasks across 20 manipulation skill groups with held-out scenes, backgrounds, lighting, and object instances. Scaling co-training data from 300 to 30,000 hours raises success from 17.1% to 44.1% on G1-OP and from 13.4% to 31.1% on G2-90D; despite comprising less than 2% of the co-training data, G2-90D improves by 17.7 points, suggesting cross-embodiment transfer. Gains span 19/20 and 18/20 skill groups, and skill-specific coverage strongly correlates with zero-shot out-of-distribution (OOD) success (Pearson r=0.80; Spearman rho=0.85). Under the same protocol, the model grounds object, color, shape, and position references in at least 90% of trials and follows explicit instructions even when they conflict with an already-committed behavior or a conventional scene association.
Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Placed in Embodied and robot world models, one of 11 directions in World models. Builds on 68 of its 76 references that are in the map. First posted on arXiv 4 Sep 2026.
Builds on
68 of 76 references.
Closest ancestors · 14
Same direction, newest first
- 2026ABot-M0.5: Unified Mobility-and-Manipulation World Action Model1 Jul
- 2026τ0-WM: A Unified Video-Action World Model for Robotic Manipulation31 May
- 2026World Action Models: The Next Frontier in Embodied AI12 May
- 2026Motubrain: An Advanced World Action Model for Robot Control30 Apr
- 2026StarVLA: A Lego-like Codebase for Vision-Language-Action Model Developing6 Apr
- 2026GigaWorld-Policy: An Efficient Action-Centered World--Action Model18 Mar
- 2026World Action Models are Zero-shot Policies17 Feb
- 2026Causal World Modeling for Robot Control29 Jan
- 2025Act2Goal: From World Model To General Goal-conditioned Policy29 Dec
- 2025Ctrl-World: A Controllable Generative World Model for Robot Manipulation11 Oct
- 2025DreamGen: Unlocking Generalization in Robot Learning through Video World Models19 May
- 2025EnerVerse: Envisioning Embodied Future Space for Robotics Manipulation3 Jan
2 more
Other references · 54
- 2022Flow Matching for Generative Modelingcited by 5,702
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
- 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,109
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,887
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,407
- 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,061
- 2023Consistency Modelscited by 1,822
- 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,761
- 2019Dream to Control: Learning Behaviors by Latent Imaginationcited by 1,653
- 2024Octo: An Open-Source Generalist Robot Policycited by 1,484
- 2025DINOv3cited by 1,414
38 more
- 2018Learning Latent Dynamics for Planning from Pixelscited by 1,264
- 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,225
- 2025SigLIP 2: Multilingual Vision-Language Encoders with Improved Semantic Understanding, Localization, and Dense Featurescited by 1,188
- 2023One-step Diffusion with Distribution Matching Distillationcited by 1,019
- 2025Cosmos World Foundation Model Platform for Physical AIcited by 864
- 2023Latent Consistency Models: Synthesizing High-Resolution Images with Few-Step Inferencecited by 846
- 2024Show-o: One Single Transformer to Unify Multimodal Understanding and Generationcited by 752
- 2024Genie: Generative Interactive Environmentscited by 747
- 2024Representation Alignment for Generation: Training Diffusion Transformers Is Easier Than You Thinkcited by 703
- 2024LTX-Video: Realtime Video Latent Diffusioncited by 581
- 2025Mean Flows for One-step Generative Modelingcited by 561
- 2025RoboTwin 2.0: A Scalable Data Generator and Benchmark with Strong Domain Randomization for Robust Bimanual Robotic Manipulationcited by 518
- 2023Consistency Trajectory Models: Learning Probability Flow ODE Trajectory of Diffusioncited by 459
- 2024Janus: Decoupling Visual Encoding for Unified Multimodal Understanding and Generationcited by 457
- 2023InstaFlow: One Step is Enough for High-Quality Diffusion-Based Text-to-Image Generationcited by 395
- 2025Reconstruction vs. Generation: Taming Optimization Dilemma in Latent Diffusion Modelscited by 393
- 2024One Step Diffusion via Shortcut Modelscited by 391
- 2023Unleashing Large-Scale Video Generative Pre-training for Visual Robot Manipulationcited by 364
- 2024Latent Action Pretraining from Videoscited by 321
- 2025LIBERO-Plus: In-depth Robustness Analysis of Vision-Language-Action Modelscited by 303
- 2024GR-2: A Generative Video-Language-Action Model with Web-Scale Knowledge for Robot Manipulationcited by 296
- 2024Video Prediction Policy: A Generalist Robot Policy with Predictive Visual Representationscited by 289
- 2024Deep Compression Autoencoder for Efficient High-Resolution Diffusion Modelscited by 217
- 2023Any-point Trajectory Modeling for Policy Learningcited by 215
- 2025Diffusion Adversarial Post-Training for One-Step Video Generationcited by 151
- 2025Knowledge Insulating Vision-Language-Action Models: Train Fast, Run Fast, Generalize Bettercited by 146
- 2025Genie Envisioner: A Unified World Foundation Platform for Robotic Manipulationcited by 137
- 2026V-JEPA 2.1: Unlocking Dense Features in Video Self-Supervised Learningcited by 117
- 2025Improved Mean Flows: On the Challenges of Fastforward Generative Modelscited by 110
- 2026WorldArena: A Unified Benchmark for Evaluating Perception and Functional Utility of Embodied World Modelscited by 76
- 2022Progressive Distillation for Fast Sampling of Diffusion Modelscited by 69
- 2024Moto: Latent Motion Token as the Bridging Language for Learning Robot Manipulation from Videoscited by 69
- 2026Qwen-RobotManip Technical Report: Alignment Unlocks Scale for Robotic Manipulation Foundation Modelscited by 50
- 2025EnerVerse-AC: Envisioning Embodied Environments with Action Conditioncited by 42
- 2026Native Video-Action Pretraining for Generalizable Robot Controlcited by 36
- 2026ACoT-VLA: Action Chain-of-Thought for Vision-Language-Action Modelscited by 33
- 2025Towards Scalable Pre-training of Visual Tokenizers for Generationcited by 28
- 2026From Foundation to Application: Improving VLA Models in Practicecited by 26
50 most cited of 54 All 54 (JSON)
Built on by
Citing papers per year: 2026: 5.
5 papers.
- 2026HappyWorld-Benchcited by 0
- 2026Quantile Head for Vision-Language-Action Modelscited by 0
- 2026WAM-OPD: Sharpening World Action Models via On-Policy Distillationcited by 0
- 2026OpenWAM: An Open Framework for Composable World-Action Modelscited by 0
- 2026Video Prediction Policy 2: Predict Better, Act Bettercited by 0
- 2026Video Prediction Policy 2: Predict Better, Act Better7 Oct 2026
- 2026OpenWAM: An Open Framework for Composable World-Action Models6 Oct 2026
- 2026WAM-OPD: Sharpening World Action Models via On-Policy Distillation28 Sep 2026
- 2026Quantile Head for Vision-Language-Action Models28 Sep 2026
- 2026HappyWorld-Bench21 Sep 2026
Similar, not cited
Close in wording, no citation either way
- 2026World Models for Robotic Manipulation: A Survey
- 2026InternW0-Δ: A World Action Model Bridging Predictive Dynamics and Actions with 20K+ Hours of Open Data
- 2026DELE-w0.5: Inferring Action from Future Latent State for Robotic Manipulation
- 2026Say, Dream, and Act: Learning Video World Models for Instruction-Driven Robot Manipulation
- 2026Direct Experience World-Model Optimization: Learning the World Beyond Action Imitation
- 2024Predictive Inverse Dynamics Models are Scalable Learners for Robotic Manipulation
- 2026HarmoWAM: Harmonizing Generalizable and Precise Manipulation via Adaptive World Action Models
- 2026Rethinking World-Action Model for Compositional and In-Context Robotic Manipulation