GigaBrain-0.5M*: a VLA That Learns From World Model-Based Reinforcement Learning
On the map: World models → Embodied and robot world models
Abstract (arXiv)
Vision-language-action (VLA) models that directly predict multi-step action chunks from current observations face inherent limitations due to constrained scene understanding and weak future anticipation capabilities. In contrast, video world models pre-trained on web-scale video corpora exhibit robust spatiotemporal reasoning and accurate future prediction, making them a natural foundation for enhancing VLA learning. Therefore, we propose textitGigaBrain-0.5M*, a VLA model trained via world model-based reinforcement learning. Built upon textitGigaBrain-0.5, which is pre-trained on over 10,000 hours of robotic manipulation data, whose intermediate version currently ranks first on the international RoboChallenge benchmark. textitGigaBrain-0.5M* further integrates world model-based reinforcement learning via textitRAMP (Reinforcement leArning via world Model-conditioned Policy) to enable robust cross-task adaptation. Empirical results demonstrate that textitRAMP achieves substantial performance gains over the RECAP baseline, yielding improvements of approximately 30% on challenging tasks including textttLaundry Folding, textttBox Packing, and textttEspresso Preparation. Critically, textitGigaBrain-0.5M^* exhibits reliable long-horizon execution, consistently accomplishing complex manipulation tasks without failure as validated by real-world deployment videos on our hrefhttps://gigabrain05m.github.ioproject page.
Key facts. Cited by 23 papers in the map (data through 7 Oct 2026). Placed in Embodied and robot world models, one of 11 directions in World models. Builds on 73 of its 81 references that are in the map. First posted on arXiv 12 Feb 2026.
Builds on
73 of 81 references.
Closest ancestors · 7
Same direction, newest first
- 2025Motus: A Unified Latent Action World Model15 Dec
- 2025GigaWorld-0: World Models as Data Engine to Empower Embodied AI25 Nov
- 2025GigaBrain-0: A World Model-Powered Vision-Language-Action Model22 Oct
- 2025WorldVLA: Towards Autoregressive Action World Model26 Jun
- 2025V-JEPA 2: Self-Supervised Video Models Enable Understanding, Prediction and Planning11 Jun
- 2025DreamGen: Unlocking Generalization in Robot Learning through Video World Models19 May
- 2022BC-Z: Zero-Shot Task Generalization with Robotic Imitation Learning4 Feb
Other references · 66
- 2017Proximal Policy Optimization Algorithmscited by 14,441
- 2022Scalable Diffusion Models with Transformerscited by 5,931
- 2022Flow Matching for Generative Modelingcited by 5,426
- 2025Qwen2.5-VL Technical Reportcited by 5,418
- 2022Flamingo: a Visual Language Model for Few-Shot Learningcited by 4,337
- 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,048
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,297
- 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,653
- 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,597
- 2024Octo: An Open-Source Generalist Robot Policycited by 1,427
38 more
- 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,167
- 2023Kosmos-2: Grounding Multimodal Large Language Models to the Worldcited by 1,075
- 2023Open X-Embodiment: Robotic Learning Datasets and RT-X Modelscited by 849
- 2025Cosmos World Foundation Model Platform for Physical AIcited by 833
- 2024DROID: A Large-Scale In-The-Wild Robot Manipulation Datasetcited by 801
- 2019Advantage-Weighted Regression: Simple and Scalable Off-Policy Reinforcement Learningcited by 750
- 2018QT-Opt: Scalable Deep Reinforcement Learning for Vision-Based Robotic Manipulationcited by 730
- 2024PaliGemma: A versatile 3B VLM for transfercited by 679
- 2024RDT-1B: a Diffusion Foundation Model for Bimanual Manipulationcited by 670
- 2025FAST: Efficient Action Tokenization for Vision-Language-Action Modelscited by 643
- 2023BridgeData V2: A Dataset for Robot Learning at Scalecited by 634
- 2023GAIA-1: A Generative World Model for Autonomous Drivingcited by 618
- 2025SpatialVLA: Exploring Spatial Representations for Visual-Language-Action Modelcited by 502
- 2024CogACT: A Foundational Vision-Language-Action Model for Synergizing Cognition and Action in Robotic Manipulationcited by 411
- 2025AgiBot World Colosseo: A Large-scale Manipulation Platform for Scalable and Intelligent Embodied Systemscited by 390
- 2024Vista: A Generalizable Driving World Model with High Fidelity and Versatile Controllabilitycited by 337
- 2025π*0.6: a VLA That Learns From Experiencecited by 280
- 2022Rectified Flow: A Marginal Preserving Approach to Optimal Transportcited by 277
- 2026Cosmos Policy: Fine-Tuning Video Models for Visuomotor Control and Planningcited by 274
- 2019RoboNet: Large-Scale Multi-Robot Learningcited by 268
- 2023MagicDrive: Street View Generation with Diverse 3D Geometry Controlcited by 250
- 2021Bridge Data: Boosting Generalization of Robotic Skills with Cross-Domain Datasetscited by 248
- 2018HG-DAgger: Interactive Imitation Learning with Human Expertscited by 245
- 2025SmolVLM: Redefining small and efficient multimodal modelscited by 226
- 2024PaliGemma 2: A Family of Versatile VLMs for Transfercited by 204
- 2024DriveDreamer-2: LLM-Enhanced World Models for Diverse Driving Video Generationcited by 186
- 2025GAIA-2: A Controllable Multi-View Generative World Model for Autonomous Drivingcited by 178
- 2025VLA-RL: Towards Masterful and General Robotic Manipulation with Scalable Reinforcement Learningcited by 166
- 2024Mixture-of-Transformers: A Sparse and Scalable Architecture for Multi-Modal Foundation Modelscited by 151
- 2024Scaling Proprioceptive-Visual Learning with Heterogeneous Pre-trained Transformerscited by 145
- 2025Knowledge Insulating Vision-Language-Action Models: Train Fast, Run Fast, Generalize Bettercited by 142
- 2025mimic-video: Video-Action Models for Generalizable Robot Control Beyond VLAscited by 133
- 2025Interactive Post-Training for Vision-Language-Action Modelscited by 129
- 2025Genie Envisioner: A Unified World Foundation Platform for Robotic Manipulationcited by 129
- 2025DriveVLA-W0: World Models Amplify Data Scaling Law in Autonomous Drivingcited by 127
- 2024DriveDreamer4D: World Models Are Effective Data Machines for 4D Driving Scene Representationcited by 123
- 2024Is Sora a World Simulator? A Comprehensive Survey on General World Models and Beyondcited by 111
- 2025GR-3 Technical Reportcited by 110
50 most cited of 66 All 66 (JSON)
Built on by
Citing papers per year: 2026: 23.
23 papers.
Sort:
By area:
- 2026GigaWorld-Policy: An Efficient Action-Centered World--Action Modelcited by 129
- 2026StarVLA: A Lego-like Codebase for Vision-Language-Action Model Developingcited by 103
- 2026SimWorld Studio: Automatic Environment Generation with Evolving Coding Agent for Embodied Agent Learningcited by 13
- 2026World Action Models: A Surveycited by 10
- 2026GigaWorld-Policy-0.5: A Faster and Stronger WAM Empowered by AutoResearchcited by 10
- 2026How Should World Models Be Evaluated for Embodied Decision-Making? A Decision-Making-Centric Positioncited by 9
- 2026RoboWorld: Fast and Reliable Neural Simulators for Generalist Robot Policy Evaluationcited by 4
- 2026NativeMEM: Native Memory Compression for Long-Horizon Robotic Manipulationcited by 4
- 2026Data Pyramid for Embodied Manipulation: A Surveycited by 4
- 2026WCM: A World Critic Model for Vision-Language-Action Reinforcement Learningcited by 4
- 2026Robust Regularized Policy Iteration under Transition Uncertaintycited by 2
- 20263D-Anchored Lookahead Planning for Persistent Robotic Scene Memory via World-Model-Based MCTScited by 2
11 more
- 2026Q-Learning With World Modelscited by 2
- 2026TACO: TActile World Model as a Self-COrrector for Scalable Robot Policy Post-Trainingcited by 1
- 2026ValueFormer: A Causal Transformer Value Function with Stage-Aware Labels for Semi-Autonomous Vision-Language-Action Policiescited by 1
- 2026World Models for Embodied Intelligence: From Plausible to Controllable to Actionablecited by 1
- 2026Scaling World-Model Reinforcement Learning Through Diffusion Policy Optimizationcited by 0
- 2026Vision Language Action (VLA) Models for Unmanned Aerial Robotics and Bimanual Manipulation: A Reviewcited by 0
- 2026RoboInter1.5: A Holistic Intermediate Representation Suite for Embodied World Modeling and Robotic Manipulationcited by 0
- 2026Hydra: A Navigation World Action Model with Discrete Latent Planning and Continuous Flow-Matching Executioncited by 0
- 2026GeomVLA: Unifying Scene, Motion, and Action in 3Dcited by 0
- 2026Imagine-RL: Residual-Confidence-Guided Cross-Attention for World-Model-Augmented VLA Reinforcement Learningcited by 0
- 2026Latent evolving World Action Modelcited by 0
- 2026Latent evolving World Action Model23 Sep 2026
- 2026Imagine-RL: Residual-Confidence-Guided Cross-Attention for World-Model-Augmented VLA Reinforcement Learning21 Sep 2026
- 2026World Models for Embodied Intelligence: From Plausible to Controllable to Actionable15 Sep 2026
- 2026GeomVLA: Unifying Scene, Motion, and Action in 3D12 Sep 2026
- 2026Hydra: A Navigation World Action Model with Discrete Latent Planning and Continuous Flow-Matching Execution29 Aug 2026
- 2026Q-Learning With World Models17 Aug 2026
- 2026ValueFormer: A Causal Transformer Value Function with Stage-Aware Labels for Semi-Autonomous Vision-Language-Action Policies3 Aug 2026
- 2026WCM: A World Critic Model for Vision-Language-Action Reinforcement Learning31 Jul 2026
- 2026Data Pyramid for Embodied Manipulation: A Survey27 Jul 2026
- 2026RoboInter1.5: A Holistic Intermediate Representation Suite for Embodied World Modeling and Robotic Manipulation21 Jul 2026
- 2026GigaWorld-Policy-0.5: A Faster and Stronger WAM Empowered by AutoResearch15 Jul 2026
- 2026Vision Language Action (VLA) Models for Unmanned Aerial Robotics and Bimanual Manipulation: A Review7 Jul 2026
11 more
- 2026NativeMEM: Native Memory Compression for Long-Horizon Robotic Manipulation7 Jul 2026
- 2026TACO: TActile World Model as a Self-COrrector for Scalable Robot Policy Post-Training3 Jul 2026
- 2026RoboWorld: Fast and Reliable Neural Simulators for Generalist Robot Policy Evaluation1 Jul 2026
- 2026World Action Models: A Survey18 Jun 2026
- 2026How Should World Models Be Evaluated for Embodied Decision-Making? A Decision-Making-Centric Position13 Jun 2026
- 2026Scaling World-Model Reinforcement Learning Through Diffusion Policy Optimization25 May 2026
- 2026SimWorld Studio: Automatic Environment Generation with Evolving Coding Agent for Embodied Agent Learning10 May 2026
- 20263D-Anchored Lookahead Planning for Persistent Robotic Scene Memory via World-Model-Based MCTS13 Apr 2026
- 2026StarVLA: A Lego-like Codebase for Vision-Language-Action Model Developing6 Apr 2026
- 2026GigaWorld-Policy: An Efficient Action-Centered World--Action Model18 Mar 2026
- 2026Robust Regularized Policy Iteration under Transition Uncertainty10 Mar 2026
- 2026GigaWorld-Policy: An Efficient Action-Centered World--Action Modelcited by 129
- 2026StarVLA: A Lego-like Codebase for Vision-Language-Action Model Developingcited by 103
- 2026World Action Models: A Surveycited by 10
- 2026GigaWorld-Policy-0.5: A Faster and Stronger WAM Empowered by AutoResearchcited by 10
- 2026How Should World Models Be Evaluated for Embodied Decision-Making? A Decision-Making-Centric Positioncited by 9
- 2026RoboWorld: Fast and Reliable Neural Simulators for Generalist Robot Policy Evaluationcited by 4
- 20263D-Anchored Lookahead Planning for Persistent Robotic Scene Memory via World-Model-Based MCTScited by 2
- 2026Q-Learning With World Modelscited by 2
- 2026TACO: TActile World Model as a Self-COrrector for Scalable Robot Policy Post-Trainingcited by 1
- 2026World Models for Embodied Intelligence: From Plausible to Controllable to Actionablecited by 1
- 2026Scaling World-Model Reinforcement Learning Through Diffusion Policy Optimizationcited by 0
- 2026RoboInter1.5: A Holistic Intermediate Representation Suite for Embodied World Modeling and Robotic Manipulationcited by 0
12 most cited of 15 All 15 (JSON)
- 2026Latent evolving World Action Model23 Sep 2026
- 2026Imagine-RL: Residual-Confidence-Guided Cross-Attention for World-Model-Augmented VLA Reinforcement Learning21 Sep 2026
- 2026World Models for Embodied Intelligence: From Plausible to Controllable to Actionable15 Sep 2026
- 2026Hydra: A Navigation World Action Model with Discrete Latent Planning and Continuous Flow-Matching Execution29 Aug 2026
- 2026Q-Learning With World Models17 Aug 2026
- 2026RoboInter1.5: A Holistic Intermediate Representation Suite for Embodied World Modeling and Robotic Manipulation21 Jul 2026
- 2026GigaWorld-Policy-0.5: A Faster and Stronger WAM Empowered by AutoResearch15 Jul 2026
- 2026TACO: TActile World Model as a Self-COrrector for Scalable Robot Policy Post-Training3 Jul 2026
- 2026RoboWorld: Fast and Reliable Neural Simulators for Generalist Robot Policy Evaluation1 Jul 2026
- 2026World Action Models: A Survey18 Jun 2026
- 2026How Should World Models Be Evaluated for Embodied Decision-Making? A Decision-Making-Centric Position13 Jun 2026
- 2026Scaling World-Model Reinforcement Learning Through Diffusion Policy Optimization25 May 2026
12 newest of 15 All 15 (JSON)
- 2026NativeMEM: Native Memory Compression for Long-Horizon Robotic Manipulationcited by 4
- 2026WCM: A World Critic Model for Vision-Language-Action Reinforcement Learningcited by 4
- 2026ValueFormer: A Causal Transformer Value Function with Stage-Aware Labels for Semi-Autonomous Vision-Language-Action Policiescited by 1
- 2026Vision Language Action (VLA) Models for Unmanned Aerial Robotics and Bimanual Manipulation: A Reviewcited by 0
- 2026GeomVLA: Unifying Scene, Motion, and Action in 3Dcited by 0
- 2026GeomVLA: Unifying Scene, Motion, and Action in 3D12 Sep 2026
- 2026ValueFormer: A Causal Transformer Value Function with Stage-Aware Labels for Semi-Autonomous Vision-Language-Action Policies3 Aug 2026
- 2026WCM: A World Critic Model for Vision-Language-Action Reinforcement Learning31 Jul 2026
- 2026Vision Language Action (VLA) Models for Unmanned Aerial Robotics and Bimanual Manipulation: A Review7 Jul 2026
- 2026NativeMEM: Native Memory Compression for Long-Horizon Robotic Manipulation7 Jul 2026
- 2026Data Pyramid for Embodied Manipulation: A Surveycited by 4
- 2026Data Pyramid for Embodied Manipulation: A Survey27 Jul 2026
Similar, not cited
Close in wording, no citation either way
- 2026Towards Practical World Model-based Reinforcement Learning for Vision-Language-Action Models
- 2025WMPO: World Model-based Policy Optimization for Vision-Language-Action Models
- 2025SimpleVLA-RL: Scaling VLA Training via Reinforcement Learning
- 2025RynnVLA-002: A Unified Vision-Language-Action and World Model
- 2025VLA-RFT: Vision-Language-Action Reinforcement Fine-tuning with Verified Rewards in World Simulators
- 2025Reinforcing Action Policies by Prophesying
- 2026Do World Action Models Generalize Better than VLAs? A Robustness Study
- 2026Prioritized Rollouts for Efficient World Model-based Vision-Language-Action Policy Optimization