G0.5: One Autoregressive Stream for Robot Reasoning and Action
On the map: Vision-language-action models → Reasoning and chain-of-thought in VLA
also in 1 more
Abstract (arXiv)
The prevailing recipe for Vision-Language-Action (VLA) models couples a pretrained VLM with a separately trained flow-matching action expert. This makes the VLM a context encoder rather than a decision-maker. We introduce G0.5, a pretrained autoregressive VLA in which a single transformer decoder emits reasoning and action tokens under a single objective. Three components make this tractable at foundation-model scale: a learnable cross-embodiment action tokenizer that maps heterogeneous robot actions into a shared vocabulary; a native chain-of-thought stream interleaving task decomposition, object grounding, and action hints with action tokens; and a visual memory module that injects multi-second history through the vision encoder. Because reasoning and action share a single set of weights, the pretrained VLM's capabilities carry over to physical behavior: the model follows instructions closely, and prompts directly steer action granularity, task horizon, and out-of-distribution scene handling without further training. Pretrained on a large collection of robot datasets together with VQA samples, G0.5 surpasses state-of-the-art models across 7 independent regimes: real-world fine-tuning on R1lite and R1pro robots (76.7% vs. 53.3% for π0.5 and 24.4% for GR00T-N1.7), the 2025 BEHAVIOR Challenge on 50 long-horizon household mobile manipulation tasks using a generalist policy (31.4% vs. 26.3% for π0.5 and 26.1% for the challenge winner), DROID post-training followed by zero-shot transfer to an unseen environment and objects (82.5%), a language-following Pick-and-Place benchmark, LIBERO (98.9%), RoboTwin 2.0 (93.3%), and SimplerEnv-Bridge (87.3%).
Key facts. Cited by 17 papers in the map (data through 7 Oct 2026). Placed in Reasoning and chain-of-thought in VLA, one of 13 directions in Vision-language-action models. Builds on 49 of its 57 references that are in the map. First posted on arXiv 12 Aug 2026.
Builds on
49 of 57 references.
Closest ancestors · 6
Same direction, newest first
- 2026DualCoT-VLA: Visual-Linguistic Chain of Thought via Parallel Reasoning for Vision-Language-Action Models23 Mar
- 2026MEM: Multi-Scale Embodied Memory for Vision Language Action Models4 Mar
- 2026HALO: A Unified Vision-Language-Action Model for Embodied Multimodal Chain-of-Thought Reasoning24 Feb
- 2025FlowVLA: Visual Chain of Thought-based Motion Reasoning for Vision-Language-Action Models25 Aug
- 2025CoT-VLA: Visual Chain-of-Thought Reasoning for Vision-Language-Action Models27 Mar
- 2024Robotic Control via Embodied Chain-of-Thought Reasoning11 Jul
Other references · 43
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 2,993
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,297
- 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,653
- 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,338
- 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,167
- 2025Fine-Tuning Vision-Language-Action Models: Optimizing Speed and Successcited by 844
- 2024DROID: A Large-Scale In-The-Wild Robot Manipulation Datasetcited by 801
- 2025FAST: Efficient Action Tokenization for Vision-Language-Action Modelscited by 643
- 2023BridgeData V2: A Dataset for Robot Learning at Scalecited by 634
- 2025SmolVLA: A Vision-Language-Action Model for Affordable and Efficient Roboticscited by 507
31 more
- 2025SpatialVLA: Exploring Spatial Representations for Visual-Language-Action Modelcited by 502
- 2024Evaluating Real-World Robot Manipulation Policies in Simulationcited by 484
- 2026Fast-WAM: Do World Action Models Need Test-time Future Imagination?cited by 311
- 2024TraceVLA: Visual Trace Prompting Enhances Spatial-Temporal Awareness for Generalist Robotic Policiescited by 298
- 2026Causal World Modeling for Robot Controlcited by 289
- 2026Cosmos Policy: Fine-Tuning Video Models for Visuomotor Control and Planningcited by 274
- 2024RoboPoint: A Vision-Language Model for Spatial Affordance Prediction for Roboticscited by 242
- 2025Motus: A Unified Latent Action World Modelcited by 231
- 2024Behavior Generation with Latent Actionscited by 159
- 2025Knowledge Insulating Vision-Language-Action Models: Train Fast, Run Fast, Generalize Bettercited by 142
- 2025RoboBrain: A Unified Brain Model for Robotic Manipulation from Abstract to Concretecited by 134
- 2026π0.7: a Steerable Generalist Robotic Foundation Model with Emergent Capabilitiescited by 127
- 2025HAMSTER: Hierarchical Action Models For Open-World Robot Manipulationcited by 125
- 2026StarVLA: A Lego-like Codebase for Vision-Language-Action Model Developingcited by 103
- 2026A Pragmatic VLA Foundation Modelcited by 97
- 2025InternVLA-M1: A Spatially Guided Vision-Language-Action Framework for Generalist Robot Policycited by 83
- 2025VQ-VLA: Improving Vision-Language-Action Models via Scaling Vector-Quantized Action Tokenizerscited by 67
- 2026Being-H0.5: Scaling Human-Centric Robot Learning for Cross-Embodiment Generalizationcited by 61
- 2025Igniting VLMs toward the Embodied Spacecited by 53
- 2025RLinf: Flexible and Efficient Large-scale Reinforcement Learning via Macro-to-Micro Flow Transformationcited by 51
- 2025VLA-0: Building State-of-the-Art VLAs with Zero Modificationcited by 49
- 2024Emma-X: An Embodied Multimodal Action Model with Grounded Chain of Thought and Look-ahead Spatial Reasoningcited by 45
- 2026Xiaomi-Robotics-0: An Open-Sourced Vision-Language-Action Model with Real-Time Executioncited by 42
- 2026Qwen-VLA: Unifying Vision-Language-Action Modeling across Tasks, Environments, and Robot Embodimentscited by 42
- 2025EO-1: An Open Unified Embodied Foundation Model for General Robot Controlcited by 30
- 2025BEAST: Efficient Tokenization of B-Splines Encoded Action Sequences for Imitation Learningcited by 25
- 2026ActionCodec: What Makes for Good Action Tokenizerscited by 17
- 2025Task adaptation of Vision-Language-Action model: 1st Place Solution for the 2025 BEHAVIOR Challengecited by 13
- 2026HEX: Humanoid-Aligned Experts for Cross-Embodiment Whole-Body Manipulationcited by 10
- 2025Openpi Comet: Competition Solution For 2025 BEHAVIOR Challengecited by 8
- 2026Green-VLA: Staged Vision-Language-Action Model for Generalist Robotscited by 6
Built on by
Citing papers per year: 2026: 17.
17 papers.
Sort:
By area:
- 2026Beyond Data Scaling: Representation-Centric Continued Pre-training for Vision-Language-Action Modelscited by 5
- 2026Riemann-1.0: An Embodied World Action Model for Physical AIcited by 2
- 2026MoPA: Coordinated Mobile Manipulation via Subsystem-Specific Perception Alignmentcited by 1
- 2026MachEmbodied-U0: Unified Understanding and Generation Model for Embodied Intelligencecited by 1
- 2026InternW0-Δ: A World Action Model Bridging Predictive Dynamics and Actions with 20K+ Hours of Open Datacited by 1
- 2026CSWAM: Better Causal Semantic Representations for Out-of-Distribution Generalization in World Action Modelscited by 0
- 2026SkelWAM: A Skeleton-Guided World-Action Model for Zero-Shot Cross-Embodiment Manipulationcited by 0
- 2026ForceRFT: Refining VLA Actions through Force-Guided Residual Reinforcement Learningcited by 0
- 2026An Action Is Worth One Patch: Unified World-Action Modeling with PatchWAMcited by 0
- 2026Devol-ONE: One Autoregressive Mixture of Transformers to Unify Vision-Language-Action and Latent World Modelingcited by 0
- 2026Copper-Policy: Focus on the Representation for Robust Robot Manipulationcited by 0
- 2026RoboICL: Embodied In-Context Learning with GPT-6 Astracited by 0
5 more
- 2026Humanoid Loco-Manipulation With Discrete VLA Modelcited by 0
- 2026CogWAM: Aligning Semantic Cognition with World Action Modeling via Event-Driven Interfacescited by 0
- 2026Magic-W0: A Structured World-Action Foundation Model for Physical Intelligencecited by 0
- 2026UniWAM: Unified World-Action Modelcited by 0
- 2026Embodied Turing Machines: Stateful Code for Robot Recursive Self-Improvementcited by 0
- 2026Embodied Turing Machines: Stateful Code for Robot Recursive Self-Improvement8 Oct 2026
- 2026UniWAM: Unified World-Action Model1 Oct 2026
- 2026Magic-W0: A Structured World-Action Foundation Model for Physical Intelligence30 Sep 2026
- 2026CogWAM: Aligning Semantic Cognition with World Action Modeling via Event-Driven Interfaces29 Sep 2026
- 2026Humanoid Loco-Manipulation With Discrete VLA Model28 Sep 2026
- 2026RoboICL: Embodied In-Context Learning with GPT-6 Astra28 Sep 2026
- 2026Copper-Policy: Focus on the Representation for Robust Robot Manipulation26 Sep 2026
- 2026Devol-ONE: One Autoregressive Mixture of Transformers to Unify Vision-Language-Action and Latent World Modeling26 Sep 2026
- 2026InternW0-Δ: A World Action Model Bridging Predictive Dynamics and Actions with 20K+ Hours of Open Data25 Sep 2026
- 2026An Action Is Worth One Patch: Unified World-Action Modeling with PatchWAM22 Sep 2026
- 2026MachEmbodied-U0: Unified Understanding and Generation Model for Embodied Intelligence22 Sep 2026
- 2026ForceRFT: Refining VLA Actions through Force-Guided Residual Reinforcement Learning19 Sep 2026
5 more
- 2026SkelWAM: A Skeleton-Guided World-Action Model for Zero-Shot Cross-Embodiment Manipulation18 Sep 2026
- 2026CSWAM: Better Causal Semantic Representations for Out-of-Distribution Generalization in World Action Models16 Sep 2026
- 2026MoPA: Coordinated Mobile Manipulation via Subsystem-Specific Perception Alignment10 Sep 2026
- 2026Beyond Data Scaling: Representation-Centric Continued Pre-training for Vision-Language-Action Models27 Aug 2026
- 2026Riemann-1.0: An Embodied World Action Model for Physical AI27 Aug 2026
- 2026Riemann-1.0: An Embodied World Action Model for Physical AIcited by 2
- 2026InternW0-Δ: A World Action Model Bridging Predictive Dynamics and Actions with 20K+ Hours of Open Datacited by 1
- 2026CSWAM: Better Causal Semantic Representations for Out-of-Distribution Generalization in World Action Modelscited by 0
- 2026SkelWAM: A Skeleton-Guided World-Action Model for Zero-Shot Cross-Embodiment Manipulationcited by 0
- 2026An Action Is Worth One Patch: Unified World-Action Modeling with PatchWAMcited by 0
- 2026Devol-ONE: One Autoregressive Mixture of Transformers to Unify Vision-Language-Action and Latent World Modelingcited by 0
- 2026Copper-Policy: Focus on the Representation for Robust Robot Manipulationcited by 0
- 2026CogWAM: Aligning Semantic Cognition with World Action Modeling via Event-Driven Interfacescited by 0
- 2026Magic-W0: A Structured World-Action Foundation Model for Physical Intelligencecited by 0
- 2026UniWAM: Unified World-Action Modelcited by 0
- 2026UniWAM: Unified World-Action Model1 Oct 2026
- 2026Magic-W0: A Structured World-Action Foundation Model for Physical Intelligence30 Sep 2026
- 2026CogWAM: Aligning Semantic Cognition with World Action Modeling via Event-Driven Interfaces29 Sep 2026
- 2026Copper-Policy: Focus on the Representation for Robust Robot Manipulation26 Sep 2026
- 2026Devol-ONE: One Autoregressive Mixture of Transformers to Unify Vision-Language-Action and Latent World Modeling26 Sep 2026
- 2026InternW0-Δ: A World Action Model Bridging Predictive Dynamics and Actions with 20K+ Hours of Open Data25 Sep 2026
- 2026An Action Is Worth One Patch: Unified World-Action Modeling with PatchWAM22 Sep 2026
- 2026SkelWAM: A Skeleton-Guided World-Action Model for Zero-Shot Cross-Embodiment Manipulation18 Sep 2026
- 2026CSWAM: Better Causal Semantic Representations for Out-of-Distribution Generalization in World Action Models16 Sep 2026
- 2026Riemann-1.0: An Embodied World Action Model for Physical AI27 Aug 2026
- 2026RoboICL: Embodied In-Context Learning with GPT-6 Astracited by 0
- 2026RoboICL: Embodied In-Context Learning with GPT-6 Astra28 Sep 2026
Similar, not cited
Close in wording, no citation either way
- 2025FASTer: Toward Efficient Autoregressive Vision Language Action Modeling via Neural Action Tokenization
- 2026Two Bridges, One Pathway: From VLMs to Generalizable VLAs with Embodied Trajectory-Coupled Data
- 2026AR-VLA: True Autoregressive Action Expert for Vision-Language-Action Models
- 2025Do What You Say: Steering Vision-Language-Action Models via Runtime Reasoning-Action Alignment Verification
- 2026CLAP: Direct VLM-to-VLA Adaptation via Language-Action Grounding
- 2026CoRE-VLA: Towards Scalable and Robust Vision-Language-Action Modeling via Conditional Routing of Experts
- 2026VLAFlow: A Unified Training Framework for Vision-Language-Action Models via Co-training and Future Latent Alignment
- 2026Vision-Language-Action in Robotics: A Survey of Datasets, Benchmarks, and Data Engines