mlsanityData to 7 Oct 2026

G0.5: One Autoregressive Stream for Robot Reasoning and Action

arXiv 2608.11739 ↗First posted 12 Aug 2026cs.RO cs.AIcited by 17

On the map: Vision-language-action models → Reasoning and chain-of-thought in VLA

also in 1 more
Abstract (arXiv)

The prevailing recipe for Vision-Language-Action (VLA) models couples a pretrained VLM with a separately trained flow-matching action expert. This makes the VLM a context encoder rather than a decision-maker. We introduce G0.5, a pretrained autoregressive VLA in which a single transformer decoder emits reasoning and action tokens under a single objective. Three components make this tractable at foundation-model scale: a learnable cross-embodiment action tokenizer that maps heterogeneous robot actions into a shared vocabulary; a native chain-of-thought stream interleaving task decomposition, object grounding, and action hints with action tokens; and a visual memory module that injects multi-second history through the vision encoder. Because reasoning and action share a single set of weights, the pretrained VLM's capabilities carry over to physical behavior: the model follows instructions closely, and prompts directly steer action granularity, task horizon, and out-of-distribution scene handling without further training. Pretrained on a large collection of robot datasets together with VQA samples, G0.5 surpasses state-of-the-art models across 7 independent regimes: real-world fine-tuning on R1lite and R1pro robots (76.7% vs. 53.3% for π0.5 and 24.4% for GR00T-N1.7), the 2025 BEHAVIOR Challenge on 50 long-horizon household mobile manipulation tasks using a generalist policy (31.4% vs. 26.3% for π0.5 and 26.1% for the challenge winner), DROID post-training followed by zero-shot transfer to an unseen environment and objects (82.5%), a language-following Pick-and-Place benchmark, LIBERO (98.9%), RoboTwin 2.0 (93.3%), and SimplerEnv-Bridge (87.3%).

Key facts. Cited by 17 papers in the map (data through 7 Oct 2026). Placed in Reasoning and chain-of-thought in VLA, one of 13 directions in Vision-language-action models. Builds on 49 of its 57 references that are in the map. First posted on arXiv 12 Aug 2026.

Builds on

49 of 57 references.

Closest ancestors · 6

Same direction, newest first

  1. 2026DualCoT-VLA: Visual-Linguistic Chain of Thought via Parallel Reasoning for Vision-Language-Action Models23 Mar
  2. 2026MEM: Multi-Scale Embodied Memory for Vision Language Action Models4 Mar
  3. 2026HALO: A Unified Vision-Language-Action Model for Embodied Multimodal Chain-of-Thought Reasoning24 Feb
  4. 2025FlowVLA: Visual Chain of Thought-based Motion Reasoning for Vision-Language-Action Models25 Aug
  5. 2025CoT-VLA: Visual Chain-of-Thought Reasoning for Vision-Language-Action Models27 Mar
  6. 2024Robotic Control via Embodied Chain-of-Thought Reasoning11 Jul

Other references · 43

  1. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
  2. 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 2,993
  3. 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
  4. 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,297
  5. 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,653
  6. 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,338
  7. 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,167
  8. 2025Fine-Tuning Vision-Language-Action Models: Optimizing Speed and Successcited by 844
  9. 2024DROID: A Large-Scale In-The-Wild Robot Manipulation Datasetcited by 801
  10. 2025FAST: Efficient Action Tokenization for Vision-Language-Action Modelscited by 643
  11. 2023BridgeData V2: A Dataset for Robot Learning at Scalecited by 634
  12. 2025SmolVLA: A Vision-Language-Action Model for Affordable and Efficient Roboticscited by 507
31 more
  1. 2025SpatialVLA: Exploring Spatial Representations for Visual-Language-Action Modelcited by 502
  2. 2024Evaluating Real-World Robot Manipulation Policies in Simulationcited by 484
  3. 2026Fast-WAM: Do World Action Models Need Test-time Future Imagination?cited by 311
  4. 2024TraceVLA: Visual Trace Prompting Enhances Spatial-Temporal Awareness for Generalist Robotic Policiescited by 298
  5. 2026Causal World Modeling for Robot Controlcited by 289
  6. 2026Cosmos Policy: Fine-Tuning Video Models for Visuomotor Control and Planningcited by 274
  7. 2024RoboPoint: A Vision-Language Model for Spatial Affordance Prediction for Roboticscited by 242
  8. 2025Motus: A Unified Latent Action World Modelcited by 231
  9. 2024Behavior Generation with Latent Actionscited by 159
  10. 2025Knowledge Insulating Vision-Language-Action Models: Train Fast, Run Fast, Generalize Bettercited by 142
  11. 2025RoboBrain: A Unified Brain Model for Robotic Manipulation from Abstract to Concretecited by 134
  12. 2026π0.7: a Steerable Generalist Robotic Foundation Model with Emergent Capabilitiescited by 127
  13. 2025HAMSTER: Hierarchical Action Models For Open-World Robot Manipulationcited by 125
  14. 2026StarVLA: A Lego-like Codebase for Vision-Language-Action Model Developingcited by 103
  15. 2026A Pragmatic VLA Foundation Modelcited by 97
  16. 2025InternVLA-M1: A Spatially Guided Vision-Language-Action Framework for Generalist Robot Policycited by 83
  17. 2025VQ-VLA: Improving Vision-Language-Action Models via Scaling Vector-Quantized Action Tokenizerscited by 67
  18. 2026Being-H0.5: Scaling Human-Centric Robot Learning for Cross-Embodiment Generalizationcited by 61
  19. 2025Igniting VLMs toward the Embodied Spacecited by 53
  20. 2025RLinf: Flexible and Efficient Large-scale Reinforcement Learning via Macro-to-Micro Flow Transformationcited by 51
  21. 2025VLA-0: Building State-of-the-Art VLAs with Zero Modificationcited by 49
  22. 2024Emma-X: An Embodied Multimodal Action Model with Grounded Chain of Thought and Look-ahead Spatial Reasoningcited by 45
  23. 2026Xiaomi-Robotics-0: An Open-Sourced Vision-Language-Action Model with Real-Time Executioncited by 42
  24. 2026Qwen-VLA: Unifying Vision-Language-Action Modeling across Tasks, Environments, and Robot Embodimentscited by 42
  25. 2025EO-1: An Open Unified Embodied Foundation Model for General Robot Controlcited by 30
  26. 2025BEAST: Efficient Tokenization of B-Splines Encoded Action Sequences for Imitation Learningcited by 25
  27. 2026ActionCodec: What Makes for Good Action Tokenizerscited by 17
  28. 2025Task adaptation of Vision-Language-Action model: 1st Place Solution for the 2025 BEHAVIOR Challengecited by 13
  29. 2026HEX: Humanoid-Aligned Experts for Cross-Embodiment Whole-Body Manipulationcited by 10
  30. 2025Openpi Comet: Competition Solution For 2025 BEHAVIOR Challengecited by 8
  31. 2026Green-VLA: Staged Vision-Language-Action Model for Generalist Robotscited by 6

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 17.

17 papers.

Sort:

By area:

  1. 2026Beyond Data Scaling: Representation-Centric Continued Pre-training for Vision-Language-Action Modelscited by 5
  2. 2026Riemann-1.0: An Embodied World Action Model for Physical AIcited by 2
  3. 2026MoPA: Coordinated Mobile Manipulation via Subsystem-Specific Perception Alignmentcited by 1
  4. 2026MachEmbodied-U0: Unified Understanding and Generation Model for Embodied Intelligencecited by 1
  5. 2026InternW0-Δ: A World Action Model Bridging Predictive Dynamics and Actions with 20K+ Hours of Open Datacited by 1
  6. 2026CSWAM: Better Causal Semantic Representations for Out-of-Distribution Generalization in World Action Modelscited by 0
  7. 2026SkelWAM: A Skeleton-Guided World-Action Model for Zero-Shot Cross-Embodiment Manipulationcited by 0
  8. 2026ForceRFT: Refining VLA Actions through Force-Guided Residual Reinforcement Learningcited by 0
  9. 2026An Action Is Worth One Patch: Unified World-Action Modeling with PatchWAMcited by 0
  10. 2026Devol-ONE: One Autoregressive Mixture of Transformers to Unify Vision-Language-Action and Latent World Modelingcited by 0
  11. 2026Copper-Policy: Focus on the Representation for Robust Robot Manipulationcited by 0
  12. 2026RoboICL: Embodied In-Context Learning with GPT-6 Astracited by 0
5 more
  1. 2026Humanoid Loco-Manipulation With Discrete VLA Modelcited by 0
  2. 2026CogWAM: Aligning Semantic Cognition with World Action Modeling via Event-Driven Interfacescited by 0
  3. 2026Magic-W0: A Structured World-Action Foundation Model for Physical Intelligencecited by 0
  4. 2026UniWAM: Unified World-Action Modelcited by 0
  5. 2026Embodied Turing Machines: Stateful Code for Robot Recursive Self-Improvementcited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2025FASTer: Toward Efficient Autoregressive Vision Language Action Modeling via Neural Action Tokenization
  2. 2026Two Bridges, One Pathway: From VLMs to Generalizable VLAs with Embodied Trajectory-Coupled Data
  3. 2026AR-VLA: True Autoregressive Action Expert for Vision-Language-Action Models
  4. 2025Do What You Say: Steering Vision-Language-Action Models via Runtime Reasoning-Action Alignment Verification
  5. 2026CLAP: Direct VLM-to-VLA Adaptation via Language-Action Grounding
  6. 2026CoRE-VLA: Towards Scalable and Robust Vision-Language-Action Modeling via Conditional Routing of Experts
  7. 2026VLAFlow: A Unified Training Framework for Vision-Language-Action Models via Co-training and Future Latent Alignment
  8. 2026Vision-Language-Action in Robotics: A Survey of Datasets, Benchmarks, and Data Engines