τ0-VLA: a Hierarchical Robot Foundation Model with World-Model-Guided Test-Time Computation
On the map: World models → Embodied and robot world models
Abstract (arXiv)
Long-horizon robot manipulation requires a robot to both execute individual skills reliably and sequence them coherently over extended tasks. Most hierarchical vision-language-action (VLA) models make each such decision with a single forward pass, leaving no mechanism to allocate additional computation to difficult or consequential choices. We introduce τ0-VLA, a hierarchical robot foundation model that formulates high-level subtask generation as a compute-scalable inference problem through world-model-guided test-time computation. At each inference step, the high-level policy uses execution memory to generate a subtask and, when needed, searches over alternatives before committing to its output. A low-level policy then executes the generated subtask across multiple robot embodiments. The policy is trained on 40,115 hours of heterogeneous real-world data with multimodal co-training. Across in-domain and distribution-shifted settings, allocating additional test-time computation substantially improves next-subtask prediction accuracy, and these gains translate into higher closed-loop success on long-horizon robot manipulation tasks.
Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Placed in Embodied and robot world models, one of 11 directions in World models. Builds on 23 of its 38 references that are in the map. First posted on arXiv 17 Aug 2026.
Builds on
23 of 38 references.
Closest ancestors · 4
Same direction, newest first
- 2026World-Language-Action Model for Unified World Modeling, Language Reasoning, and Action Synthesis4 Jun
- 2026Scaling World Model for Hierarchical Manipulation Policies11 Feb
- 2025WorldVLA: Towards Autoregressive Action World Model26 Jun
- 2023Zero-Shot Robotic Manipulation with Pretrained Image-Editing Diffusion Models16 Oct
Other references · 19
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,887
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,407
- 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,761
- 2018World Modelscited by 1,513
- 2024RDT-1B: a Diffusion Foundation Model for Bimanual Manipulationcited by 691
- 2025FAST: Efficient Action Tokenization for Vision-Language-Action Modelscited by 665
- 2025SmolVLA: A Vision-Language-Action Model for Affordable and Efficient Roboticscited by 530
- 2025X-VLA: Soft-Prompted Transformer as Scalable Cross-Embodiment Vision-Language-Action Modelcited by 303
- 2025Hi Robot: Open-Ended Instruction Following with Hierarchical Vision-Language-Action Modelscited by 221
- 2025Real-Time Execution of Action Chunking Flow Policiescited by 216
- 2025Knowledge Insulating Vision-Language-Action Models: Train Fast, Run Fast, Generalize Bettercited by 146
- 2025MemER: Scaling Up Memory for Robot Control via Experience Retrievalcited by 67
7 more
- 2026Being-H0.5: Scaling Human-Centric Robot Learning for Cross-Embodiment Generalizationcited by 66
- 2025RoboMonkey: Scaling Test-Time Sampling and Verification for Vision-Language-Action Modelscited by 61
- 2026MEM: Multi-Scale Embodied Memory for Vision Language Action Modelscited by 61
- 2025RoVer: Robot Reward Model as Test-Time Verifier for Vision-Language-Action Modelcited by 19
- 2026Goal2Skill: Long-Horizon Manipulation with Adaptive Planning and Reflectioncited by 11
- 2025Hierarchical Vision Language Action Model Using Success and Failure Demonstrationscited by 2
- 2026Anticipation-VLA: Solving Long-Horizon Embodied Tasks via Anticipation-based Subgoal Generationcited by 2
Built on by
Citing papers per year: 2026: 5.
5 papers.
- 2026In-Context Learning for Robots: Methods and Applicationscited by 1
- 2026CAPEX: Efficiently Distilling Foundation Model Behavior into Deployable Robot Policies through Experience-Adaptive Reasoningcited by 0
- 2026Vision-Language-Action Autonomous Driving Agent with Language-based Memorycited by 0
- 2026Vela: Scaling Vision-Language-Action Models with Adaptive Action Curve Parametrizationcited by 0
- 2026RoboJEPA: Scaling Robotic Latent World Modelscited by 0
- 2026RoboJEPA: Scaling Robotic Latent World Models7 Oct 2026
- 2026Vela: Scaling Vision-Language-Action Models with Adaptive Action Curve Parametrization4 Oct 2026
- 2026Vision-Language-Action Autonomous Driving Agent with Language-based Memory29 Sep 2026
- 2026In-Context Learning for Robots: Methods and Applications28 Sep 2026
- 2026CAPEX: Efficiently Distilling Foundation Model Behavior into Deployable Robot Policies through Experience-Adaptive Reasoning26 Sep 2026
Similar, not cited
Close in wording, no citation either way
- 2026AtomVLA: Scalable Post-Training for Robotic Manipulation via Predictive Latent World Models
- 2026What Matters in Orchestrating Robot Policies: A Systematic Study of Hierarchical VLA Agents
- 2026ElegantVLA: Learning When to Think for Efficient Vision-Language-Action Models
- 2025SITCOM: Scaling Inference-Time COMpute for VLAs
- 2026AC^2-VLA: Action-Context-Aware Adaptive Computation in Vision-Language-Action Models for Efficient Robotic Manipulation
- 2026Learning to Accelerate Vision-Language-Action Models through Adaptive Visual Token Caching
- 2025Long-VLA: Unleashing Long-Horizon Capability of Vision Language Action Model for Robot Manipulation
- 2025LoHoVLA: A Unified Vision-Language-Action Model for Long-Horizon Embodied Tasks