mlsanityData to 14 Oct 2026

τ0-VLA: a Hierarchical Robot Foundation Model with World-Model-Guided Test-Time Computation

arXiv 2608.16885 ↗First posted 17 Aug 2026cs.ROcited by 5

On the map: World models → Embodied and robot world models

Abstract (arXiv)

Long-horizon robot manipulation requires a robot to both execute individual skills reliably and sequence them coherently over extended tasks. Most hierarchical vision-language-action (VLA) models make each such decision with a single forward pass, leaving no mechanism to allocate additional computation to difficult or consequential choices. We introduce τ0-VLA, a hierarchical robot foundation model that formulates high-level subtask generation as a compute-scalable inference problem through world-model-guided test-time computation. At each inference step, the high-level policy uses execution memory to generate a subtask and, when needed, searches over alternatives before committing to its output. A low-level policy then executes the generated subtask across multiple robot embodiments. The policy is trained on 40,115 hours of heterogeneous real-world data with multimodal co-training. Across in-domain and distribution-shifted settings, allocating additional test-time computation substantially improves next-subtask prediction accuracy, and these gains translate into higher closed-loop success on long-horizon robot manipulation tasks.

Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Placed in Embodied and robot world models, one of 11 directions in World models. Builds on 23 of its 38 references that are in the map. First posted on arXiv 17 Aug 2026.

Builds on

23 of 38 references.

Closest ancestors · 4

Same direction, newest first

  1. 2026World-Language-Action Model for Unified World Modeling, Language Reasoning, and Action Synthesis4 Jun
  2. 2026Scaling World Model for Hierarchical Manipulation Policies11 Feb
  3. 2025WorldVLA: Towards Autoregressive Action World Model26 Jun
  4. 2023Zero-Shot Robotic Manipulation with Pretrained Image-Editing Diffusion Models16 Oct

Other references · 19

  1. 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,887
  2. 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,407
  3. 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,761
  4. 2018World Modelscited by 1,513
  5. 2024RDT-1B: a Diffusion Foundation Model for Bimanual Manipulationcited by 691
  6. 2025FAST: Efficient Action Tokenization for Vision-Language-Action Modelscited by 665
  7. 2025SmolVLA: A Vision-Language-Action Model for Affordable and Efficient Roboticscited by 530
  8. 2025X-VLA: Soft-Prompted Transformer as Scalable Cross-Embodiment Vision-Language-Action Modelcited by 303
  9. 2025Hi Robot: Open-Ended Instruction Following with Hierarchical Vision-Language-Action Modelscited by 221
  10. 2025Real-Time Execution of Action Chunking Flow Policiescited by 216
  11. 2025Knowledge Insulating Vision-Language-Action Models: Train Fast, Run Fast, Generalize Bettercited by 146
  12. 2025MemER: Scaling Up Memory for Robot Control via Experience Retrievalcited by 67
7 more
  1. 2026Being-H0.5: Scaling Human-Centric Robot Learning for Cross-Embodiment Generalizationcited by 66
  2. 2025RoboMonkey: Scaling Test-Time Sampling and Verification for Vision-Language-Action Modelscited by 61
  3. 2026MEM: Multi-Scale Embodied Memory for Vision Language Action Modelscited by 61
  4. 2025RoVer: Robot Reward Model as Test-Time Verifier for Vision-Language-Action Modelcited by 19
  5. 2026Goal2Skill: Long-Horizon Manipulation with Adaptive Planning and Reflectioncited by 11
  6. 2025Hierarchical Vision Language Action Model Using Success and Failure Demonstrationscited by 2
  7. 2026Anticipation-VLA: Solving Long-Horizon Embodied Tasks via Anticipation-based Subgoal Generationcited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 5.

5 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026AtomVLA: Scalable Post-Training for Robotic Manipulation via Predictive Latent World Models
  2. 2026What Matters in Orchestrating Robot Policies: A Systematic Study of Hierarchical VLA Agents
  3. 2026ElegantVLA: Learning When to Think for Efficient Vision-Language-Action Models
  4. 2025SITCOM: Scaling Inference-Time COMpute for VLAs
  5. 2026AC^2-VLA: Action-Context-Aware Adaptive Computation in Vision-Language-Action Models for Efficient Robotic Manipulation
  6. 2026Learning to Accelerate Vision-Language-Action Models through Adaptive Visual Token Caching
  7. 2025Long-VLA: Unleashing Long-Horizon Capability of Vision Language Action Model for Robot Manipulation
  8. 2025LoHoVLA: A Unified Vision-Language-Action Model for Long-Horizon Embodied Tasks