Closing the Loop in Humanoid VLA: Persistent 3D Object Tokens for Verifiable Loco-Manipulation
On the map: Vision-language-action models → Tactile, force-aware and humanoid VLA
Abstract (arXiv)
Vision-language-action policies are a promising foundation for general robot control, but long-horizon humanoid loco-manipulation requires the robot to treat task objects as persistent physical entities across movement, contact, occlusion, and recovery. We study this problem as object-state divergence: the object state used to condition a whole-body action can differ from the state used to decide whether the action achieved the intended physical relation. We propose Persistent Object Tokenization (POT), which maintains role-indexed 3D object records from RGB-D observations and converts them into object tokens for a whole-body action expert. Instantiated as POT-VLA, the same object records condition action generation and support geometric predicate checks, yielding a closed-loop execution system in which object state is both actionable and verifiable. On a Unitree G1, POT-VLA improves a matched direct GR00T-N1.7 baseline from 39/80 to 71/80 successes over eight real-world task families. In an external Being-0-aligned reference, POT-VLA achieves 44/50 successes on aligned service tasks, compared with the 37/50 success reported by the Being-0 paper. The largest gains occur on tasks requiring maintained 3D relations, suggesting that persistent object-centered state is a useful abstraction for verifiable humanoid VLA execution.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Tactile, force-aware and humanoid VLA, one of 13 directions in Vision-language-action models. Builds on 30 of its 35 references that are in the map. First posted on arXiv 20 Jul 2026.
Builds on
30 of 35 references.
Closest ancestors · 1
Same direction, newest first
Other references · 29
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 2,993
- 2022Do As I Can, Not As I Say: Grounding Language in Robotic Affordancescited by 2,302
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,297
- 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,007
- 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,653
- 2024Octo: An Open-Source Generalist Robot Policycited by 1,427
- 2022Code as Policies: Language Model Programs for Embodied Controlcited by 1,172
- 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,167
- 2022Inner Monologue: Embodied Reasoning through Planning with Language Modelscited by 1,057
- 2022Language Models as Zero-Shot Planners: Extracting Actionable Knowledge for Embodied Agentscited by 1,029
- 2025SAM 3: Segment Anything with Conceptscited by 835
17 more
- 2023VoxPoser: Composable 3D Value Maps for Robotic Manipulation with Language Modelscited by 733
- 2021CLIPort: What and Where Pathways for Robotic Manipulationcited by 617
- 2022Perceiver-Actor: A Multi-Task Transformer for Robotic Manipulationcited by 545
- 2022VIMA: General Robot Manipulation with Multimodal Promptscited by 403
- 2023RVT: Robotic View Transformer for 3D Object Manipulationcited by 224
- 2023Real-World Humanoid Locomotion with Reinforcement Learningcited by 132
- 2025BeyondMimic: From Motion Tracking to Versatile Humanoid Control via Guided Diffusioncited by 128
- 2022StructDiffusion: Language-Guided Creation of Physically-Valid Structures using Unseen Objectscited by 49
- 2024Generalizable Humanoid Manipulation with 3D Diffusion Policiescited by 49
- 2025WholeBodyVLA: Towards Unified Latent VLA for Whole-Body Loco-Manipulation Controlcited by 32
- 2024ReplanVLM: Replanning Robotic Tasks with Visual Language Modelscited by 28
- 2025Being-0: A Humanoid Robotic Agent with Vision-Language Models and Modular Skillscited by 21
- 2025VerifyLLM: LLM-Based Pre-Execution Task Plan Verification for Robotscited by 14
- 2024Autonomous Behavior Planning For Humanoid Loco-manipulation Through Grounded Language Modelcited by 8
- 2025Hierarchical Vision-Language Planning for Multi-Step Humanoid Manipulationcited by 4
- 2025Scene Graph-Guided Proactive Replanning for Failure-Resilient Embodied Agentcited by 4
- 2024iWalker: Imperative Visual Planning for Walking Humanoid Robotcited by 3
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026Cybo-Waiter: A Physical Agentic Framework for Humanoid Whole-Body Locomotion-Manipulation
- 2026Humanoid Loco-Manipulation With Discrete VLA Model
- 2026VeriSpace: Spatially Grounded Action Verification for Vision-Language-Action Models
- 2026WOLF-VLA: Whole-Body Humanoid Optimal Locomotion Framework for Vision-Language-Action Learning
- 2026ActionGround: Training-Free Runtime Refinement of Frozen VLA Policies
- 2026KINO: A Keyframe Interface for VLM Planning and Whole-Body Control in Humanoid Loco-Manipulation ↗
- 2026MotionVLA: Injecting Geometric Motion into Vision-Language-Action Model
- 2026EATR-Stereo: Embodiment-Aware Token Routing of Paired Stereo Evidence for Humanoid Vision-Language-Action Control