HumanoidToolBench: Benchmarking Humanoid Tool Use from Selection to Mobile Execution
Not on the map. Why?
Abstract (arXiv)
As robotic hardware and learning methods advance, humanoids need tools to perform tasks beyond their inherent physical limits. Successful tool use requires selecting a suitable tool and coordinating manipulation and, when needed, locomotion to complete the task. Existing benchmarks do not jointly evaluate these capabilities on a humanoid. We introduce HumanoidToolBench, an 18-task benchmark spanning three scenarios, three execution levels, and two tool-set modes, together with ToolBook, a dataset of 3.1k demonstrations collected in simulation and on a real Unitree G1. Evaluation of seven policies in simulation and three on the real robot reveals substantial gaps between selecting a suitable tool and completing the task. Focused GR00T N1.7 probes show reduced selection accuracy on unseen tools and continued task execution under unrelated instructions. Code and data are available at https://snu-pi.github.io/HumanoidToolBench/.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 20 of its 25 references that are in the map. First posted on arXiv 1 Oct 2026.
Builds on
20 of 25 references.
References · 20
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,182
- 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,838
- 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,761
- 2023Learning Fine-Grained Bimanual Manipulation with Low-Cost Hardwarecited by 1,568
- 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,540
- 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,410
- 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,225
- 2025RoboTwin 2.0: A Scalable Data Generator and Benchmark with Strong Domain Randomization for Robust Bimanual Robotic Manipulationcited by 518
- 2026Fast-WAM: Do World Action Models Need Test-time Future Imagination?cited by 349
- 2026Cosmos 3: Omnimodal World Models for Physical AIcited by 165
- 2024HumanoidBench: Simulated Humanoid Benchmark for Whole-Body Locomotion and Manipulationcited by 112
8 more
- 2025SONIC: Supersizing Motion Tracking for Natural Humanoid Whole-Body Controlcited by 101
- 2026Psi0: An Open Foundation Model Towards Universal Humanoid Loco-Manipulationcited by 27
- 2025PhysToolBench: Benchmarking Physical Tool Understanding for MLLMscited by 9
- 2026SIMPLE: Simulation-Based Policy Learning and Evaluation for Humanoid Loco-manipulationcited by 8
- 2025DICE-BENCH: Evaluating the Tool-Use Capabilities of Large Language Models in Multi-Round, Multi-Party Dialoguescited by 6
- 2026RoboWits: Unexpected Challenges for Robotic Creative Problem Solvingcited by 1
- 2026WOLF-VLA: Whole-Body Humanoid Optimal Locomotion Framework for Vision-Language-Action Learningcited by 1
- 2026From Grasps to Dexterity: Large-Scale Grasp Pretraining for Dexterous Manipulationcited by 1
Built on by
Not cited yet.