mlsanityData to 7 Oct 2026

DynaHOI: Benchmarking Hand-Object Interaction for Dynamic Target

arXiv 2602.11919 ↗First posted 12 Feb 2026cs.CV cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Most existing hand motion generation benchmarks for hand-object interaction (HOI) focus on static objects, leaving dynamic scenarios with moving targets and time-critical coordination largely untested. To address this gap, we introduce the DynaHOI-Gym, a unified online closed-loop platform with parameterized motion generators and rollout-based metrics for dynamic capture evaluation. Built on DynaHOI-Gym, we release DynaHOI-10M, a large-scale benchmark with 10M frames and 180K hand capture trajectories, whose target motions are organized into 8 major categories and 22 fine-grained subcategories. We also provide a simple observe-before-act baseline (ObAct) that integrates short-term observations with the current frame via spatiotemporal attention to predict actions, achieving an 8.1% improvement in location success rate.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 27 of its 34 references that are in the map. First posted on arXiv 12 Feb 2026.

Builds on

27 of 34 references.

References · 27

  1. 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
  2. 2025Qwen3-VL Technical Reportcited by 2,534
  3. 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,297
  4. 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiencycited by 1,419
  5. 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,167
  6. 2025SmolVLA: A Vision-Language-Action Model for Affordable and Efficient Roboticscited by 507
  7. 2020GRAB: A Dataset of Whole-Body Human Grasping of Objectscited by 397
  8. 2024TinyVLA: Towards Fast, Data-Efficient Vision-Language-Action Models for Robotic Manipulationcited by 331
  9. 2022HOI4D: A 4D Egocentric Dataset for Category-Level Human-Object Interactioncited by 321
  10. 2021DexYCB: A Benchmark for Capturing Hand Grasping of Objectscited by 320
  11. 2022ARCTIC: A Dataset for Dexterous Bimanual Hand-Object Manipulationcited by 306
  12. 2020ContactPose: A Dataset of Grasps with Object Contact and Hand Posecited by 180
15 more
  1. 2024VLABench: A Large-Scale Benchmark for Language-Conditioned Robotics Manipulation with Long-Horizon Reasoning Taskscited by 171
  2. 2025VLA-Adapter: An Effective Paradigm for Tiny-Scale Vision-Language-Action Modelcited by 140
  3. 2024RoboMamba: Efficient Vision-Language-Action Model for Robotic Reasoning and Manipulationcited by 102
  4. 2025UP-VLA: A Unified Understanding and Prediction Model for Embodied Agentcited by 99
  5. 2025Being-H0: Vision-Language-Action Pretraining from Large-Scale Human Videoscited by 94
  6. 2024TACO: Benchmarking Generalizable Bimanual Tool-ACtion-Object Understandingcited by 85
  7. 2024Text2HOI: Text-guided 3D Motion Generation for Hand-Object Interactioncited by 84
  8. 2024OAKINK2: A Dataset of Bimanual Hands-Object Manipulation in Complex Task Completioncited by 78
  9. 2023AssemblyHands: Towards Egocentric Activity Understanding via 3D Hand Pose Estimationcited by 64
  10. 2024Introducing HOT3D: An Egocentric Dataset for 3D Hand and Object Trackingcited by 46
  11. 2024GigaHands: A Massive Annotated Dataset of Bimanual Hand Activitiescited by 32
  12. 2025HOIGPT: Learning Long Sequence Hand-Object Interaction with Language Modelscited by 32
  13. 2024InterHandGen: Two-Hand Interaction Generation via Cascaded Reverse Diffusioncited by 28
  14. 2025OpenHOI: Open-World Hand-Object Interaction Synthesis with Multimodal Large Language Modelcited by 17
  15. 2023HandDiffuse: Generative Controllers for Two-Hand Interactions via Diffusion Modelscited by 13

Built on by

Not cited yet.