GOTT: Object-centric Dexterous Manipulation with a Reusable Cross-Embodiment Primitive
Not on the map. Why?
Abstract (arXiv)
Foundation models and large-scale human data provide rich sources of manipulation intent, but translating this intent into multi-fingered robot behavior remains difficult. Dexterous hands still lack a reusable low-level primitive that reliably establishes contact across tasks and embodiments. We propose GOTT, a reach-acquire-move framework built around a single cross-embodiment contact-acquisition primitive. Given a robot-agnostic object trajectory and a reach specification, GOTT first brings the hand near a task-relevant contact region. The shared closed-loop primitive then establishes stable contact from this approximate initialization, and a pose-conditioned controller tracks the desired object motion. Reach specifications may come from future-aware planning, external models, or human demonstrations, while the primitive and tracking backend remain unchanged. Simulation and real-world experiments show that GOTT is able to establish robust contact across diverse objects, arm-hand platforms, and seen and unseen hand morphologies. It also consistently improves end-to-end task success over open-loop grasp execution.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 57 of its 63 references that are in the map. First posted on arXiv 2 Oct 2026.
Builds on
57 of 63 references.
References · 57
- 2017Proximal Policy Optimization Algorithmscited by 15,215
- 2024SAM 2: Segment Anything in Images and Videoscited by 2,863
- 2022Code as Policies: Language Model Programs for Embodied Controlcited by 1,210
- 2023VoxPoser: Composable 3D Value Maps for Robotic Manipulation with Language Modelscited by 750
- 2018Learning Dexterous In-Hand Manipulationcited by 687
- 2023FoundationPose: Unified 6D Pose Estimation and Tracking of Novel Objectscited by 429
- 2021DexYCB: A Benchmark for Capturing Hand Grasping of Objectscited by 325
- 2024ReKep: Spatio-Temporal Reasoning of Relational Keypoint Constraints for Robotic Manipulationcited by 315
- 2023Any-point Trajectory Modeling for Policy Learningcited by 215
- 2022DeXtreme: Transfer of Agile In-hand Manipulation from Simulation to Realitycited by 149
- 2022DexGraspNet: A Large-Scale Robotic Dexterous Grasp Dataset for General Objects Based on Simulationcited by 137
- 2024Flow as the Cross-Domain Manipulation Interfacecited by 132
38 more
- 2022OakInk: A Large-scale Knowledge Repository for Understanding Hand-Object Interactioncited by 131
- 2023UniDexGrasp: Universal Robotic Dexterous Grasping via Learning Diverse Proposal Generation and Goal-Conditioned Policycited by 124
- 2024Track2Act: Predicting Point Tracks from Internet Videos enables Generalizable Robot Manipulationcited by 124
- 2022In-Hand Object Rotation via Rapid Motor Adaptationcited by 118
- 2021D-Grasp: Physically Plausible Dynamic Grasp Synthesis for Hand-Object Interactionscited by 113
- 2023UniDexGrasp++: Improving Dexterous Grasping Policy Learning via Geometry-aware Curriculum and Iterative Generalist-Specialist Learningcited by 107
- 2022Visual Dexterity: In-Hand Reorientation of Novel and Complex Object Shapescited by 101
- 2023General In-Hand Object Rotation with Vision and Touchcited by 99
- 2024OKAMI: Teaching Humanoid Robots Manipulation Skills through Single Video Imitationcited by 67
- 2025ManipTrans: Efficient Dexterous Bimanual Manipulation Transfer via Residual Learningcited by 66
- 2024GraspXL: Generating Grasping Motions for Diverse Objects at Scalecited by 60
- 2024Robot See Robot Do: Imitating Articulated Object Manipulation with Monocular 4D Reconstructioncited by 54
- 2024Vision-based Manipulation from Single Human Video with Open-World Object Graphscited by 50
- 2024Introducing HOT3D: An Egocentric Dataset for 3D Hand and Object Trackingcited by 48
- 2024Omnigrasp: Grasping Diverse Objects with Simulated Humanoidscited by 46
- 2024DextrAH-G: Pixels-to-Action Dexterous Arm-Hand Grasping with Geometric Fabricscited by 42
- 2024D(R,O) Grasp: A Unified Representation of Robot and Object Interaction for Cross-Embodiment Dexterous Graspingcited by 42
- 2024Object-Centric Dexterous Manipulation from Human Motion Datacited by 41
- 2023Dexterous Functional Graspingcited by 39
- 2024SPOT: SE(3) Pose Trajectory Diffusion for Object-Centric Manipulationcited by 38
- 2025Robotic Manipulation by Imitating Generated Videos Without Physical Demonstrationscited by 38
- 2025DexMachina: Functional Retargeting for Bimanual Dexterous Manipulationcited by 37
- 2025Crossing the Human-Robot Embodiment Gap with Sim-to-Real RL using One Human Demonstrationcited by 34
- 2025SPIDER: Scalable Physics-Informed Dexterous Retargetingcited by 32
- 2024DITTO: Demonstration Imitation by Trajectory Transformationcited by 30
- 2024Video Depth without Video Modelscited by 29
- 2024GET-Zero: Graph Embodiment Transformer for Zero-shot Embodiment Generalizationcited by 27
- 2024Cross-Embodiment Dexterous Grasping with Reinforcement Learningcited by 27
- 2025AffordDexGrasp: Open-set Language-guided Dexterous Grasp with Generalizable-Instructive Affordancecited by 27
- 2024Local Policies Enable Zero-shot Long-horizon Manipulationcited by 22
- 2024BODex: Scalable and Efficient Robotic Dexterous Grasp Synthesis Using Bilevel Optimizationcited by 20
- 2025RobustDexGrasp: Robust Dexterous Grasping of General Objectscited by 19
- 2025DexTrack: Towards Generalizable Neural Tracking Control for Dexterous Manipulation from Human Referencescited by 17
- 2025AnyDexGrasp: General Dexterous Grasping for Different Hands with Human-level Learning Efficiencycited by 16
- 2026SimToolReal: An Object-Centric Policy for Zero-Shot Dexterous Tool Manipulationcited by 15
- 2026Dex4D: Task-Agnostic Point Track Policy for Zero-Shot Dexterous Manipulationcited by 14
- 2025Scaffolding Dexterous Manipulation with Vision-Language Modelscited by 9
- 2024SpringGrasp: Synthesizing Compliant, Dexterous Grasps under Shape Uncertaintycited by 8
50 most cited of 57 All 57 (JSON)
Built on by
Not cited yet.