From Power to Precision: Learning Fine-grained Dexterity for Multi-fingered Robotic Hands
Not on the map. Why?
Abstract (arXiv)
Human grasps can be roughly categorized into two types: power grasps and precision grasps. Precision grasping enables tool use and is believed to have influenced human evolution. Today's multi-fingered robotic hands are effective in power grasps, but for tasks requiring precision, parallel grippers are still more widely adopted. This contrast highlights a key limitation in current robotic hand design: the difficulty of achieving both stable power grasps and precise, fine-grained manipulation within a single, versatile system. In this work, we bridge this gap by jointly optimizing the control and hardware design of a multi-fingered dexterous hand, enabling both power and precision manipulation. Rather than redesigning the entire hand, we introduce a lightweight fingertip geometry modification, represent it as a contact plane, and jointly optimize its parameters along with the corresponding control. Our control strategy dynamically switches between power and precision manipulation and simplifies precision control into parallel thumb-index motions, which proves robust for sim-to-real transfer. On the design side, we leverage large-scale simulation to optimize the fingertip geometry using a differentiable neural-physics surrogate model. We validate our approach through extensive experiments in both sim-to-real and real-to-real settings. Our method achieves an 82.5% zero-shot success rate on unseen objects in sim-to-real precision grasping, and a 93.3% success rate in challenging real-world tasks involving bread pinching. These results demonstrate that our co-design framework can significantly enhance the fine-grained manipulation ability of multi-fingered hands without reducing their ability for power grasps. Our project page is at https://jianglongye.com/power-to-precision
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 47 of its 59 references that are in the map. First posted on arXiv 17 Nov 2025.
Builds on
47 of 59 references.
References · 47
- 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,248
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,407
- 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,061
- 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,761
- 2023Learning Fine-Grained Bimanual Manipulation with Low-Cost Hardwarecited by 1,568
- 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,540
- 2023Open X-Embodiment: Robotic Learning Datasets and RT-X Modelscited by 862
- 2018QT-Opt: Scalable Deep Reinforcement Learning for Vision-Based Robotic Manipulationcited by 743
- 2021What Matters in Learning from Offline Human Demonstrations for Robot Manipulationcited by 725
- 2019RLBench: The Robot Learning Benchmark & Learning Environmentcited by 689
- 2023MimicGen: A Data Generation System for Scalable Robot Learning using Human Demonstrationscited by 327
- 2024ManiSkill3: GPU Parallelized Robotics Simulation and Rendering for Generalizable Embodied AIcited by 229
35 more
- 2017One-Shot Visual Imitation Learning via Meta-Learningcited by 228
- 2023Affordances from Human Videos as a Versatile Representation for Roboticscited by 226
- 2023RoboGen: Towards Unleashing Infinite Data for Automated Robot Learning via Generative Simulationcited by 218
- 2015Supersizing Self-supervision: Learning to Grasp from 50K Tries and 700 Robot Hourscited by 209
- 2021DexMV: Imitation Learning for Dexterous Manipulation from Human Videoscited by 206
- 2018RoboTurk: A Crowdsourcing Platform for Robotic Skill Learning through Imitationcited by 204
- 2023GELLO: A General, Low-Cost, and Intuitive Teleoperation Framework for Robot Manipulatorscited by 189
- 2023AnyTeleop: A General Vision-Based Dexterous Robot Arm-Hand Teleoperation Systemcited by 152
- 2024Open-TeleVision: Teleoperation with Immersive Active Visual Feedbackcited by 145
- 2022DexGraspNet: A Large-Scale Robotic Dexterous Grasp Dataset for General Objects Based on Simulationcited by 137
- 2024ALOHA Unleashed: A Simple Recipe for Robot Dexteritycited by 134
- 2020Learning to Generalize Across Long-Horizon Tasks from Human Demonstrationscited by 115
- 2020Visual Imitation Made Easycited by 111
- 2025DexGraspVLA: A Vision-Language-Action Framework Towards General Dexterous Graspingcited by 89
- 2021Bottom-Up Skill Discovery from Unsegmented Demonstrations for Long-Horizon Robot Manipulationcited by 83
- 2022Learning and Retrieval from Prior Data for Skill-based Imitation Learningcited by 77
- 2024Bunny-VisionPro: Real-Time Bimanual Dexterous Teleoperation for Imitation Learningcited by 77
- 2021Synthesizing Diverse and Physically Stable Grasps with Arbitrary Hand Structures using Differentiable Force Closure Estimatorcited by 71
- 2024GraspXL: Generating Grasping Motions for Diverse Objects at Scalecited by 60
- 2024DextrAH-RGB: Visuomotor Policies to Grasp Anything with Dexterous Handscited by 45
- 2022Learning Continuous Grasping Function with a Dexterous Hand from Human Demonstrationscited by 34
- 2025Dex1B: Learning with 1B Demonstrations for Dexterous Manipulationcited by 24
- 2024BODex: Scalable and Efficient Robotic Dexterous Grasp Synthesis Using Bilevel Optimizationcited by 20
- 2025DexVLG: Dexterous Vision-Language-Grasp Model at Scalecited by 20
- 2022PATO: Policy Assisted TeleOperation for Scalable Robot Data Collectioncited by 19
- 2025AnyDexGrasp: General Dexterous Grasping for Different Hands with Human-level Learning Efficiencycited by 16
- 2023Precise Robotic Needle-Threading with Tactile Perception and Reinforcement Learningcited by 6
- 2024WildLMa: Long Horizon Loco-Manipulation in the Wildcited by 6
- 2023DenseTact-Mini: An Optical Tactile Sensor for Grasping Multi-Scale Objects From Flat Surfacescited by 5
- 2023GelSight Svelte Hand: A Three-finger, Two-DoF, Tactile-rich, Low-cost Robot Hand for Dexterous Manipulationcited by 4
- 2024TEXterity: Tactile Extrinsic deXteritycited by 4
- 2024Ensuring Force Safety in Vision-Guided Robotic Manipulation via Implicit Tactile Calibrationcited by 4
- 2025Co-Design of Soft Gripper with Neural Physicscited by 4
- 2024PaperBot: Learning to Design Real-World Tools Using Papercited by 2
- 2024Design and Control Co-Optimization for Automated Design Iteration of Dexterous Anthropomorphic Soft Robotic Handscited by 2
Built on by
Citing papers per year: 2026: 2.
2 papers.