Grasp2Twist: Learning Bimanual Dexterous Jar Opening by Reinforcement Learning
On the map: Deep reinforcement learning methods → RL for robot locomotion and manipulation
Abstract (arXiv)
This paper presents Grasp2Twist, a bimanual dexterous manipulation system that learns to grasp and twist open jar lids using reinforcement learning. Learning this task raises three challenges: learning a unified policy for a multi-stage task, sustaining lid twisting, and sim-to-real transfer. To address the first challenge, we introduce a continuous enclosure measure to guide grasp formation and a binary enclosure indicator to guide the grasp-to-twist transition for unified policy learning. We derive both from the geometric relationship between the object center and the convex hull formed by the hand's palm and fingertips. Kinematic constraints limit how far the hand can rotate the lid with fixed contacts, so sustained twisting requires finger contact reconfiguration. We use a three-stage curriculum to facilitate exploration of these contact changes and also improve robustness for sim-to-real transfer. With our approach, the learned policy demonstrates finger gaiting, reconfiguring hand-object contacts to sustain lid rotation. It transfers zero-shot to the physical system and achieves an 88% task success rate across six household containers, including peanut-butter, vitamin, and instant-coffee jars. Ablations further validate the roles of the geometric enclosure in grasp formation and the curriculum in contact-reconfiguration exploration.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in RL for robot locomotion and manipulation, one of 15 directions in Deep reinforcement learning methods. Builds on 31 of its 36 references that are in the map. First posted on arXiv 25 Sep 2026.
Builds on
31 of 36 references.
Closest ancestors · 1
Same direction, newest first
Other references · 30
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2017Proximal Policy Optimization Algorithmscited by 15,215
- 2023Learning Fine-Grained Bimanual Manipulation with Low-Cost Hardwarecited by 1,568
- 2025SAM 3: Segment Anything with Conceptscited by 906
- 2015End-to-End Training of Deep Visuomotor Policiescited by 875
- 2019Solving Rubik's Cube with a Robot Handcited by 734
- 2018Learning Dexterous In-Hand Manipulationcited by 687
- 2021Learning to Walk in Minutes Using Massively Parallel Deep Reinforcement Learningcited by 512
- 2017Asymmetric Actor Critic for Image-Based Robot Learningcited by 238
- 2017Reverse Curriculum Generation for Reinforcement Learningcited by 198
- 2021A System for General In-Hand Object Re-Orientationcited by 165
- 2023AnyTeleop: A General Vision-Based Dexterous Robot Arm-Hand Teleoperation Systemcited by 152
18 more
- 2022Visual Dexterity: In-Hand Reorientation of Novel and Complex Object Shapescited by 101
- 2026EgoScale: Scaling Dexterous Manipulation with Diverse Egocentric Human Datacited by 94
- 2022DexPoint: Generalizable Point Cloud Reinforcement Learning for Sim-to-Real Dexterous Manipulationcited by 84
- 2023Rotating without Seeing: Towards In-hand Dexterity through Touchcited by 84
- 2024Bunny-VisionPro: Real-Time Bimanual Dexterous Teleoperation for Imitation Learningcited by 77
- 2021Synthesizing Diverse and Physically Stable Grasps with Arbitrary Hand Structures using Differentiable Force Closure Estimatorcited by 71
- 2025ManipTrans: Efficient Dexterous Bimanual Manipulation Transfer via Residual Learningcited by 66
- 2022GenDexGrasp: Generalizable Dexterous Graspingcited by 56
- 2018Learning Task-Oriented Grasping for Tool Manipulation from Simulated Self-Supervisioncited by 52
- 2023Sequential Dexterity: Chaining Dexterous Policies for Long-Horizon Manipulationcited by 49
- 2024Twisting Lids Off with Two Handscited by 42
- 2024Object-Centric Dexterous Manipulation from Human Motion Datacited by 41
- 2025Crossing the Human-Robot Embodiment Gap with Sim-to-Real RL using One Human Demonstrationcited by 34
- 2022Complex In-Hand Manipulation via Compliance-Enabled Finger Gaiting and Multi-Modal Planningcited by 26
- 2026mjlab: A Lightweight Framework for GPU-Accelerated Robot Learningcited by 26
- 2022Learning High-DOF Reaching-and-Grasping via Dynamic Representation of Gripper-Object Interactioncited by 24
- 2023Sampling-based Exploration for Reinforcement Learning of Dexterous Manipulationcited by 24
- 2022DA2 Dataset: Toward Dexterity-Aware Dual-Arm Graspingcited by 11
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Learning Dexterous Manipulation Using Contact Wrench Guidance From Human Demonstration
- 2025Hierarchical Reinforcement Learning for Articulated Tool Manipulation with Multifingered Hand
- 2025Learning Dexterous Manipulation Skills from Imperfect Simulations
- 2024Dexterous Manipulation Based on Prior Dexterous Grasp Pose Knowledge
- 2026A Minimalist Retargeting-Guided Reinforcement Learning Recipe for Dexterous Manipulation
- 2026Learning Stable In-Grasp Manipulation in a Non-Dropping Action Space ↗
- 2025Dexterous Manipulation through Imitation Learning: A Survey
- 2026DexTaG: Tactile-as-Guidance in Reinforcement Learning for Dexterous Manipulation