mlsanityData to 14 Oct 2026

Grasp2Twist: Learning Bimanual Dexterous Jar Opening by Reinforcement Learning

arXiv 2609.32064 ↗First posted 25 Sep 2026cs.ROcited by 0

On the map: Deep reinforcement learning methods → RL for robot locomotion and manipulation

Abstract (arXiv)

This paper presents Grasp2Twist, a bimanual dexterous manipulation system that learns to grasp and twist open jar lids using reinforcement learning. Learning this task raises three challenges: learning a unified policy for a multi-stage task, sustaining lid twisting, and sim-to-real transfer. To address the first challenge, we introduce a continuous enclosure measure to guide grasp formation and a binary enclosure indicator to guide the grasp-to-twist transition for unified policy learning. We derive both from the geometric relationship between the object center and the convex hull formed by the hand's palm and fingertips. Kinematic constraints limit how far the hand can rotate the lid with fixed contacts, so sustained twisting requires finger contact reconfiguration. We use a three-stage curriculum to facilitate exploration of these contact changes and also improve robustness for sim-to-real transfer. With our approach, the learned policy demonstrates finger gaiting, reconfiguring hand-object contacts to sustain lid rotation. It transfers zero-shot to the physical system and achieves an 88% task success rate across six household containers, including peanut-butter, vitamin, and instant-coffee jars. Ablations further validate the roles of the geometric enclosure in grasp formation and the curriculum in contact-reconfiguration exploration.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in RL for robot locomotion and manipulation, one of 15 directions in Deep reinforcement learning methods. Builds on 31 of its 36 references that are in the map. First posted on arXiv 25 Sep 2026.

Builds on

31 of 36 references.

Closest ancestors · 1

Same direction, newest first

  1. 2025RSL-RL: A Learning Library for Robotics Research13 Sep

Other references · 30

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2017Proximal Policy Optimization Algorithmscited by 15,215
  3. 2023Learning Fine-Grained Bimanual Manipulation with Low-Cost Hardwarecited by 1,568
  4. 2025SAM 3: Segment Anything with Conceptscited by 906
  5. 2015End-to-End Training of Deep Visuomotor Policiescited by 875
  6. 2019Solving Rubik's Cube with a Robot Handcited by 734
  7. 2018Learning Dexterous In-Hand Manipulationcited by 687
  8. 2021Learning to Walk in Minutes Using Massively Parallel Deep Reinforcement Learningcited by 512
  9. 2017Asymmetric Actor Critic for Image-Based Robot Learningcited by 238
  10. 2017Reverse Curriculum Generation for Reinforcement Learningcited by 198
  11. 2021A System for General In-Hand Object Re-Orientationcited by 165
  12. 2023AnyTeleop: A General Vision-Based Dexterous Robot Arm-Hand Teleoperation Systemcited by 152
18 more
  1. 2022Visual Dexterity: In-Hand Reorientation of Novel and Complex Object Shapescited by 101
  2. 2026EgoScale: Scaling Dexterous Manipulation with Diverse Egocentric Human Datacited by 94
  3. 2022DexPoint: Generalizable Point Cloud Reinforcement Learning for Sim-to-Real Dexterous Manipulationcited by 84
  4. 2023Rotating without Seeing: Towards In-hand Dexterity through Touchcited by 84
  5. 2024Bunny-VisionPro: Real-Time Bimanual Dexterous Teleoperation for Imitation Learningcited by 77
  6. 2021Synthesizing Diverse and Physically Stable Grasps with Arbitrary Hand Structures using Differentiable Force Closure Estimatorcited by 71
  7. 2025ManipTrans: Efficient Dexterous Bimanual Manipulation Transfer via Residual Learningcited by 66
  8. 2022GenDexGrasp: Generalizable Dexterous Graspingcited by 56
  9. 2018Learning Task-Oriented Grasping for Tool Manipulation from Simulated Self-Supervisioncited by 52
  10. 2023Sequential Dexterity: Chaining Dexterous Policies for Long-Horizon Manipulationcited by 49
  11. 2024Twisting Lids Off with Two Handscited by 42
  12. 2024Object-Centric Dexterous Manipulation from Human Motion Datacited by 41
  13. 2025Crossing the Human-Robot Embodiment Gap with Sim-to-Real RL using One Human Demonstrationcited by 34
  14. 2022Complex In-Hand Manipulation via Compliance-Enabled Finger Gaiting and Multi-Modal Planningcited by 26
  15. 2026mjlab: A Lightweight Framework for GPU-Accelerated Robot Learningcited by 26
  16. 2022Learning High-DOF Reaching-and-Grasping via Dynamic Representation of Gripper-Object Interactioncited by 24
  17. 2023Sampling-based Exploration for Reinforcement Learning of Dexterous Manipulationcited by 24
  18. 2022DA2 Dataset: Toward Dexterity-Aware Dual-Arm Graspingcited by 11

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Learning Dexterous Manipulation Using Contact Wrench Guidance From Human Demonstration
  2. 2025Hierarchical Reinforcement Learning for Articulated Tool Manipulation with Multifingered Hand
  3. 2025Learning Dexterous Manipulation Skills from Imperfect Simulations
  4. 2024Dexterous Manipulation Based on Prior Dexterous Grasp Pose Knowledge
  5. 2026A Minimalist Retargeting-Guided Reinforcement Learning Recipe for Dexterous Manipulation
  6. 2026Learning Stable In-Grasp Manipulation in a Non-Dropping Action Space ↗
  7. 2025Dexterous Manipulation through Imitation Learning: A Survey
  8. 2026DexTaG: Tactile-as-Guidance in Reinforcement Learning for Dexterous Manipulation