Tactile Dexterity: Manipulation Primitives with Tactile Feedback
Not on the map. Why?
Abstract (arXiv)
This paper develops closed-loop tactile controllers for dexterous robotic manipulation with a dual-palm robotic system. Tactile dexterity is an approach to dexterous manipulation that plans for robot/object interactions that render interpretable tactile information for control. We divide the role of tactile control into two goals: 1) control the contact state between the end-effector and the object (contact/no-contact, stick/slip) by regulating the stability of planned contact configurations and monitoring undesired slip events; and 2) control the object state by tactile-based tracking and iterative replanning of the object and robot trajectories. Key to this formulation is the decomposition of manipulation plans into sequences of manipulation primitives with simple mechanics and efficient planners. We consider the scenario of manipulating an object from an initial pose to a target pose on a flat surface while correcting for external perturbations and uncertainty in the initial pose of the object. We experimentally validate the approach with an ABB YuMi dual-arm robot and demonstrate the ability of the tactile controller to react to external perturbations.
Key facts. Cited by 21 papers in the map (data through 7 Oct 2026). First posted on arXiv 8 Feb 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 2; 2022: 3; 2023: 4; 2024: 5; 2025: 5; 2026: 2.
21 papers.
Sort:
By area:
- 2023Rotating without Seeing: Towards In-hand Dexterity through Touchcited by 78
- 2021GelSight Wedge: Measuring High-Resolution 3D Contact Geometry with a Compact Robot Fingercited by 34
- 2024Multimodal Visual-Tactile Representation Learning through Self-Supervised Contrastive Pre-Trainingcited by 30
- 2023The Power of the Senses: Generalizable Manipulation from Vision and Touch through Masked Multimodal Learningcited by 24
- 2021Zero-shot sim-to-real transfer of tactile control policies for aggressive swing-up manipulationcited by 13
- 2025Touch begins where vision ends: Generalizable policies for contact-rich manipulationcited by 13
- 2024FeelAnyForce: Estimating Contact Force Feedback from Tactile Sensation for Vision-Based Tactile Sensorscited by 11
- 2022Robust Pivoting: Exploiting Frictional Stability Using Bilevel Optimizationcited by 8
- 2022Action Conditioned Tactile Prediction: case study on slip predictioncited by 8
- 2025Sensor-Invariant Tactile Representationcited by 8
- 2024M2CURL: Sample-Efficient Multimodal Reinforcement Learning via Self-Supervised Representation Learning for Robotic Manipulationcited by 7
- 2025Taccel: Scaling Up Vision-based Tactile Robotics via High-performance GPU Simulationcited by 6
9 more
- 2023Tactile-Filter: Interactive Tactile Perception for Part Matingcited by 4
- 2024LeTac-MPC: Learning Model Predictive Control for Tactile-reactive Graspingcited by 4
- 2022Learning to Synthesize Volumetric Meshes from Vision-based Tactile Imprintscited by 3
- 2023Robust Pivoting Manipulation using Contact Implicit Bilevel Optimizationcited by 3
- 2025VTAO-BiManip: Masked Visual-Tactile-Action Pre-training with Object Understanding for Bimanual Dexterous Manipulationcited by 2
- 2024Behavioral Learning of Dish Rinsing and Scrubbing based on Interruptive Direct Teaching Considering Assistance Ratecited by 1
- 2026TacPAC: Tactile Prediction and Real-Time Action Correction in World-Action Models for Contact-Rich Manipulationcited by 1
- 2025Learning Pivoting Manipulation with Force and Vision Feedback Using Optimization-based Demonstrationscited by 0
- 2026Unified Visual-Tactile-Action Modeling from Human Demonstrations for Dexterous Manipulationcited by 0
- 2026Unified Visual-Tactile-Action Modeling from Human Demonstrations for Dexterous Manipulation28 Sep 2026
- 2026TacPAC: Tactile Prediction and Real-Time Action Correction in World-Action Models for Contact-Rich Manipulation4 Sep 2026
- 2025Learning Pivoting Manipulation with Force and Vision Feedback Using Optimization-based Demonstrations1 Aug 2025
- 2025Touch begins where vision ends: Generalizable policies for contact-rich manipulation16 Jun 2025
- 2025Taccel: Scaling Up Vision-based Tactile Robotics via High-performance GPU Simulation17 Apr 2025
- 2025Sensor-Invariant Tactile Representation27 Feb 2025
- 2025VTAO-BiManip: Masked Visual-Tactile-Action Pre-training with Object Understanding for Bimanual Dexterous Manipulation7 Jan 2025
- 2024FeelAnyForce: Estimating Contact Force Feedback from Tactile Sensation for Vision-Based Tactile Sensors2 Oct 2024
- 2024Behavioral Learning of Dish Rinsing and Scrubbing based on Interruptive Direct Teaching Considering Assistance Rate18 Aug 2024
- 2024LeTac-MPC: Learning Model Predictive Control for Tactile-reactive Grasping7 Mar 2024
- 2024M2CURL: Sample-Efficient Multimodal Reinforcement Learning via Self-Supervised Representation Learning for Robotic Manipulation30 Jan 2024
- 2024Multimodal Visual-Tactile Representation Learning through Self-Supervised Contrastive Pre-Training22 Jan 2024
9 more
- 2023The Power of the Senses: Generalizable Manipulation from Vision and Touch through Masked Multimodal Learning2 Nov 2023
- 2023Rotating without Seeing: Towards In-hand Dexterity through Touch20 Mar 2023
- 2023Robust Pivoting Manipulation using Contact Implicit Bilevel Optimization15 Mar 2023
- 2023Tactile-Filter: Interactive Tactile Perception for Part Mating10 Mar 2023
- 2022Action Conditioned Tactile Prediction: case study on slip prediction19 May 2022
- 2022Learning to Synthesize Volumetric Meshes from Vision-based Tactile Imprints29 Mar 2022
- 2022Robust Pivoting: Exploiting Frictional Stability Using Bilevel Optimization22 Mar 2022
- 2021GelSight Wedge: Measuring High-Resolution 3D Contact Geometry with a Compact Robot Finger16 Jun 2021
- 2021Zero-shot sim-to-real transfer of tactile control policies for aggressive swing-up manipulation7 Jan 2021
- 2023Rotating without Seeing: Towards In-hand Dexterity through Touchcited by 78
- 2021GelSight Wedge: Measuring High-Resolution 3D Contact Geometry with a Compact Robot Fingercited by 34
- 2024Multimodal Visual-Tactile Representation Learning through Self-Supervised Contrastive Pre-Trainingcited by 30
- 2023The Power of the Senses: Generalizable Manipulation from Vision and Touch through Masked Multimodal Learningcited by 24
- 2021Zero-shot sim-to-real transfer of tactile control policies for aggressive swing-up manipulationcited by 13
- 2024FeelAnyForce: Estimating Contact Force Feedback from Tactile Sensation for Vision-Based Tactile Sensorscited by 11
- 2022Robust Pivoting: Exploiting Frictional Stability Using Bilevel Optimizationcited by 8
- 2022Action Conditioned Tactile Prediction: case study on slip predictioncited by 8
- 2025Sensor-Invariant Tactile Representationcited by 8
- 2024M2CURL: Sample-Efficient Multimodal Reinforcement Learning via Self-Supervised Representation Learning for Robotic Manipulationcited by 7
- 2025Taccel: Scaling Up Vision-based Tactile Robotics via High-performance GPU Simulationcited by 6
- 2023Tactile-Filter: Interactive Tactile Perception for Part Matingcited by 4
12 most cited of 19 All 19 (JSON)
- 2026Unified Visual-Tactile-Action Modeling from Human Demonstrations for Dexterous Manipulation28 Sep 2026
- 2025Learning Pivoting Manipulation with Force and Vision Feedback Using Optimization-based Demonstrations1 Aug 2025
- 2025Taccel: Scaling Up Vision-based Tactile Robotics via High-performance GPU Simulation17 Apr 2025
- 2025Sensor-Invariant Tactile Representation27 Feb 2025
- 2025VTAO-BiManip: Masked Visual-Tactile-Action Pre-training with Object Understanding for Bimanual Dexterous Manipulation7 Jan 2025
- 2024FeelAnyForce: Estimating Contact Force Feedback from Tactile Sensation for Vision-Based Tactile Sensors2 Oct 2024
- 2024Behavioral Learning of Dish Rinsing and Scrubbing based on Interruptive Direct Teaching Considering Assistance Rate18 Aug 2024
- 2024LeTac-MPC: Learning Model Predictive Control for Tactile-reactive Grasping7 Mar 2024
- 2024M2CURL: Sample-Efficient Multimodal Reinforcement Learning via Self-Supervised Representation Learning for Robotic Manipulation30 Jan 2024
- 2024Multimodal Visual-Tactile Representation Learning through Self-Supervised Contrastive Pre-Training22 Jan 2024
- 2023The Power of the Senses: Generalizable Manipulation from Vision and Touch through Masked Multimodal Learning2 Nov 2023
- 2023Rotating without Seeing: Towards In-hand Dexterity through Touch20 Mar 2023
12 newest of 19 All 19 (JSON)