Maintaining Grasps within Slipping Bound by Monitoring Incipient Slip
Not on the map. Why?
Abstract (arXiv)
In this paper, we propose an approach to detect incipient slip, i.e. predict slip, by using a high-resolution vision-based tactile sensor, GelSlim. The sensor dynamically captures the tactile imprints of the contact object and their changes with a soft gel pad. The method assumes the object is mostly rigid and treats the motion of object's imprint on sensor surface as a 2D rigid-body motion. We use the deviation of the true motion field from that of a 2D planar rigid transformation as a measure of slip. The output is a dense slip field which we use to detect when small areas of the contact patch start to slip (incipient slip). The method can detect both translational and rotational incipient slip without any prior knowledge of the object at 24 Hz. We test the method on 10 objects 240 times and achieve 86.25% detection accuracy. We further show how the slip feedback can be used to monitor the gripping force to avoid slip with a closed-loop bottle-cap screwing and unscrewing experiment with incipient slip detection feedback. The method was demonstrated to be useful for the robot to apply proper gripping force and stop screwing at the right point before breaking objects. The method can be applied to many manipulation tasks in both structured and unstructured environments.
Key facts. Cited by 16 papers in the map (data through 7 Oct 2026). First posted on arXiv 31 Oct 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 4; 2022: 1; 2023: 4; 2024: 3; 2025: 2; 2026: 2.
16 papers.
Sort:
- 2021GelSight Wedge: Measuring High-Resolution 3D Contact Geometry with a Compact Robot Fingercited by 34
- 2021SwingBot: Learning Physical Features from In-hand Tactile Exploration for Dynamic Swing-up Manipulationcited by 24
- 2023Evetac: An Event-based Optical Tactile Sensor for Robotic Manipulationcited by 12
- 2024FeelAnyForce: Estimating Contact Force Feedback from Tactile Sensation for Vision-Based Tactile Sensorscited by 11
- 2021Dynamic Modeling of Hand-Object Interactions via Tactile Sensingcited by 8
- 2025Sensor-Invariant Tactile Representationcited by 8
- 2023Learning to Detect Slip through Tactile Estimation of the Contact Force Field and its Entropycited by 4
- 2023Tactile-Filter: Interactive Tactile Perception for Part Matingcited by 4
- 2024LeTac-MPC: Learning Model Predictive Control for Tactile-reactive Graspingcited by 4
- 2022Learning to Detect Slip with Barometric Tactile Sensors and a Temporal Convolutional Neural Networkcited by 1
- 2023Robust Learning-Based Incipient Slip Detection using the PapillArray Optical Tactile Sensor for Improved Robotic Grippingcited by 1
- 2024Learning Gentle Grasping from Human-Free Force Control Demonstrationcited by 1
4 more
- 2021Under Pressure: Learning to Detect Slip with Barometric Tactile Sensorscited by 0
- 2025Learning Pivoting Manipulation with Force and Vision Feedback Using Optimization-based Demonstrationscited by 0
- 2026Tac2Pix: Image-Space Visuo-Tactile Fusion for Dexterous Manipulationcited by 0
- 2026SlipSense: Multimodal Tactile Learning for Low-Latency and Generalized Slip Detectioncited by 0
- 2026SlipSense: Multimodal Tactile Learning for Low-Latency and Generalized Slip Detection14 Sep 2026
- 2026Tac2Pix: Image-Space Visuo-Tactile Fusion for Dexterous Manipulation7 Jun 2026
- 2025Learning Pivoting Manipulation with Force and Vision Feedback Using Optimization-based Demonstrations1 Aug 2025
- 2025Sensor-Invariant Tactile Representation27 Feb 2025
- 2024FeelAnyForce: Estimating Contact Force Feedback from Tactile Sensation for Vision-Based Tactile Sensors2 Oct 2024
- 2024Learning Gentle Grasping from Human-Free Force Control Demonstration16 Sep 2024
- 2024LeTac-MPC: Learning Model Predictive Control for Tactile-reactive Grasping7 Mar 2024
- 2023Evetac: An Event-based Optical Tactile Sensor for Robotic Manipulation2 Dec 2023
- 2023Robust Learning-Based Incipient Slip Detection using the PapillArray Optical Tactile Sensor for Improved Robotic Gripping8 Jul 2023
- 2023Tactile-Filter: Interactive Tactile Perception for Part Mating10 Mar 2023
- 2023Learning to Detect Slip through Tactile Estimation of the Contact Force Field and its Entropy2 Mar 2023
- 2022Learning to Detect Slip with Barometric Tactile Sensors and a Temporal Convolutional Neural Network19 Feb 2022
4 more
- 2021Dynamic Modeling of Hand-Object Interactions via Tactile Sensing9 Sep 2021
- 2021GelSight Wedge: Measuring High-Resolution 3D Contact Geometry with a Compact Robot Finger16 Jun 2021
- 2021Under Pressure: Learning to Detect Slip with Barometric Tactile Sensors24 Mar 2021
- 2021SwingBot: Learning Physical Features from In-hand Tactile Exploration for Dynamic Swing-up Manipulation28 Jan 2021
- 2021GelSight Wedge: Measuring High-Resolution 3D Contact Geometry with a Compact Robot Fingercited by 34
- 2021SwingBot: Learning Physical Features from In-hand Tactile Exploration for Dynamic Swing-up Manipulationcited by 24
- 2023Evetac: An Event-based Optical Tactile Sensor for Robotic Manipulationcited by 12
- 2024FeelAnyForce: Estimating Contact Force Feedback from Tactile Sensation for Vision-Based Tactile Sensorscited by 11
- 2021Dynamic Modeling of Hand-Object Interactions via Tactile Sensingcited by 8
- 2025Sensor-Invariant Tactile Representationcited by 8
- 2023Learning to Detect Slip through Tactile Estimation of the Contact Force Field and its Entropycited by 4
- 2023Tactile-Filter: Interactive Tactile Perception for Part Matingcited by 4
- 2024LeTac-MPC: Learning Model Predictive Control for Tactile-reactive Graspingcited by 4
- 2022Learning to Detect Slip with Barometric Tactile Sensors and a Temporal Convolutional Neural Networkcited by 1
- 2023Robust Learning-Based Incipient Slip Detection using the PapillArray Optical Tactile Sensor for Improved Robotic Grippingcited by 1
- 2024Learning Gentle Grasping from Human-Free Force Control Demonstrationcited by 1
12 most cited of 16 All 16 (JSON)
- 2026SlipSense: Multimodal Tactile Learning for Low-Latency and Generalized Slip Detection14 Sep 2026
- 2026Tac2Pix: Image-Space Visuo-Tactile Fusion for Dexterous Manipulation7 Jun 2026
- 2025Learning Pivoting Manipulation with Force and Vision Feedback Using Optimization-based Demonstrations1 Aug 2025
- 2025Sensor-Invariant Tactile Representation27 Feb 2025
- 2024FeelAnyForce: Estimating Contact Force Feedback from Tactile Sensation for Vision-Based Tactile Sensors2 Oct 2024
- 2024Learning Gentle Grasping from Human-Free Force Control Demonstration16 Sep 2024
- 2024LeTac-MPC: Learning Model Predictive Control for Tactile-reactive Grasping7 Mar 2024
- 2023Evetac: An Event-based Optical Tactile Sensor for Robotic Manipulation2 Dec 2023
- 2023Robust Learning-Based Incipient Slip Detection using the PapillArray Optical Tactile Sensor for Improved Robotic Gripping8 Jul 2023
- 2023Tactile-Filter: Interactive Tactile Perception for Part Mating10 Mar 2023
- 2023Learning to Detect Slip through Tactile Estimation of the Contact Force Field and its Entropy2 Mar 2023
- 2022Learning to Detect Slip with Barometric Tactile Sensors and a Temporal Convolutional Neural Network19 Feb 2022
12 newest of 16 All 16 (JSON)