Active Extrinsic Contact Sensing: Application to General Peg-in-Hole Insertion
Not on the map. Why?
Abstract (arXiv)
We propose a method that actively estimates contact location between a grasped rigid object and its environment and uses this as input to a peg-in-hole insertion policy. An estimation model and an active tactile feedback controller work collaboratively to estimate the external contacts accurately. The controller helps the estimation model get a better estimate by regulating a consistent contact mode. The better estimation makes it easier for the controller to regulate the contact. We then train an object-agnostic insertion policy that learns to use the series of contact estimates to guide the insertion of an unseen peg into a hole. In contrast with previous works that learn a policy directly from tactile signals, since this policy is in contact configuration space, it can be learned directly in simulation. Lastly, we demonstrate and evaluate the active extrinsic contact line estimation and the trained insertion policy together in a real experiment. We show that the proposed method inserts various-shaped test objects with higher success rates and fewer insertion attempts than previous work with end-to-end approaches. See supplementary video and results at https://sites.google.com/view/active-extrinsic-contact.
Key facts. Cited by 16 papers in the map (data through 7 Oct 2026). First posted on arXiv 7 Oct 2021.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2022: 1; 2023: 4; 2024: 4; 2025: 4; 2026: 3.
16 papers.
Sort:
By area:
- 2023MimicTouch: Leveraging Multi-modal Human Tactile Demonstrations for Contact-rich Manipulationcited by 30
- 2023The Power of the Senses: Generalizable Manipulation from Vision and Touch through Masked Multimodal Learningcited by 24
- 2024AnySkin: Plug-and-play Skin Sensing for Robotic Touchcited by 22
- 2022Tac2Pose: Tactile Object Pose Estimation from the First Touchcited by 14
- 2024Learning Precise, Contact-Rich Manipulation through Uncalibrated Tactile Skinscited by 11
- 2024Built Different: Tactile Perception to Overcome Cross-Embodiment Capability Differences in Collaborative Manipulationcited by 6
- 2024LeTac-MPC: Learning Model Predictive Control for Tactile-reactive Graspingcited by 4
- 2023Integrated Object Deformation and Contact Patch Estimation from Visuo-Tactile Feedbackcited by 3
- 2025DexSkin: High-Coverage Conformable Robotic Skin for Learning Contact-Rich Manipulationcited by 2
- 2025Cross-Sensor Touch Generationcited by 2
- 2023Tactile Estimation of Extrinsic Contact Patch for Stable Placementcited by 1
- 2026OmniTacTune: Policy-Agnostic Real-World RL for Tactile Residual Adaptation of Visual Policiescited by 1
4 more
- 2025Object Pose Estimation through Dexterous Touchcited by 0
- 2025TranTac: Leveraging Transient Tactile Signals for Contact-Rich Robotic Manipulationcited by 0
- 2026SI-Diff: A Framework for Learning Search and High-Precision Insertion with a Force-Domain Diffusion Policycited by 0
- 2026Proprioception-Anchored Cross-Modal Pretraining for Zero-Shot Sim-to-Real Contact-Rich Assemblycited by 0
- 2026Proprioception-Anchored Cross-Modal Pretraining for Zero-Shot Sim-to-Real Contact-Rich Assembly7 Sep 2026
- 2026OmniTacTune: Policy-Agnostic Real-World RL for Tactile Residual Adaptation of Visual Policies4 Jul 2026
- 2026SI-Diff: A Framework for Learning Search and High-Precision Insertion with a Force-Domain Diffusion Policy12 May 2026
- 2025Cross-Sensor Touch Generation10 Oct 2025
- 2025DexSkin: High-Coverage Conformable Robotic Skin for Learning Contact-Rich Manipulation23 Sep 2025
- 2025TranTac: Leveraging Transient Tactile Signals for Contact-Rich Robotic Manipulation20 Sep 2025
- 2025Object Pose Estimation through Dexterous Touch16 Sep 2025
- 2024Learning Precise, Contact-Rich Manipulation through Uncalibrated Tactile Skins22 Oct 2024
- 2024Built Different: Tactile Perception to Overcome Cross-Embodiment Capability Differences in Collaborative Manipulation23 Sep 2024
- 2024AnySkin: Plug-and-play Skin Sensing for Robotic Touch12 Sep 2024
- 2024LeTac-MPC: Learning Model Predictive Control for Tactile-reactive Grasping7 Mar 2024
- 2023The Power of the Senses: Generalizable Manipulation from Vision and Touch through Masked Multimodal Learning2 Nov 2023
4 more
- 2023MimicTouch: Leveraging Multi-modal Human Tactile Demonstrations for Contact-rich Manipulation25 Oct 2023
- 2023Tactile Estimation of Extrinsic Contact Patch for Stable Placement25 Sep 2023
- 2023Integrated Object Deformation and Contact Patch Estimation from Visuo-Tactile Feedback23 May 2023
- 2022Tac2Pose: Tactile Object Pose Estimation from the First Touch25 Apr 2022
- 2023MimicTouch: Leveraging Multi-modal Human Tactile Demonstrations for Contact-rich Manipulationcited by 30
- 2023The Power of the Senses: Generalizable Manipulation from Vision and Touch through Masked Multimodal Learningcited by 24
- 2024AnySkin: Plug-and-play Skin Sensing for Robotic Touchcited by 22
- 2022Tac2Pose: Tactile Object Pose Estimation from the First Touchcited by 14
- 2024Learning Precise, Contact-Rich Manipulation through Uncalibrated Tactile Skinscited by 11
- 2024Built Different: Tactile Perception to Overcome Cross-Embodiment Capability Differences in Collaborative Manipulationcited by 6
- 2024LeTac-MPC: Learning Model Predictive Control for Tactile-reactive Graspingcited by 4
- 2023Integrated Object Deformation and Contact Patch Estimation from Visuo-Tactile Feedbackcited by 3
- 2025DexSkin: High-Coverage Conformable Robotic Skin for Learning Contact-Rich Manipulationcited by 2
- 2025Cross-Sensor Touch Generationcited by 2
- 2023Tactile Estimation of Extrinsic Contact Patch for Stable Placementcited by 1
- 2026OmniTacTune: Policy-Agnostic Real-World RL for Tactile Residual Adaptation of Visual Policiescited by 1
12 most cited of 15 All 15 (JSON)
- 2026Proprioception-Anchored Cross-Modal Pretraining for Zero-Shot Sim-to-Real Contact-Rich Assembly7 Sep 2026
- 2026OmniTacTune: Policy-Agnostic Real-World RL for Tactile Residual Adaptation of Visual Policies4 Jul 2026
- 2025Cross-Sensor Touch Generation10 Oct 2025
- 2025DexSkin: High-Coverage Conformable Robotic Skin for Learning Contact-Rich Manipulation23 Sep 2025
- 2025TranTac: Leveraging Transient Tactile Signals for Contact-Rich Robotic Manipulation20 Sep 2025
- 2025Object Pose Estimation through Dexterous Touch16 Sep 2025
- 2024Learning Precise, Contact-Rich Manipulation through Uncalibrated Tactile Skins22 Oct 2024
- 2024Built Different: Tactile Perception to Overcome Cross-Embodiment Capability Differences in Collaborative Manipulation23 Sep 2024
- 2024AnySkin: Plug-and-play Skin Sensing for Robotic Touch12 Sep 2024
- 2024LeTac-MPC: Learning Model Predictive Control for Tactile-reactive Grasping7 Mar 2024
- 2023The Power of the Senses: Generalizable Manipulation from Vision and Touch through Masked Multimodal Learning2 Nov 2023
- 2023MimicTouch: Leveraging Multi-modal Human Tactile Demonstrations for Contact-rich Manipulation25 Oct 2023
12 newest of 15 All 15 (JSON)