GelSight Wedge: Measuring High-Resolution 3D Contact Geometry with a Compact Robot Finger
Not on the map. Why?
Abstract (arXiv)
Vision-based tactile sensors have the potential to provide important contact geometry to localize the objective with visual occlusion. However, it is challenging to measure high-resolution 3D contact geometry for a compact robot finger, to simultaneously meet optical and mechanical constraints. In this work, we present the GelSight Wedge sensor, which is optimized to have a compact shape for robot fingers, while achieving high-resolution 3D reconstruction. We evaluate the 3D reconstruction under different lighting configurations, and extend the method from 3 lights to 1 or 2 lights. We demonstrate the flexibility of the design by shrinking the sensor to the size of a human finger for fine manipulation tasks. We also show the effectiveness and potential of the reconstructed 3D geometry for pose tracking in the 3D space.
Key facts. Cited by 34 papers in the map (data through 7 Oct 2026). Builds on 20 of its 30 references that are in the map. First posted on arXiv 16 Jun 2021.
Builds on
20 of 30 references.
References · 20
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2018Open3D: A Modern Library for 3D Data Processingcited by 717
- 2020DIGIT: A Novel Design for a Low-Cost Compact High-Resolution Tactile Sensor with Application to In-Hand Manipulationcited by 164
- 2018More Than a Feeling: Learning to Grasp and Regrasp using Vision and Touchcited by 100
- 2018GelSlim: A High-Resolution, Compact, Robust, and Calibrated Tactile-sensing Fingercited by 50
- 2019Cable Manipulation with a Tactile-Reactive Grippercited by 44
- 2019Manipulation by Feel: Touch-Based Control with Deep Predictive Modelscited by 34
- 2017Active Clothing Material Perception using Tactile Sensing and Deep Learningcited by 29
- 2017Improved GelSight Tactile Sensor for Measuring Geometry and Slipcited by 27
- 2020OmniTact: A Multi-Directional High Resolution Touch Sensorcited by 27
- 2020Tactile Dexterity: Manipulation Primitives with Tactile Feedbackcited by 21
- 2017Shape-independent Hardness Estimation Using Deep Learning and a GelSight Tactile Sensorcited by 19
8 more
- 2019Tactile Mapping and Localization from High-Resolution Tactile Imprintscited by 19
- 2018Maintaining Grasps within Slipping Bound by Monitoring Incipient Slipcited by 16
- 2019Soft-bubble: A highly compliant dense geometry tactile sensor for robot manipulationcited by 15
- 2018Tactile Regrasp: Grasp Adjustments via Simulated Tactile Transformationscited by 12
- 2018From pixels to percepts: Highly robust edge perception and contour following using deep learning and an optical biomimetic tactile sensorcited by 12
- 2020Soft, Round, High Resolution Tactile Fingertip Sensors for Dexterous Robotic Manipulationcited by 8
- 2020Learning the sense of touch in simulation: a sim-to-real strategy for vision-based tactile sensingcited by 7
- 2019Exoskeleton-covered soft finger with vision-based proprioception and tactile sensingcited by 1
Built on by
Citing papers per year: 2021: 1; 2022: 2; 2023: 9; 2024: 6; 2025: 8; 2026: 8.
34 papers.
Sort:
By area:
- 2024Aligning Cyber Space with Physical World: A Comprehensive Survey on Embodied AIcited by 175
- 2022See, Hear, and Feel: Smart Sensory Fusion for Robotic Manipulationcited by 61
- 2023Dexterity from Touch: Self-Supervised Pre-Training of Tactile Representations with Robotic Playcited by 60
- 2024Transferable Tactile Transformers for Representation Learning Across Diverse Sensors and Taskscited by 44
- 2021ReSkin: versatile, replaceable, lasting tactile skinscited by 33
- 2023See to Touch: Learning Tactile Dexterity through Visual Incentivescited by 33
- 2023Neural feels with neural fields: Visuo-tactile perception for in-hand manipulationcited by 28
- 2024AnySkin: Plug-and-play Skin Sensing for Robotic Touchcited by 22
- 2022Visuotactile Affordances for Cloth Manipulation with Local Controlcited by 20
- 2026TacVLA: Contact-Aware Tactile Fusion for Robust Vision-Language-Action Manipulationcited by 17
- 2023Visual-Tactile Sensing for In-Hand Object Reconstructioncited by 13
- 2023FingerSLAM: Closed-loop Unknown Object Localization and Reconstruction from Visuo-tactile Feedbackcited by 12
22 more
- 2023GelSight Svelte: A Human Finger-shaped Single-camera Tactile Robot Finger with Large Sensing Coverage and Proprioceptive Sensingcited by 10
- 2025VT-Refine: Learning Bimanual Assembly with Visuo-Tactile Feedback via Simulation Fine-Tuningcited by 10
- 2023Controllable Visual-Tactile Synthesiscited by 8
- 2025Sensor-Invariant Tactile Representationcited by 8
- 2024Tactile DreamFusion: Exploiting Tactile Sensing for 3D Generationcited by 6
- 2025GelSLAM: A Real-time, High-Fidelity, and Robust 3D Tactile SLAM Systemcited by 6
- 2024LeTac-MPC: Learning Model Predictive Control for Tactile-reactive Graspingcited by 4
- 2025eFlesh: Highly customizable Magnetic Touch Sensing using Cut-Cell Microstructurescited by 4
- 2025Reactive In-Air Clothing Manipulation with Confidence-Aware Dense Correspondence and Visuotactile Affordancecited by 4
- 2024FusionSense: Bridging Common Sense, Vision, and Touch for Robust Sparse-View Reconstructioncited by 2
- 2025GelBelt: A Vision-based Tactile Sensor for Continuous Sensing of Large Surfacescited by 2
- 2025Enhance Vision-based Tactile Sensors via Dynamic Illumination and Image Fusioncited by 1
- 2026TouchAnything: Diffusion-Guided 3D Reconstruction from Sparse Robot Touchescited by 1
- 2023Towards Design and Development of an ArUco Markers-Based Quantitative Surface Tactile Sensorcited by 0
- 2023Tactile Active Inference Reinforcement Learning for Efficient Robotic Manipulation Skill Acquisitioncited by 0
- 2025A Modularized Design Approach for GelSight Family of Vision-based Tactile Sensorscited by 0
- 2026Monocular Reconstruction of Neural Tactile Fieldscited by 0
- 2026ViTac-Tracing: Visual-Tactile Imitation Learning of Deformable Object Tracingcited by 0
- 2026Transparent Fragments Contour Estimation via Visual-Tactile Fusion for Autonomous Reassemblycited by 0
- 2026Reduced-order Neural Modeling with Differentiable Simulation for High-Detail Tactile Perceptioncited by 0
- 2026Text-based Tactile Graphics Generation for the Visually Impairedcited by 0
- 2026Calibration-Free Surface Normals Estimation in Vision-Based Tactile Sensing using Universal Photometric Stereocited by 0
- 2026Calibration-Free Surface Normals Estimation in Vision-Based Tactile Sensing using Universal Photometric Stereo23 Sep 2026
- 2026Text-based Tactile Graphics Generation for the Visually Impaired10 Jul 2026
- 2026Reduced-order Neural Modeling with Differentiable Simulation for High-Detail Tactile Perception6 May 2026
- 2026TouchAnything: Diffusion-Guided 3D Reconstruction from Sparse Robot Touches10 Apr 2026
- 2026ViTac-Tracing: Visual-Tactile Imitation Learning of Deformable Object Tracing19 Mar 2026
- 2026Transparent Fragments Contour Estimation via Visual-Tactile Fusion for Autonomous Reassembly18 Mar 2026
- 2026TacVLA: Contact-Aware Tactile Fusion for Robust Vision-Language-Action Manipulation13 Mar 2026
- 2026Monocular Reconstruction of Neural Tactile Fields13 Feb 2026
- 2025VT-Refine: Learning Bimanual Assembly with Visuo-Tactile Feedback via Simulation Fine-Tuning16 Oct 2025
- 2025Reactive In-Air Clothing Manipulation with Confidence-Aware Dense Correspondence and Visuotactile Affordance4 Sep 2025
- 2025GelSLAM: A Real-time, High-Fidelity, and Robust 3D Tactile SLAM System21 Aug 2025
- 2025eFlesh: Highly customizable Magnetic Touch Sensing using Cut-Cell Microstructures11 Jun 2025
22 more
- 2025A Modularized Design Approach for GelSight Family of Vision-based Tactile Sensors20 Apr 2025
- 2025Enhance Vision-based Tactile Sensors via Dynamic Illumination and Image Fusion27 Mar 2025
- 2025Sensor-Invariant Tactile Representation27 Feb 2025
- 2025GelBelt: A Vision-based Tactile Sensor for Continuous Sensing of Large Surfaces9 Jan 2025
- 2024Tactile DreamFusion: Exploiting Tactile Sensing for 3D Generation9 Dec 2024
- 2024FusionSense: Bridging Common Sense, Vision, and Touch for Robust Sparse-View Reconstruction10 Oct 2024
- 2024AnySkin: Plug-and-play Skin Sensing for Robotic Touch12 Sep 2024
- 2024Aligning Cyber Space with Physical World: A Comprehensive Survey on Embodied AI9 Jul 2024
- 2024Transferable Tactile Transformers for Representation Learning Across Diverse Sensors and Tasks19 Jun 2024
- 2024LeTac-MPC: Learning Model Predictive Control for Tactile-reactive Grasping7 Mar 2024
- 2023Neural feels with neural fields: Visuo-tactile perception for in-hand manipulation20 Dec 2023
- 2023Tactile Active Inference Reinforcement Learning for Efficient Robotic Manipulation Skill Acquisition19 Nov 2023
- 2023Towards Design and Development of an ArUco Markers-Based Quantitative Surface Tactile Sensor12 Oct 2023
- 2023See to Touch: Learning Tactile Dexterity through Visual Incentives21 Sep 2023
- 2023GelSight Svelte: A Human Finger-shaped Single-camera Tactile Robot Finger with Large Sensing Coverage and Proprioceptive Sensing19 Sep 2023
- 2023Controllable Visual-Tactile Synthesis4 May 2023
- 2023Visual-Tactile Sensing for In-Hand Object Reconstruction25 Mar 2023
- 2023Dexterity from Touch: Self-Supervised Pre-Training of Tactile Representations with Robotic Play21 Mar 2023
- 2023FingerSLAM: Closed-loop Unknown Object Localization and Reconstruction from Visuo-tactile Feedback14 Mar 2023
- 2022Visuotactile Affordances for Cloth Manipulation with Local Control9 Dec 2022
- 2022See, Hear, and Feel: Smart Sensory Fusion for Robotic Manipulation7 Dec 2022
- 2021ReSkin: versatile, replaceable, lasting tactile skins29 Oct 2021
- 2024Aligning Cyber Space with Physical World: A Comprehensive Survey on Embodied AIcited by 175
- 2022See, Hear, and Feel: Smart Sensory Fusion for Robotic Manipulationcited by 61
- 2023Dexterity from Touch: Self-Supervised Pre-Training of Tactile Representations with Robotic Playcited by 60
- 2024Transferable Tactile Transformers for Representation Learning Across Diverse Sensors and Taskscited by 44
- 2021ReSkin: versatile, replaceable, lasting tactile skinscited by 33
- 2023See to Touch: Learning Tactile Dexterity through Visual Incentivescited by 33
- 2023Neural feels with neural fields: Visuo-tactile perception for in-hand manipulationcited by 28
- 2024AnySkin: Plug-and-play Skin Sensing for Robotic Touchcited by 22
- 2022Visuotactile Affordances for Cloth Manipulation with Local Controlcited by 20
- 2023Visual-Tactile Sensing for In-Hand Object Reconstructioncited by 13
- 2023FingerSLAM: Closed-loop Unknown Object Localization and Reconstruction from Visuo-tactile Feedbackcited by 12
- 2023GelSight Svelte: A Human Finger-shaped Single-camera Tactile Robot Finger with Large Sensing Coverage and Proprioceptive Sensingcited by 10
12 most cited of 30 All 30 (JSON)
- 2026Calibration-Free Surface Normals Estimation in Vision-Based Tactile Sensing using Universal Photometric Stereo23 Sep 2026
- 2026Text-based Tactile Graphics Generation for the Visually Impaired10 Jul 2026
- 2026Reduced-order Neural Modeling with Differentiable Simulation for High-Detail Tactile Perception6 May 2026
- 2026Transparent Fragments Contour Estimation via Visual-Tactile Fusion for Autonomous Reassembly18 Mar 2026
- 2026Monocular Reconstruction of Neural Tactile Fields13 Feb 2026
- 2025Reactive In-Air Clothing Manipulation with Confidence-Aware Dense Correspondence and Visuotactile Affordance4 Sep 2025
- 2025GelSLAM: A Real-time, High-Fidelity, and Robust 3D Tactile SLAM System21 Aug 2025
- 2025eFlesh: Highly customizable Magnetic Touch Sensing using Cut-Cell Microstructures11 Jun 2025
- 2025A Modularized Design Approach for GelSight Family of Vision-based Tactile Sensors20 Apr 2025
- 2025Enhance Vision-based Tactile Sensors via Dynamic Illumination and Image Fusion27 Mar 2025
- 2025Sensor-Invariant Tactile Representation27 Feb 2025
- 2025GelBelt: A Vision-based Tactile Sensor for Continuous Sensing of Large Surfaces9 Jan 2025
12 newest of 30 All 30 (JSON)