EgoTactile: Learning Grasp Pressure for Everyday Objects from Egocentric Video
Not on the map. Why?
Abstract (arXiv)
Estimating full-hand grasp pressure from egocentric video is critical for immersive VR and robotic manipulation, yet dense tactile sensing often relies on intrusive hardware. Existing vision-based methods predominantly rely on planar surfaces or fingertip contacts, failing to generalize to complex 3D object interactions. Therefore, we introduce EgoTactile, a benchmark pairing egocentric video with full-hand pressure supervision for diverse everyday objects, incorporating a bare-hand transfer subset to enable generalization to natural scenarios. Leveraging this benchmark, we first establish EgoPressureFormer as a discriminative baseline. Beyond this, to explicitly address the uncertainty in partial observations, we propose EgoPressureDiff, a conditional diffusion framework that adapts a large-scale pre-trained video diffusion backbone. By combining rich world knowledge priors with a Physically-Informed Feature Rectification layer to inject semantic constraints, our approach effectively infers plausible contact patterns and resolves visual-physical ambiguities. Extensive experiments demonstrate that our method achieves superior performance on the benchmark and robust transferability to in-the-wild scenarios. Our project page is available at https://egotactile.github.io/.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 19 of its 26 references that are in the map. First posted on arXiv 8 Jun 2026.
Builds on
19 of 26 references.
References · 19
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2017Neural Discrete Representation Learningcited by 4,650
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,526
- 2021Is Space-Time Attention All You Need for Video Understanding?cited by 1,609
- 2021Ego4D: Around the World in 3,000 Hours of Egocentric Videocited by 1,530
- 2017Sigmoid-Weighted Linear Units for Neural Network Function Approximation in Reinforcement Learningcited by 935
- 2024Grounded SAM: Assembling Open-World Models for Diverse Visual Taskscited by 914
- 2018Scaling Egocentric Vision: The EPIC-KITCHENS Datasetcited by 789
- 2020DIGIT: A Novel Design for a Low-Cost Compact High-Resolution Tactile Sensor with Application to In-Hand Manipulationcited by 164
- 2024HOT3D: Hand and Object Tracking in 3D from Egocentric Multi-View Videoscited by 122
7 more
- 2022PressureVision: Estimating Hand Pressure from a Single RGB Imagecited by 23
- 2023PressureVision++: Estimating Fingertip Pressure from Diverse RGB Imagescited by 12
- 2025OPENTOUCH: Bringing Full-Hand Touch to Real-World Interactioncited by 11
- 2024TouchInsight: Uncertainty-aware Rapid Touch and Text Input for Mixed Reality from Egocentric Visioncited by 4
- 2024Posture-Informed Muscular Force Learning for Robust Hand Pressure Estimationcited by 3
- 2025A Humanoid Visual-Tactile-Action Dataset for Contact-Rich Manipulationcited by 2
- 2026EgoPressDiff: Multimodal Video Diffusion for Egocentric UV-Domain Hand-Pressure Estimationcited by 1
Built on by
Citing papers per year: 2026: 3.
3 papers.
- 2026TouchSight: Bare-Handed Tactile Prediction from Egocentric Video via Generative Visual Augmentation17 Sep 2026
- 2026Bench2Dex: Benchmarking Visuo-Tactile Bimanual Dexterous Manipulation Across Dexterous Hands14 Sep 2026
- 2026ACE-Data-0: Human-Centric Ambient Capture as Embodied Data Engine30 Jul 2026
Similar, not cited
Close in wording, no citation either way
- 2026ACE-Ego-Hand: Repurposing Video Diffusion Models for Occlusion-Robust Egocentric 3D Hand Motion Recovery
- 2026WristCompass: Kinematic Coupling as a Learnable Visual Concept for Ego-Camera Orientation
- 2026ESTHER: Egocentric Stereo Hand Estimation and Reconstruction in the Wild
- 2026EgoGrasp: World-Space Hand-Object Interaction Estimation from Egocentric Videos
- 2026EggHand: A Multimodal Foundation Model for Egocentric Hand Pose Forecasting
- 2026VISTA: Visually Inferred Spatial ConTact Attention for Contact-Rich Manipulation
- 2025Developing Vision-Language-Action Model from Egocentric Videos
- 2025EgoLoc: A Generalizable Solution for Temporal Interaction Localization in Egocentric Videos