mlsanityData to 7 Oct 2026

EgoTactile: Learning Grasp Pressure for Everyday Objects from Egocentric Video

arXiv 2606.09243 ↗First posted 8 Jun 2026cs.CV cs.AIcited by 3

Not on the map. Why?

Abstract (arXiv)

Estimating full-hand grasp pressure from egocentric video is critical for immersive VR and robotic manipulation, yet dense tactile sensing often relies on intrusive hardware. Existing vision-based methods predominantly rely on planar surfaces or fingertip contacts, failing to generalize to complex 3D object interactions. Therefore, we introduce EgoTactile, a benchmark pairing egocentric video with full-hand pressure supervision for diverse everyday objects, incorporating a bare-hand transfer subset to enable generalization to natural scenarios. Leveraging this benchmark, we first establish EgoPressureFormer as a discriminative baseline. Beyond this, to explicitly address the uncertainty in partial observations, we propose EgoPressureDiff, a conditional diffusion framework that adapts a large-scale pre-trained video diffusion backbone. By combining rich world knowledge priors with a Physically-Informed Feature Rectification layer to inject semantic constraints, our approach effectively infers plausible contact patterns and resolves visual-physical ambiguities. Extensive experiments demonstrate that our method achieves superior performance on the benchmark and robust transferability to in-the-wild scenarios. Our project page is available at https://egotactile.github.io/.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 19 of its 26 references that are in the map. First posted on arXiv 8 Jun 2026.

Builds on

19 of 26 references.

References · 19

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  4. 2017Neural Discrete Representation Learningcited by 4,650
  5. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,526
  6. 2021Is Space-Time Attention All You Need for Video Understanding?cited by 1,609
  7. 2021Ego4D: Around the World in 3,000 Hours of Egocentric Videocited by 1,530
  8. 2017Sigmoid-Weighted Linear Units for Neural Network Function Approximation in Reinforcement Learningcited by 935
  9. 2024Grounded SAM: Assembling Open-World Models for Diverse Visual Taskscited by 914
  10. 2018Scaling Egocentric Vision: The EPIC-KITCHENS Datasetcited by 789
  11. 2020DIGIT: A Novel Design for a Low-Cost Compact High-Resolution Tactile Sensor with Application to In-Hand Manipulationcited by 164
  12. 2024HOT3D: Hand and Object Tracking in 3D from Egocentric Multi-View Videoscited by 122
7 more
  1. 2022PressureVision: Estimating Hand Pressure from a Single RGB Imagecited by 23
  2. 2023PressureVision++: Estimating Fingertip Pressure from Diverse RGB Imagescited by 12
  3. 2025OPENTOUCH: Bringing Full-Hand Touch to Real-World Interactioncited by 11
  4. 2024TouchInsight: Uncertainty-aware Rapid Touch and Text Input for Mixed Reality from Egocentric Visioncited by 4
  5. 2024Posture-Informed Muscular Force Learning for Robust Hand Pressure Estimationcited by 3
  6. 2025A Humanoid Visual-Tactile-Action Dataset for Contact-Rich Manipulationcited by 2
  7. 2026EgoPressDiff: Multimodal Video Diffusion for Egocentric UV-Domain Hand-Pressure Estimationcited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 3.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026ACE-Ego-Hand: Repurposing Video Diffusion Models for Occlusion-Robust Egocentric 3D Hand Motion Recovery
  2. 2026WristCompass: Kinematic Coupling as a Learnable Visual Concept for Ego-Camera Orientation
  3. 2026ESTHER: Egocentric Stereo Hand Estimation and Reconstruction in the Wild
  4. 2026EgoGrasp: World-Space Hand-Object Interaction Estimation from Egocentric Videos
  5. 2026EggHand: A Multimodal Foundation Model for Egocentric Hand Pose Forecasting
  6. 2026VISTA: Visually Inferred Spatial ConTact Attention for Contact-Rich Manipulation
  7. 2025Developing Vision-Language-Action Model from Egocentric Videos
  8. 2025EgoLoc: A Generalizable Solution for Temporal Interaction Localization in Egocentric Videos