EgoPressDiff: Multimodal Video Diffusion for Egocentric UV-Domain Hand-Pressure Estimation
On the map: Diffusion models → Diffusion and flow policies for robotics
Abstract (arXiv)
Estimating hand-surface contact pressure from an egocentric view is crucial for AR/VR devices, robotic imitation, and ergonomic analysis. Existing methods often discretize pressure signal and process frames independently, leading to quantization errors and temporal inconsistencies. We present EgoPressDiff, a conditional video diffusion framework that generates UV-pressure maps from visual input. The core of our approach is a multi-modal conditioning strategy, introducing a PoseNet and a Vertex Encoder to efficiently extract features from hand pose and 3D mesh vertices. These signals, along with depth information, guide the generative process to ensure the pressure fields are physically grounded. To effectively fuse these heterogeneous features, we further propose a Distribution-Calibrated Spatial Layer, which aligns their statistical properties before combination. Evaluated on the EgoPressure ego-view setting, EgoPressDiff achieves state-of-the-art results, improving Volumetric IoU by over 34% relative to prior baseline, while reducing MAE and maintaining high temporal accuracy. Our project page is at https://egopressdiff.github.io/.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Diffusion and flow policies for robotics, one of 14 directions in Diffusion models. Builds on 18 of its 24 references that are in the map. First posted on arXiv 5 Jun 2026.
Builds on
18 of 24 references.
References · 18
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2016Layer Normalizationcited by 5,669
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,581
- 2021Ego4D: Around the World in 3,000 Hours of Egocentric Videocited by 1,556
- 2017Sigmoid-Weighted Linear Units for Neural Network Function Approximation in Reinforcement Learningcited by 950
- 2023Animate Anyone: Consistent and Controllable Image-to-Video Synthesis for Character Animationcited by 688
- 2023Ego-Exo4D: Understanding Skilled Human Activity from First- and Third-Person Perspectivescited by 490
- 2023Reconstructing Hands in 3D with Transformerscited by 306
- 2025Video Depth Anything: Consistent Depth Estimation for Super-Long Videoscited by 207
- 2022Embodied Hands: Modeling and Capturing Hands and Bodies Togethercited by 181
6 more
- 2021D-Grasp: Physically Plausible Dynamic Grasp Synthesis for Hand-Object Interactionscited by 113
- 2022PressureVision: Estimating Hand Pressure from a Single RGB Imagecited by 23
- 2024EgoPressure: A Dataset for Hand Pressure and Pose Estimation in Egocentric Visioncited by 19
- 2023PressureVision++: Estimating Fingertip Pressure from Diverse RGB Imagescited by 12
- 2023Visual Contact Pressure Estimation for Grippers in the Wildcited by 5
- 2022An Integrated Design Pipeline for Tactile Sensing Robotic Manipulatorscited by 3
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026ACE-Ego-Hand: Repurposing Video Diffusion Models for Occlusion-Robust Egocentric 3D Hand Motion Recovery
- 2024Estimating Ego-Body Pose from Doubly Sparse Egocentric Video Data
- 2026EgoGrasp: World-Space Hand-Object Interaction Estimation from Egocentric Videos
- 2026The Surprising Effectiveness of Video Diffusion Models for Hand Motion Reconstruction
- 2026RLHND: Video Foundation Models as Physically Grounded Hand Trackers for Robot Learning
- 2026ESTHER: Egocentric Stereo Hand Estimation and Reconstruction in the Wild
- 2026Hand2World: Autoregressive Egocentric Interaction Generation via Free-Space Hand Gestures
- 2024Estimating Body and Hand Motion in an Ego-sensed World