GraphiContact: Pose-aware Human-Scene Robust Contact Perception for Interactive Systems
Not on the map. Why?
Abstract (arXiv)
Monocular vertex-level human-scene contact prediction is a fundamental capability for interactive systems such as assistive monitoring, embodied AI, and rehabilitation analysis. In this work, we study this task jointly with single-image 3D human mesh reconstruction, using reconstructed body geometry as a scaffold for contact reasoning. Existing approaches either focus on contact prediction without sufficiently exploiting explicit 3D human priors, or emphasize pose/mesh reconstruction without directly optimizing robust vertex-level contact inference under occlusion and perceptual noise. To address this gap, we propose GraphiContact, a pose-aware framework that transfers complementary human priors from two pretrained Transformer encoders and predicts per-vertex human-scene contact on the reconstructed mesh. To improve robustness in real-world scenarios, we further introduce a Single-Image Multi-Infer Uncertainty (SIMU) training strategy with token-level adaptive routing, which simulates occlusion and noisy observations during training while preserving efficient single-branch inference at test time. Experiments on five benchmark datasets show that GraphiContact achieves consistent gains on both contact prediction and 3D human reconstruction. Our code, based on the GraphiContact method, provides comprehensive 3D human reconstruction and interaction analysis, and will be publicly available at https://github.com/Aveiro-Lin/GraphiContact.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 46 of its 59 references that are in the map. First posted on arXiv 19 Mar 2026.
Builds on
46 of 59 references.
References · 46
- 2017Attention Is All You Needcited by 59,932
- 2021HuMoR: 3D Human Motion Model for Robust Pose Estimationcited by 319
- 2024MACE: Mass Concept Erasure in Diffusion Modelscited by 298
- 2019Resolving 3D Human Pose Ambiguities with 3D Scene Constraintscited by 294
- 2019Convolutional Mesh Regression for Single-Image Human Shape Reconstructioncited by 270
- 2021Mesh Graphormercited by 264
- 2022BEHAVE: Dataset and Method for Tracking Human Object Interactionscited by 246
- 2023TF-ICON: Diffusion-Based Training-Free Cross-Domain Image Compositioncited by 182
- 2020ContactPose: A Dataset of Grasps with Object Contact and Hand Posecited by 180
- 2022Capturing and Inferring Dense Full-Body Human-Scene Contactcited by 176
- 2020Populating 3D Scenes by Learning Human-Scene Interactioncited by 164
- 2021Collaborative Regression of Expressive Bodies using Moderationcited by 137
34 more
- 2020CPF: Learning a Contact Potential Field to Model the Hand-Object Interactioncited by 127
- 2024Robust Watermarking Using Generative Priors Against Image Editing: From Benchmarking to Advancescited by 105
- 2022CHORE: Contact, Human and Object REconstruction from a single RGB imagecited by 95
- 2024EraseAnything: Enabling Concept Erasure in Rectified Flow Transformerscited by 93
- 2021On Self-Contact and Human Posecited by 88
- 2025Set You Straight: Auto-Steering Denoising Trajectories to Sidestep Unwanted Conceptscited by 61
- 2023DECO: Dense Estimation of 3D Human-Scene Contact In The Wildcited by 54
- 2023LEMON: Learning 3D Human-Object Interaction Relation from 2D Imagescited by 49
- 2023Detecting Human-Object Contact in Imagescited by 41
- 2023Zolly: Zoom Focal Length Correctly for Perspective-Distorted Human Mesh Reconstructioncited by 41
- 2020Detecting Hands and Recognizing Physical Contact in the Wildcited by 38
- 2023POTTER: Pooling Attention Transformer for Efficient Human Mesh Recoverycited by 31
- 2025Does FLUX Already Know How to Perform Physically Plausible Image Composition?cited by 30
- 2022HULC: 3D Human Motion Capture with Pose Manifold Sampling and Dense Contact Guidancecited by 29
- 2024Joint Reconstruction of 3D Human and Object via Contact-Based Refinement Transformercited by 29
- 2025DragFlow: Unleashing DiT Priors with Region Based Supervision for Drag Editingcited by 29
- 2023Hulk: A Universal Knowledge Translator for Human-Centric Taskscited by 22
- 2025Reconstructing Humans with a Biomechanically Accurate Skeletoncited by 22
- 2025PICO: Reconstructing 3D People In Contact with Objectscited by 22
- 2022MoCapDeform: Monocular 3D Human Motion Capture in Deformable Scenescited by 18
- 2025All That Glitters Is Not Gold: Key-Secured 3D Secrets within 3D Gaussian Splattingcited by 15
- 2025Temporal-Guided Spiking Neural Networks for Event-Based Human Action Recognitioncited by 11
- 2025Revoking Amnesia: RL-based Trajectory Optimization to Resurrect Erased Concepts in Diffusion Modelscited by 11
- 2025A-MESS: Anchor based Multimodal Embedding with Semantic Synchronization for Multimodal Intent Recognitioncited by 10
- 2025FreCT: Frequency-augmented Convolutional Transformer for Robust Time Series Anomaly Detectioncited by 10
- 2021Copy-Move Image Forgery Detection Based on Evolving Circular Domains Coveragecited by 9
- 2025Reusing Attention for One-stage Lane Topology Understandingcited by 9
- 2025Dual-channel Heterophilic Message Passing for Graph Fraud Detectioncited by 8
- 2026Hallucination Begins Where Saliency Dropscited by 8
- 2025DConAD: A Differencing-based Contrastive Representation Learning Framework for Time Series Anomaly Detectioncited by 7
- 2025Never compromise with vulnerabilities: a comprehensive survey on AI governancecited by 5
- 2025WaveSP-Net: Learnable Wavelet-Domain Sparse Prompt Tuning for Speech Deepfake Detectioncited by 5
- 2025Butter: Frequency Consistency and Hierarchical Fusion for Autonomous Driving Object Detectioncited by 4
- 2025S^2-KD: Semantic-Spectral Knowledge Distillation Spatiotemporal Forecastingcited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.