Physics-Encoded Graph Neural Networks for Deformation Prediction under Contact
Not on the map. Why?
Abstract (arXiv)
In robotics, it's crucial to understand object deformation during tactile interactions. A precise understanding of deformation can elevate robotic simulations and have broad implications across different industries. We introduce a method using Physics-Encoded Graph Neural Networks (GNNs) for such predictions. Similar to robotic grasping and manipulation scenarios, we focus on modeling the dynamics between a rigid mesh contacting a deformable mesh under external forces. Our approach represents both the soft body and the rigid body within graph structures, where nodes hold the physical states of the meshes. We also incorporate cross-attention mechanisms to capture the interplay between the objects. By jointly learning geometry and physics, our model reconstructs consistent and detailed deformations. We've made our code and dataset public to advance research in robotic simulation and grasping.
Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Builds on 20 of its 40 references that are in the map. First posted on arXiv 5 Feb 2024.
Builds on
20 of 40 references.
References · 20
- 2017Attention Is All You Needcited by 59,932
- 2017Graph Attention Networkscited by 8,854
- 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,223
- 2018Dynamic Graph CNN for Learning on Point Cloudscited by 2,220
- 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,522
- 2020Point Transformercited by 1,462
- 2016Geometric deep learning: going beyond Euclidean datacited by 1,042
- 2020Learning Mesh-Based Simulation with Graph Networkscited by 840
- 2016A Compositional Object-Based Approach to Learning Physical Dynamicscited by 119
- 2017Topology Adaptive Graph Convolutional Networkscited by 112
- 2022Physics-Informed Machine Learning: A Survey on Problems, Methods and Applicationscited by 88
- 2016SyncSpecCNN: Synchronized Spectral CNN for 3D Shape Segmentationcited by 70
8 more
- 2023Rotation-Invariant Transformer for Point Cloud Matchingcited by 68
- 2022Bending Graphs: Hierarchical Shape Matching using Gated Optimal Transportcited by 24
- 2021PhysGNN: A Physics-Driven Graph Neural Network Based Model for Predicting Soft Tissue Deformation in Image-Guided Neurosurgerycited by 22
- 2020Graphite: GRAPH-Induced feaTure Extraction for Point Cloud Registrationcited by 12
- 2023Dynamic Hyperbolic Attention Network for Fine Hand-object Reconstructioncited by 10
- 2020Physics-informed deep learning for flow and deformation in poroelastic mediacited by 5
- 2023Robotic Navigation Autonomy for Subretinal Injection via Intelligent Real-Time Virtual iOCT Volume Slicingcited by 3
- 2022CloudAttention: Efficient Multi-Scale Attention Scheme For 3D Point Cloud Learningcited by 2
Built on by
Citing papers per year: 2025: 4; 2026: 2.
6 papers.
- 2025Learning 3D-Gaussian Simulators from RGB Videoscited by 8
- 2026SoMA: A Real-to-Sim Neural Simulator for Robotic Soft-body Manipulationcited by 4
- 2025Neural-Augmented Kelvinlet for Real-Time Soft Tissue Deformation Modelingcited by 1
- 2025Recurrent U-Net-Based Graph Neural Network (RUGNN) for Accurate Deformation Predictions in Sheet Material Formingcited by 1
- 2025MIXPINN: Mixed-Material Simulations by Physics-Informed Neural Networkcited by 0
- 2026ODeform: Learning Continuous 4D Motion for Shape Deformation with Neural ODEscited by 0
- 2026ODeform: Learning Continuous 4D Motion for Shape Deformation with Neural ODEs22 Jul 2026
- 2026SoMA: A Real-to-Sim Neural Simulator for Robotic Soft-body Manipulation2 Feb 2026
- 2025Recurrent U-Net-Based Graph Neural Network (RUGNN) for Accurate Deformation Predictions in Sheet Material Forming10 Jul 2025
- 2025Neural-Augmented Kelvinlet for Real-Time Soft Tissue Deformation Modeling6 Jun 2025
- 2025Learning 3D-Gaussian Simulators from RGB Videos31 Mar 2025
- 2025MIXPINN: Mixed-Material Simulations by Physics-Informed Neural Network17 Mar 2025