Physical-Field-Bridged Material Parameter Inference from Multi-View Deformation Videos
Not on the map. Why?
Abstract (arXiv)
Estimating simulation-ready material parameters from visual observations is crucial for deformable-object manipulation but challenging because material properties are only indirectly revealed through physical responses. We introduce physical-field-bridged material inference, a single-pass framework that uses dense physical responses to connect multi-view RGB deformation videos with constitutive-type classification and continuous parameter regression. Unlike inverse-physics methods requiring per-scene reconstruction, online tuning, or simulation-in-the-loop optimization, our model predicts force/contact masks, projected motion-flow fields, and projected stress-response maps, then conditions material inference on these fields to reduce reliance on appearance or category shortcuts. We construct DeformFieldBench, a 3DGS MPM learning environment comprising 5,000 simulations across 100 object shapes and five mechanically informative loading modes, with dense pixel-aligned physical supervision. Our method achieves the best median errors on all four continuous parameters, improves stress-hotspot recall from 0.0762 to 0.5121, and attains 0.8676 SSIM/36.82 dB PSNR in same-simulator replay on unseen objects. Under a protocol-matched GSO evaluation, inference and future-state prediction take approximately 30 seconds, compared with 15-120 minutes for per-scene optimization. The method also yields measurable replay agreement on five real-world sequences. These results support dense physical fields as an effective bridge for fast material inference, while cross-simulator and real-world tests reveal remaining domain and identifiability gaps.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 21 of its 26 references that are in the map. First posted on arXiv 13 Oct 2026.
Builds on
21 of 26 references.
References · 21
- 2023PhysGaussian: Physics-Integrated 3D Gaussians for Generative Dynamicscited by 377
- 2020ThreeDWorld: A Platform for Interactive Multi-Modal Physical Simulationcited by 250
- 2023PAC-NeRF: Physics Augmented Continuum Neural Radiance Fields for Geometry-Agnostic System Identificationcited by 154
- 2021Physion: Evaluating Physical Prediction from Vision in Humans and Machinescited by 153
- 2020SoftGym: Benchmarking Deep Reinforcement Learning for Deformable Object Manipulationcited by 121
- 2019CLOTH3D: Clothed 3D Humanscited by 116
- 2024ManiGaussian: Dynamic Gaussian Splatting for Multi-task Robotic Manipulationcited by 108
- 2024Reconstruction and Simulation of Elastic Objects with Spring-Mass 3D Gaussianscited by 97
- 2025PhysTwin: Physics-Informed Reconstruction and Simulation of Deformable Objects from Videoscited by 87
- 2019DensePhysNet: Learning Dense Physical Object Representations via Multi-step Dynamic Interactionscited by 63
- 2023Learning Neural Constitutive Laws From Motion Observations for Generalizable PDE Dynamicscited by 57
- 2025DiffSplat: Repurposing Image Diffusion Models for Scalable Gaussian Splat Generationcited by 50
9 more
- 2024Physical Property Understanding from Language-Embedded Feature Fieldscited by 48
- 2025PUGS: Zero-shot Physical Understanding with Gaussian Splattingcited by 24
- 2025Pixie: Fast and Generalizable Supervised Learning of 3D Physics from Pixelscited by 24
- 2024GaussianProperty: Integrating Physical Properties to 3D Gaussians with LMMscited by 23
- 2025Vid2Sim: Generalizable, Video-based Reconstruction of Appearance, Geometry and Physics for Mesh-free Simulationcited by 20
- 2025UniPhy: Learning a Unified Constitutive Model for Inverse Physics Simulationcited by 12
- 2025MASIV: Toward Material-Agnostic System Identification from Videoscited by 9
- 2026Learning Physics-Grounded 4D Dynamics with Neural Gaussian Force Fieldscited by 6
- 2024DOFS: A Real-world 3D Deformable Object Dataset with Full Spatial Information for Dynamics Model Learningcited by 3
Built on by
Not cited yet.