UniPhy: Learning a Unified Constitutive Model for Inverse Physics Simulation
Not on the map. Why?
Abstract (arXiv)
We propose UniPhy, a common latent-conditioned neural constitutive model that can encode the physical properties of diverse materials. At inference UniPhy allows `inverse simulation' i.e. inferring material properties by optimizing the scene-specific latent to match the available observations via differentiable simulation. In contrast to existing methods that treat such inference as system identification, UniPhy does not rely on user-specified material type information. Compared to prior neural constitutive modeling approaches which learn instance specific networks, the shared training across materials improves both, robustness and accuracy of the estimates. We train UniPhy using simulated trajectories across diverse geometries and materials -- elastic, plasticine, sand, and fluids (Newtonian & non-Newtonian). At inference, given an object with unknown material properties, UniPhy can infer the material properties via latent optimization to match the motion observations, and can then allow re-simulating the object under diverse scenarios. We compare UniPhy against prior inverse simulation methods, and show that the inference from UniPhy enables more accurate replay and re-simulation under novel conditions.
Key facts. Cited by 12 papers in the map (data through 14 Oct 2026). Builds on 33 of its 62 references that are in the map. First posted on arXiv 22 May 2025.
Builds on
33 of 62 references.
References · 33
- 2023Segment Anythingcited by 8,234
- 2020End-to-End Object Detection with Transformerscited by 7,414
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
- 2020D-NeRF: Neural Radiance Fields for Dynamic Scenescited by 1,465
- 2020Learning to Simulate Complex Physics with Graph Networkscited by 880
- 2020Learning Mesh-Based Simulation with Graph Networkscited by 868
- 2023Dynamic 3D Gaussians: Tracking by Persistent Dynamic View Synthesiscited by 737
- 2019Soft Rasterizer: A Differentiable Renderer for Image-based 3D Reasoningcited by 420
- 2023PhysGaussian: Physics-Integrated 3D Gaussians for Generative Dynamicscited by 377
- 2023SC-GS: Sparse-Controlled Gaussian Splatting for Editable Dynamic Scenescited by 347
- 2018Learning Category-Specific Mesh Reconstruction from Image Collectionscited by 317
- 2019DiffTaichi: Differentiable Programming for Physical Simulationcited by 258
21 more
- 2022DynIBaR: Neural Dynamic Image-Based Renderingcited by 224
- 2021HyperNeRF: A Higher-Dimensional Representation for Topologically Varying Neural Radiance Fieldscited by 214
- 2024PhysDreamer: Physics-Based Interaction with 3D Objects via Video Generationcited by 191
- 2023PAC-NeRF: Physics Augmented Continuum Neural Radiance Fields for Geometry-Agnostic System Identificationcited by 154
- 2020Combining Differentiable PDE Solvers and Graph Neural Networks for Fluid Flow Predictioncited by 138
- 2016A Differentiable Physics Engine for Deep Learning in Roboticscited by 108
- 2021PlasticineLab: A Soft-Body Manipulation Benchmark with Differentiable Physicscited by 103
- 2018ChainQueen: A Real-Time Differentiable Physical Simulator for Soft Roboticscited by 98
- 2023Forward Flow for Novel View Synthesis of Dynamic Scenescited by 68
- 2021DiffPD: Differentiable Projective Dynamicscited by 62
- 2023Learning Neural Constitutive Laws From Motion Observations for Generalizable PDE Dynamicscited by 57
- 2021Polyconvex anisotropic hyperelasticity with neural networkscited by 55
- 2020Geometric deep learning for computational mechanics Part I: Anisotropic Hyperelasticitycited by 49
- 2023FluidLab: A Differentiable Environment for Benchmarking Complex Fluid Manipulationcited by 40
- 2022Differentiable Simulation of Soft Multi-body Systemscited by 39
- 2014Deformable Part Models are Convolutional Neural Networkscited by 35
- 2022Virtual Elastic Objectscited by 35
- 2022RISP: Rendering-Invariant State Predictor with Differentiable Simulation and Rendering for Cross-Domain Parameter Estimationcited by 29
- 2022Geometric deep learning for computational mechanics Part II: Graph embedding for interpretable multiscale plasticitycited by 11
- 2019Learning Elastic Constitutive Material and Damping Modelscited by 10
- 2021DiffAqua: A Differentiable Computational Design Pipeline for Soft Underwater Swimmers with Shape Interpolationcited by 9
Built on by
Citing papers per year: 2025: 2; 2026: 10.
12 papers.
- 2025Pixie: Fast and Generalizable Supervised Learning of 3D Physics from Pixelscited by 24
- 2025PhysChoreo: Physics-Controllable Video Generation with Part-Aware Semantic Groundingcited by 9
- 2026Deltaynamics: Language-Based Representation for Inferring Rigid-Body Dynamics From Videoscited by 3
- 2026MonoPhysics: Estimating Geometry, Appearance, and Physical Parameters from Monocular Videoscited by 3
- 2026NeuROK: Generative 4D Neural Object Kinematicscited by 3
- 2026PhysCoRe: Physics-Corrected Residual World Models for Material-Aware Deformable Dynamicscited by 1
- 2026RAFL: Generalizable Sim-to-Real of Soft Robots with Residual Acceleration Field Learningcited by 0
- 20263DPhysVideo: Consistency-Guided Flow SDE for Video Generation via 3D Scene Reconstruction and Physical Simulationcited by 0
- 2026MoSA: Motion-constrained Stress Adaptation for Mitigating Real-to-Sim Gap in Continuum Dynamics via Learning Residual Anisotropycited by 0
- 2026DyG2T: Modeling Object Dynamics with 3D Gaussian Temporal-Spatial Particle Graph Transformercited by 0
- 2026Neural Constitutive Learning for Generalized Reaction-Diffusion Systemscited by 0
- 2026Physical-Field-Bridged Material Parameter Inference from Multi-View Deformation Videoscited by 0
- 2026Physical-Field-Bridged Material Parameter Inference from Multi-View Deformation Videos13 Oct 2026
- 2026Neural Constitutive Learning for Generalized Reaction-Diffusion Systems29 Sep 2026
- 2026DyG2T: Modeling Object Dynamics with 3D Gaussian Temporal-Spatial Particle Graph Transformer19 Aug 2026
- 2026PhysCoRe: Physics-Corrected Residual World Models for Material-Aware Deformable Dynamics22 Jul 2026
- 2026NeuROK: Generative 4D Neural Object Kinematics28 May 2026
- 2026MonoPhysics: Estimating Geometry, Appearance, and Physical Parameters from Monocular Videos28 May 2026
- 2026MoSA: Motion-constrained Stress Adaptation for Mitigating Real-to-Sim Gap in Continuum Dynamics via Learning Residual Anisotropy21 May 2026
- 2026Deltaynamics: Language-Based Representation for Inferring Rigid-Body Dynamics From Videos20 May 2026
- 20263DPhysVideo: Consistency-Guided Flow SDE for Video Generation via 3D Scene Reconstruction and Physical Simulation16 May 2026
- 2026RAFL: Generalizable Sim-to-Real of Soft Robots with Residual Acceleration Field Learning23 Mar 2026
- 2025PhysChoreo: Physics-Controllable Video Generation with Part-Aware Semantic Grounding25 Nov 2025
- 2025Pixie: Fast and Generalizable Supervised Learning of 3D Physics from Pixels20 Aug 2025