Learning Neural Constitutive Laws From Motion Observations for Generalizable PDE Dynamics
Not on the map. Why?
Abstract (arXiv)
We propose a hybrid neural network (NN) and PDE approach for learning generalizable PDE dynamics from motion observations. Many NN approaches learn an end-to-end model that implicitly models both the governing PDE and constitutive models (or material models). Without explicit PDE knowledge, these approaches cannot guarantee physical correctness and have limited generalizability. We argue that the governing PDEs are often well-known and should be explicitly enforced rather than learned. Instead, constitutive models are particularly suitable for learning due to their data-fitting nature. To this end, we introduce a new framework termed "Neural Constitutive Laws" (NCLaw), which utilizes a network architecture that strictly guarantees standard constitutive priors, including rotation equivariance and undeformed state equilibrium. We embed this network inside a differentiable simulation and train the model by minimizing a loss function based on the difference between the simulation and the motion observation. We validate NCLaw on various large-deformation dynamical systems, ranging from solids to fluids. After training on a single motion trajectory, our method generalizes to new geometries, initial/boundary conditions, temporal ranges, and even multi-physics systems. On these extremely out-of-distribution generalization tasks, NCLaw is orders-of-magnitude more accurate than previous NN approaches. Real-world experiments demonstrate our method's ability to learn constitutive laws from videos.
Key facts. Cited by 56 papers in the map (data through 7 Oct 2026). Builds on 28 of its 108 references that are in the map. First posted on arXiv 27 Apr 2023.
Builds on
28 of 108 references.
References · 28
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2016Gaussian Error Linear Units (GELUs)cited by 3,431
- 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,806
- 2019DeepONet: Learning nonlinear operators for identifying differential equations based on the universal approximation theorem of operatorscited by 1,965
- 2020Learning to Simulate Complex Physics with Graph Networkscited by 867
- 2020Learning Mesh-Based Simulation with Graph Networkscited by 840
- 2021Vector Neurons: A General Framework for SO(3)-Equivariant Networkscited by 304
- 2019DiffTaichi: Differentiable Programming for Physical Simulationcited by 248
- 2020Solver-in-the-Loop: Learning from Differentiable Physics to Interact with Iterative PDE-Solverscited by 201
- 2016A Differentiable Physics Engine for Deep Learning in Roboticscited by 107
- 2021gradSim: Differentiable simulation for system identification and visuomotor controlcited by 100
16 more
- 2021PlasticineLab: A Soft-Body Manipulation Benchmark with Differentiable Physicscited by 100
- 2018ChainQueen: A Real-Time Differentiable Physical Simulator for Soft Roboticscited by 98
- 2020Augmenting Physical Models with Deep Networks for Complex Dynamics Forecastingcited by 93
- 2021DiffPD: Differentiable Projective Dynamicscited by 62
- 2021Polyconvex anisotropic hyperelasticity with neural networkscited by 54
- 2020Geometric deep learning for computational mechanics Part I: Anisotropic Hyperelasticitycited by 49
- 2022Differentiable Simulation of Soft Multi-body Systemscited by 39
- 2021Efficient Differentiable Simulation of Articulated Bodiescited by 38
- 2023FluidLab: A Differentiable Environment for Benchmarking Complex Fluid Manipulationcited by 37
- 2022Virtual Elastic Objectscited by 35
- 2022RISP: Rendering-Invariant State Predictor with Differentiable Simulation and Rendering for Cross-Domain Parameter Estimationcited by 29
- 2023SoftZoo: A Soft Robot Co-design Benchmark For Locomotion In Diverse Environmentscited by 18
- 2022Geometric deep learning for computational mechanics Part II: Graph embedding for interpretable multiscale plasticitycited by 11
- 2019Learning Elastic Constitutive Material and Damping Modelscited by 10
- 2021Data-driven discovery of interpretable causal relations for deep learning material laws with uncertainty propagationcited by 10
- 2019Placental Flattening via Volumetric Parameterizationcited by 7
Built on by
Citing papers per year: 2023: 3; 2024: 17; 2025: 19; 2026: 17.
56 papers.
Sort:
By area:
- 2023PhysGaussian: Physics-Integrated 3D Gaussians for Generative Dynamicscited by 368
- 2024PhysDreamer: Physics-Based Interaction with 3D Objects via Video Generationcited by 185
- 2024KAN 2.0: Kolmogorov-Arnold Networks Meet Sciencecited by 116
- 2024Reconstruction and Simulation of Elastic Objects with Spring-Mass 3D Gaussianscited by 92
- 2024LLM and Simulation as Bilevel Optimizers: A New Paradigm to Advance Physical Scientific Discoverycited by 82
- 2025PhysTwin: Physics-Informed Reconstruction and Simulation of Deformable Objects from Videoscited by 78
- 2024GIC: Gaussian-Informed Continuum for Physical Property Identification and Simulationcited by 48
- 2024Dynamic 3D Gaussian Tracking for Graph-Based Neural Dynamics Modelingcited by 42
- 2025A Survey of Sim-to-Real Methods in RL: Progress, Prospects and Challenges with Foundation Modelscited by 36
- 2025Exploring the Evolution of Physics Cognition in Video Generation: A Surveycited by 31
- 2024Neural Material Adaptor for Visual Grounding of Intrinsic Dynamicscited by 30
- 2023Physics-Informed Computer Vision: A Review and Perspectivescited by 28
38 more
- 2024Scaling physics-informed hard constraints with mixture-of-expertscited by 24
- 2025Particle-Grid Neural Dynamics for Learning Deformable Object Models from RGB-D Videoscited by 22
- 2025Pixie: Fast and Generalizable Supervised Learning of 3D Physics from Pixelscited by 22
- 2024Stabilizing Reinforcement Learning in Differentiable Multiphysics Simulationcited by 14
- 2025UniPhy: Learning a Unified Constitutive Model for Inverse Physics Simulationcited by 11
- 2024PARCv2: Physics-aware Recurrent Convolutional Neural Networks for Spatiotemporal Dynamics Modelingcited by 10
- 2025PhysWorld: From Real Videos to World Models of Deformable Objects via Physics-Aware Demonstration Synthesiscited by 9
- 2025Exploiting Edited Large Language Models as General Scientific Optimizerscited by 7
- 2025MASIV: Toward Material-Agnostic System Identification from Videoscited by 7
- 2023Learning Homogenization for Elliptic Operatorscited by 6
- 2026MOSIV: Multi-Object System Identification from Videoscited by 6
- 2024A Neural Material Point Method for Particle-based Emulationcited by 5
- 2025ParticleGS: Learning Neural Gaussian Particle Dynamics from Videos for Prior-free Physical Motion Extrapolationcited by 5
- 2026Learning Physics-Grounded 4D Dynamics with Neural Gaussian Force Fieldscited by 5
- 2026ReconPhys: Reconstruct Appearance and Physical Attributes from Single Videocited by 5
- 2024PokeFlex: A Real-World Dataset of Volumetric Deformable Objects for Roboticscited by 4
- 2024GausSim: Foreseeing Reality by Gaussian Simulator for Elastic Objectscited by 4
- 2025ProJo4D: Progressive Joint Optimization for Sparse-View Inverse Physics Estimationcited by 4
- 2025Gaussian-Augmented Physics Simulation and System Identification with Complex Colliderscited by 4
- 2025NeuSpring: Neural Spring Fields for Reconstruction and Simulation of Deformable Objects from Videoscited by 4
- 2024Learning Object Properties Using Robot Proprioception via Differentiable Robot-Object Interactioncited by 3
- 2025VisionLaw: Inferring Interpretable Intrinsic Dynamics from Visual Observations via Bilevel Optimizationcited by 3
- 2024Learning Lagrangian Interaction Dynamics with Sampling-Based Model Order Reductioncited by 2
- 2025Parameter-Efficient Conditioning for Material Generalization in Graph-Based Simulatorscited by 2
- 2026MotionPhysics: Learnable Motion Distillation for Text-Guided Simulationcited by 2
- 2026NeuROK: Generative 4D Neural Object Kinematicscited by 2
- 2026Learning Physics-Guided Residual Dynamics for Deformable Object Simulationcited by 2
- 2024Safe PDE Boundary Control with Neural Operatorscited by 1
- 2025Learning 3D Garment Animation from Trajectories of A Piece of Clothcited by 1
- 2025Neural Modular Physics for Elastic Simulationcited by 1
- 2026PhysCoRe: Physics-Corrected Residual World Models for Material-Aware Deformable Dynamicscited by 1
- 2024Learning Physics-Consistent Material Behavior from Dynamic Displacementscited by 0
- 2025Generalized Dynamics Generation towards Scannable Physical World Modelcited by 0
- 2025IDOL: Meeting Diverse Distribution Shifts with Prior Physics for Tropical Cyclone Multi-Task Estimationcited by 0
- 2026RAFL: Generalizable Sim-to-Real of Soft Robots with Residual Acceleration Field Learningcited by 0
- 2026Momentum-Conserving Graph Neural Networks for Deformable Objectscited by 0
- 2026Mesh Field Theory: Port-Hamiltonian Formulation of Mesh-Based Physicscited by 0
- 2026MoSA: Motion-constrained Stress Adaptation for Mitigating Real-to-Sim Gap in Continuum Dynamics via Learning Residual Anisotropycited by 0
50 most cited of 56 All 56 (JSON)
- 2026Neural Constitutive Learning for Generalized Reaction-Diffusion Systems29 Sep 2026
- 2026NeuIDO: Neural Intrinsic Dynamics Operator for Physics-Informed 4D World Models21 Sep 2026
- 2026Analytic Dynamics: Learning Physics-Grounded Representation for Fast Intrinsic Dynamics Inference from Monocular Videos31 Aug 2026
- 2026Learning Implicit Constitutive Laws for Dynamic 3D Gaussian Splatting from Monocular Videos22 Aug 2026
- 2026PhysCoRe: Physics-Corrected Residual World Models for Material-Aware Deformable Dynamics22 Jul 2026
- 2026Learning Physics-Guided Residual Dynamics for Deformable Object Simulation15 Jul 2026
- 2026Latent Space Reinforcement Learning for Inverse Material Estimation in Food Fracture Simulation15 Jun 2026
- 2026NeuROK: Generative 4D Neural Object Kinematics28 May 2026
- 2026MonoPhysics: Estimating Geometry, Appearance, and Physical Parameters from Monocular Videos28 May 2026
- 2026MoSA: Motion-constrained Stress Adaptation for Mitigating Real-to-Sim Gap in Continuum Dynamics via Learning Residual Anisotropy21 May 2026
- 2026Mesh Field Theory: Port-Hamiltonian Formulation of Mesh-Based Physics1 May 2026
- 2026Momentum-Conserving Graph Neural Networks for Deformable Objects28 Apr 2026
38 more
- 2026ReconPhys: Reconstruct Appearance and Physical Attributes from Single Video9 Apr 2026
- 2026RAFL: Generalizable Sim-to-Real of Soft Robots with Residual Acceleration Field Learning23 Mar 2026
- 2026MOSIV: Multi-Object System Identification from Videos6 Mar 2026
- 2026Learning Physics-Grounded 4D Dynamics with Neural Gaussian Force Fields29 Jan 2026
- 2026MotionPhysics: Learnable Motion Distillation for Text-Guided Simulation1 Jan 2026
- 2025Neural Modular Physics for Elastic Simulation17 Dec 2025
- 2025IDOL: Meeting Diverse Distribution Shifts with Prior Physics for Tropical Cyclone Multi-Task Estimation13 Nov 2025
- 2025NeuSpring: Neural Spring Fields for Reconstruction and Simulation of Deformable Objects from Videos11 Nov 2025
- 2025Gaussian-Augmented Physics Simulation and System Identification with Complex Colliders10 Nov 2025
- 2025Parameter-Efficient Conditioning for Material Generalization in Graph-Based Simulators7 Nov 2025
- 2025PhysWorld: From Real Videos to World Models of Deformable Objects via Physics-Aware Demonstration Synthesis24 Oct 2025
- 2025Generalized Dynamics Generation towards Scannable Physical World Model16 Oct 2025
- 2025Pixie: Fast and Generalizable Supervised Learning of 3D Physics from Pixels20 Aug 2025
- 2025VisionLaw: Inferring Interpretable Intrinsic Dynamics from Visual Observations via Bilevel Optimization19 Aug 2025
- 2025MASIV: Toward Material-Agnostic System Identification from Videos1 Aug 2025
- 2025Particle-Grid Neural Dynamics for Learning Deformable Object Models from RGB-D Videos18 Jun 2025
- 2025ProJo4D: Progressive Joint Optimization for Sparse-View Inverse Physics Estimation5 Jun 2025
- 2025ParticleGS: Learning Neural Gaussian Particle Dynamics from Videos for Prior-free Physical Motion Extrapolation26 May 2025
- 2025UniPhy: Learning a Unified Constitutive Model for Inverse Physics Simulation22 May 2025
- 2025Exploring the Evolution of Physics Cognition in Video Generation: A Survey27 Mar 2025
- 2025PhysTwin: Physics-Informed Reconstruction and Simulation of Deformable Objects from Videos23 Mar 2025
- 2025Exploiting Edited Large Language Models as General Scientific Optimizers8 Mar 2025
- 2025A Survey of Sim-to-Real Methods in RL: Progress, Prospects and Challenges with Foundation Models18 Feb 2025
- 2025Learning 3D Garment Animation from Trajectories of A Piece of Cloth2 Jan 2025
- 2024GausSim: Foreseeing Reality by Gaussian Simulator for Elastic Objects23 Dec 2024
- 2024Stabilizing Reinforcement Learning in Differentiable Multiphysics Simulation16 Dec 2024
- 2024Safe PDE Boundary Control with Neural Operators23 Nov 2024
- 2024Dynamic 3D Gaussian Tracking for Graph-Based Neural Dynamics Modeling24 Oct 2024
- 2024Neural Material Adaptor for Visual Grounding of Intrinsic Dynamics10 Oct 2024
- 2024PokeFlex: A Real-World Dataset of Volumetric Deformable Objects for Robotics10 Oct 2024
- 2024Learning Object Properties Using Robot Proprioception via Differentiable Robot-Object Interaction4 Oct 2024
- 2024A Neural Material Point Method for Particle-based Emulation28 Aug 2024
- 2024KAN 2.0: Kolmogorov-Arnold Networks Meet Science19 Aug 2024
- 2024Learning Physics-Consistent Material Behavior from Dynamic Displacements25 Jul 2024
- 2024Learning Lagrangian Interaction Dynamics with Sampling-Based Model Order Reduction4 Jul 2024
- 2024GIC: Gaussian-Informed Continuum for Physical Property Identification and Simulation21 Jun 2024
- 2024LLM and Simulation as Bilevel Optimizers: A New Paradigm to Advance Physical Scientific Discovery16 May 2024
- 2024PhysDreamer: Physics-Based Interaction with 3D Objects via Video Generation19 Apr 2024
50 newest of 56 All 56 (JSON)
- 2024PhysDreamer: Physics-Based Interaction with 3D Objects via Video Generationcited by 185
- 2025PhysWorld: From Real Videos to World Models of Deformable Objects via Physics-Aware Demonstration Synthesiscited by 9
- 2026PhysCoRe: Physics-Corrected Residual World Models for Material-Aware Deformable Dynamicscited by 1
- 2025Generalized Dynamics Generation towards Scannable Physical World Modelcited by 0
- 2026NeuIDO: Neural Intrinsic Dynamics Operator for Physics-Informed 4D World Modelscited by 0
- 2026NeuIDO: Neural Intrinsic Dynamics Operator for Physics-Informed 4D World Models21 Sep 2026
- 2026PhysCoRe: Physics-Corrected Residual World Models for Material-Aware Deformable Dynamics22 Jul 2026
- 2025PhysWorld: From Real Videos to World Models of Deformable Objects via Physics-Aware Demonstration Synthesis24 Oct 2025
- 2025Generalized Dynamics Generation towards Scannable Physical World Model16 Oct 2025
- 2024PhysDreamer: Physics-Based Interaction with 3D Objects via Video Generation19 Apr 2024
- 2023PhysGaussian: Physics-Integrated 3D Gaussians for Generative Dynamicscited by 368
- 2024KAN 2.0: Kolmogorov-Arnold Networks Meet Sciencecited by 116
- 2024Reconstruction and Simulation of Elastic Objects with Spring-Mass 3D Gaussianscited by 92
- 2025PhysTwin: Physics-Informed Reconstruction and Simulation of Deformable Objects from Videoscited by 78
- 2024GIC: Gaussian-Informed Continuum for Physical Property Identification and Simulationcited by 48
- 2024Dynamic 3D Gaussian Tracking for Graph-Based Neural Dynamics Modelingcited by 42
- 2025A Survey of Sim-to-Real Methods in RL: Progress, Prospects and Challenges with Foundation Modelscited by 36
- 2024Neural Material Adaptor for Visual Grounding of Intrinsic Dynamicscited by 30
- 2023Physics-Informed Computer Vision: A Review and Perspectivescited by 28
- 2025Particle-Grid Neural Dynamics for Learning Deformable Object Models from RGB-D Videoscited by 22
- 2025Pixie: Fast and Generalizable Supervised Learning of 3D Physics from Pixelscited by 22
- 2024Stabilizing Reinforcement Learning in Differentiable Multiphysics Simulationcited by 14
12 most cited of 47 All 47 (JSON)
- 2026Neural Constitutive Learning for Generalized Reaction-Diffusion Systems29 Sep 2026
- 2026Analytic Dynamics: Learning Physics-Grounded Representation for Fast Intrinsic Dynamics Inference from Monocular Videos31 Aug 2026
- 2026Learning Implicit Constitutive Laws for Dynamic 3D Gaussian Splatting from Monocular Videos22 Aug 2026
- 2026Learning Physics-Guided Residual Dynamics for Deformable Object Simulation15 Jul 2026
- 2026Latent Space Reinforcement Learning for Inverse Material Estimation in Food Fracture Simulation15 Jun 2026
- 2026NeuROK: Generative 4D Neural Object Kinematics28 May 2026
- 2026MonoPhysics: Estimating Geometry, Appearance, and Physical Parameters from Monocular Videos28 May 2026
- 2026MoSA: Motion-constrained Stress Adaptation for Mitigating Real-to-Sim Gap in Continuum Dynamics via Learning Residual Anisotropy21 May 2026
- 2026Mesh Field Theory: Port-Hamiltonian Formulation of Mesh-Based Physics1 May 2026
- 2026Momentum-Conserving Graph Neural Networks for Deformable Objects28 Apr 2026
- 2026ReconPhys: Reconstruct Appearance and Physical Attributes from Single Video9 Apr 2026
- 2026RAFL: Generalizable Sim-to-Real of Soft Robots with Residual Acceleration Field Learning23 Mar 2026
12 newest of 47 All 47 (JSON)