Simplicits: Mesh-Free, Geometry-Agnostic, Elastic Simulation
Not on the map. Why?
Abstract (arXiv)
The proliferation of 3D representations, from explicit meshes to implicit neural fields and more, motivates the need for simulators agnostic to representation. We present a data-, mesh-, and grid-free solution for elastic simulation for any object in any geometric representation undergoing large, nonlinear deformations. We note that every standard geometric representation can be reduced to an occupancy function queried at any point in space, and we define a simulator atop this common interface. For each object, we fit a small implicit neural network encoding spatially varying weights that act as a reduced deformation basis. These weights are trained to learn physically significant motions in the object via random perturbations. Our loss ensures we find a weight-space basis that best minimizes deformation energy by stochastically evaluating elastic energies through Monte Carlo sampling of the deformation volume. At runtime, we simulate in the reduced basis and sample the deformations back to the original domain. Our experiments demonstrate the versatility, accuracy, and speed of this approach on data including signed distance functions, point clouds, neural primitives, tomography scans, radiance fields, Gaussian splats, surface meshes, and volume meshes, as well as showing a variety of material energies, contact models, and time integration schemes.
Key facts. Cited by 26 papers in the map (data through 7 Oct 2026). Builds on 20 of its 63 references that are in the map. First posted on arXiv 9 Jun 2024.
Builds on
20 of 63 references.
References · 20
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
- 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,698
- 2020Implicit Neural Representations with Periodic Activation Functionscited by 2,214
- 2019Towards Robust Monocular Depth Estimation: Mixing Datasets for Zero-shot Cross-dataset Transfercited by 1,484
- 2020D-NeRF: Neural Radiance Fields for Dynamic Scenescited by 1,459
- 2022Magic3D: High-Resolution Text-to-3D Content Creationcited by 1,285
- 2020Nerfies: Deformable Neural Radiance Fieldscited by 1,194
- 2023Nerfstudio: A Modular Framework for Neural Radiance Field Developmentcited by 596
- 2023PhysGaussian: Physics-Integrated 3D Gaussians for Generative Dynamicscited by 368
- 2021SCANimate: Weakly Supervised Learning of Skinned Clothed Avatar Networkscited by 181
- 2021LEAP: Learning Articulated Occupancy of Peoplecited by 107
8 more
- 2023PIE-NeRF: Physics-based Interactive Elastodynamics with NeRFcited by 51
- 2021NTopo: Mesh-free Topology Optimization using Implicit Neural Representationscited by 41
- 2022VolTeMorph: Realtime, Controllable and Generalisable Animation of Volumetric Representationscited by 36
- 2020Codimensional Incremental Potential Contactcited by 33
- 2023Data-Free Learning of Reduced-Order Kinematicscited by 19
- 2023Fast Complementary Dynamics via Skinning Eigenmodescited by 12
- 2023Constrained Delaunay Tetrahedrization: A Robust and Practical Approachcited by 2
- 2018Poly-Spline Finite Element Methodcited by 1
Built on by
Citing papers per year: 2024: 2; 2025: 9; 2026: 15.
26 papers.
Sort:
By area:
- 2025PhysCtrl: Generative Physics for Controllable and Physics-Grounded Video Generationcited by 39
- 2024Efficient Physics Simulation for 3D Scenes via MLLM-Guided Gaussian Splattingcited by 30
- 2024Make-It-Animatable: An Efficient Framework for Authoring Animation-Ready 3D Characterscited by 23
- 2025Vid2Sim: Generalizable, Video-based Reconstruction of Appearance, Geometry and Physics for Mesh-free Simulationcited by 18
- 2025DecoupledGaussian: Object-Scene Decoupling for Physics-Based Interactioncited by 16
- 2025Triangle Splatting+: Differentiable Rendering with Opaque Trianglescited by 5
- 2025ProJo4D: Progressive Joint Optimization for Sparse-View Inverse Physics Estimationcited by 4
- 2025Gaussian-Augmented Physics Simulation and System Identification with Complex Colliderscited by 4
- 2025Low-Rank Adaptation of Neural Fieldscited by 2
- 2026ArtisanGS: Interactive Tools for Gaussian Splat Selection with AI and Human in the Loopcited by 2
- 2026WorldParticle: Unified World Simulation of Lagrangian Particle Dynamics via Transformercited by 2
- 2026NeuROK: Generative 4D Neural Object Kinematicscited by 2
14 more
- 2026Axolotl3D: a Unified Framework for Faithful 3D Shape Completioncited by 2
- 2026FreeForm: Reduced-Order Deformable Simulation from Particle-Based Skinning Eigenmodescited by 1
- 2026UniPixie: Unified and Probabilistic 3D Physics Learning via Flow Matchingcited by 1
- 2026Adaptive Volumetric Mechanical Property Fields Invariant to Resolutioncited by 1
- 2025Snap-and-tune: combining deep learning and test-time optimization for high-fidelity cardiovascular volumetric meshingcited by 0
- 2025Generalized Dynamics Generation towards Scannable Physical World Modelcited by 0
- 2026PhysSkin: Real-Time and Generalizable Physics-Based Animation via Self-Supervised Neural Skinningcited by 0
- 2026Learning Orthonormal Bases for Function Spacescited by 0
- 2026HyperBones: Realtime Bone-driven Neural Garment Simulation with Hypernetwork Conditioningcited by 0
- 2026MoSA: Motion-constrained Stress Adaptation for Mitigating Real-to-Sim Gap in Continuum Dynamics via Learning Residual Anisotropycited by 0
- 2026MonoPhysics: Estimating Geometry, Appearance, and Physical Parameters from Monocular Videoscited by 0
- 2026NewtPhys: Do Foundation Models Understand Newtonian Physics?cited by 0
- 2026TRON: Tracing Rays to Orchestrate a Neural Renderer for 3D Gaussian Reconstructionscited by 0
- 2026RealSimLoop: Online Real-to-Sim Adaptation via Differentiable Reduced-Order Simulation with Vision Feedbackcited by 0
- 2026RealSimLoop: Online Real-to-Sim Adaptation via Differentiable Reduced-Order Simulation with Vision Feedback9 Sep 2026
- 2026Axolotl3D: a Unified Framework for Faithful 3D Shape Completion22 Jul 2026
- 2026Adaptive Volumetric Mechanical Property Fields Invariant to Resolution16 Jun 2026
- 2026TRON: Tracing Rays to Orchestrate a Neural Renderer for 3D Gaussian Reconstructions9 Jun 2026
- 2026UniPixie: Unified and Probabilistic 3D Physics Learning via Flow Matching3 Jun 2026
- 2026NewtPhys: Do Foundation Models Understand Newtonian Physics?2 Jun 2026
- 2026NeuROK: Generative 4D Neural Object Kinematics28 May 2026
- 2026MonoPhysics: Estimating Geometry, Appearance, and Physical Parameters from Monocular Videos28 May 2026
- 2026FreeForm: Reduced-Order Deformable Simulation from Particle-Based Skinning Eigenmodes28 May 2026
- 2026MoSA: Motion-constrained Stress Adaptation for Mitigating Real-to-Sim Gap in Continuum Dynamics via Learning Residual Anisotropy21 May 2026
- 2026HyperBones: Realtime Bone-driven Neural Garment Simulation with Hypernetwork Conditioning19 May 2026
- 2026Learning Orthonormal Bases for Function Spaces19 May 2026
14 more
- 2026WorldParticle: Unified World Simulation of Lagrangian Particle Dynamics via Transformer14 May 2026
- 2026PhysSkin: Real-Time and Generalizable Physics-Based Animation via Self-Supervised Neural Skinning24 Mar 2026
- 2026ArtisanGS: Interactive Tools for Gaussian Splat Selection with AI and Human in the Loop10 Feb 2026
- 2025Gaussian-Augmented Physics Simulation and System Identification with Complex Colliders10 Nov 2025
- 2025Generalized Dynamics Generation towards Scannable Physical World Model16 Oct 2025
- 2025Triangle Splatting+: Differentiable Rendering with Opaque Triangles29 Sep 2025
- 2025PhysCtrl: Generative Physics for Controllable and Physics-Grounded Video Generation24 Sep 2025
- 2025Snap-and-tune: combining deep learning and test-time optimization for high-fidelity cardiovascular volumetric meshing9 Jun 2025
- 2025Vid2Sim: Generalizable, Video-based Reconstruction of Appearance, Geometry and Physics for Mesh-free Simulation6 Jun 2025
- 2025ProJo4D: Progressive Joint Optimization for Sparse-View Inverse Physics Estimation5 Jun 2025
- 2025Low-Rank Adaptation of Neural Fields22 Apr 2025
- 2025DecoupledGaussian: Object-Scene Decoupling for Physics-Based Interaction7 Mar 2025
- 2024Make-It-Animatable: An Efficient Framework for Authoring Animation-Ready 3D Characters27 Nov 2024
- 2024Efficient Physics Simulation for 3D Scenes via MLLM-Guided Gaussian Splatting19 Nov 2024
- 2024Efficient Physics Simulation for 3D Scenes via MLLM-Guided Gaussian Splattingcited by 30
- 2024Make-It-Animatable: An Efficient Framework for Authoring Animation-Ready 3D Characterscited by 23
- 2025Vid2Sim: Generalizable, Video-based Reconstruction of Appearance, Geometry and Physics for Mesh-free Simulationcited by 18
- 2025DecoupledGaussian: Object-Scene Decoupling for Physics-Based Interactioncited by 16
- 2025Triangle Splatting+: Differentiable Rendering with Opaque Trianglescited by 5
- 2025ProJo4D: Progressive Joint Optimization for Sparse-View Inverse Physics Estimationcited by 4
- 2025Gaussian-Augmented Physics Simulation and System Identification with Complex Colliderscited by 4
- 2025Low-Rank Adaptation of Neural Fieldscited by 2
- 2026ArtisanGS: Interactive Tools for Gaussian Splat Selection with AI and Human in the Loopcited by 2
- 2026WorldParticle: Unified World Simulation of Lagrangian Particle Dynamics via Transformercited by 2
- 2026NeuROK: Generative 4D Neural Object Kinematicscited by 2
- 2026Axolotl3D: a Unified Framework for Faithful 3D Shape Completioncited by 2
12 most cited of 23 All 23 (JSON)
- 2026RealSimLoop: Online Real-to-Sim Adaptation via Differentiable Reduced-Order Simulation with Vision Feedback9 Sep 2026
- 2026Axolotl3D: a Unified Framework for Faithful 3D Shape Completion22 Jul 2026
- 2026Adaptive Volumetric Mechanical Property Fields Invariant to Resolution16 Jun 2026
- 2026TRON: Tracing Rays to Orchestrate a Neural Renderer for 3D Gaussian Reconstructions9 Jun 2026
- 2026NewtPhys: Do Foundation Models Understand Newtonian Physics?2 Jun 2026
- 2026NeuROK: Generative 4D Neural Object Kinematics28 May 2026
- 2026MonoPhysics: Estimating Geometry, Appearance, and Physical Parameters from Monocular Videos28 May 2026
- 2026FreeForm: Reduced-Order Deformable Simulation from Particle-Based Skinning Eigenmodes28 May 2026
- 2026MoSA: Motion-constrained Stress Adaptation for Mitigating Real-to-Sim Gap in Continuum Dynamics via Learning Residual Anisotropy21 May 2026
- 2026HyperBones: Realtime Bone-driven Neural Garment Simulation with Hypernetwork Conditioning19 May 2026
- 2026Learning Orthonormal Bases for Function Spaces19 May 2026
- 2026WorldParticle: Unified World Simulation of Lagrangian Particle Dynamics via Transformer14 May 2026
12 newest of 23 All 23 (JSON)