mlsanityData to 14 Oct 2026

PIE-NeRF: Physics-based Interactive Elastodynamics with NeRF

arXiv 2311.13099 ↗First posted 22 Nov 2023cs.CV cs.AI cs.GRcited by 51

Not on the map. Why?

Abstract (arXiv)

We show that physics-based simulations can be seamlessly integrated with NeRF to generate high-quality elastodynamics of real-world objects. Unlike existing methods, we discretize nonlinear hyperelasticity in a meshless way, obviating the necessity for intermediate auxiliary shape proxies like a tetrahedral mesh or voxel grid. A quadratic generalized moving least square (Q-GMLS) is employed to capture nonlinear dynamics and large deformation on the implicit model. Such meshless integration enables versatile simulations of complex and codimensional shapes. We adaptively place the least-square kernels according to the NeRF density field to significantly reduce the complexity of the nonlinear simulation. As a result, physically realistic animations can be conveniently synthesized using our method for a wide range of hyperelastic materials at an interactive rate. For more information, please visit our project page at https://fytalon.github.io/pienerf/.

Key facts. Cited by 51 papers in the map (data through 14 Oct 2026). Builds on 52 of its 94 references that are in the map. First posted on arXiv 22 Nov 2023.

Builds on

52 of 94 references.

References · 52

  1. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
  2. 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,723
  3. 2020D-NeRF: Neural Radiance Fields for Dynamic Scenescited by 1,465
  4. 2020Nerfies: Deformable Neural Radiance Fieldscited by 1,198
  5. 2020Neural Sparse Voxel Fieldscited by 959
  6. 2021PlenOctrees for Real-time Rendering of Neural Radiance Fieldscited by 905
  7. 2020Neural Scene Flow Fields for Space-Time View Synthesis of Dynamic Scenescited by 751
  8. 2023HexPlane: A Fast Representation for Dynamic Scenescited by 587
  9. 2021FastNeRF: High-Fidelity Neural Rendering at 200FPScited by 511
  10. 2022Point-NeRF: Point-based Neural Radiance Fieldscited by 503
  11. 2020NeRV: Neural Reflectance and Visibility Fields for Relighting and View Synthesiscited by 496
  12. 2023Instruct-NeRF2NeRF: Editing 3D Scenes with Instructionscited by 484
38 more
  1. 2022HumanNeRF: Free-viewpoint Rendering of Moving People from Monocular Videocited by 483
  2. 2020Non-Rigid Neural Radiance Fields: Reconstruction and Novel View Synthesis of a Dynamic Scene From Monocular Videocited by 471
  3. 2021Putting NeRF on a Diet: Semantically Consistent Few-Shot View Synthesiscited by 464
  4. 2021Dynamic View Synthesis from Dynamic Monocular Videocited by 420
  5. 2020Space-time Neural Irradiance Fields for Free-Viewpoint Videocited by 414
  6. 2022Decomposing NeRF for Editing via Feature Field Distillationcited by 371
  7. 2021CLIP-NeRF: Text-and-Image Driven Manipulation of Neural Radiance Fieldscited by 370
  8. 2020Neural Radiance Flow for 4D View Synthesis and Video Processingcited by 270
  9. 2021Learning Object-Compositional Neural Radiance Field for Editable Scene Renderingcited by 228
  10. 2021Editing Conditional Radiance Fieldscited by 222
  11. 2022NeRF-Editing: Geometry Editing of Neural Radiance Fieldscited by 217
  12. 2023PAC-NeRF: Physics Augmented Continuum Neural Radiance Fields for Geometry-Agnostic System Identificationcited by 154
  13. 2021Editable Free-viewpoint Video Using a Layered Neural Representationcited by 148
  14. 2022NeuMesh: Learning Disentangled Neural Mesh-based Implicit Field for Geometry and Texture Editingcited by 142
  15. 2021NeRF for Outdoor Scene Relightingcited by 114
  16. 2021FENeRF: Face Editing in Neural Radiance Fieldscited by 112
  17. 2022DeVRF: Fast Deformable Voxel Radiance Fields for Dynamic Scenescited by 103
  18. 2023SINE: Semantic-driven Image-based NeRF Editing with Prior-guided Editing Fieldcited by 94
  19. 2022Deforming Radiance Fields with Cagescited by 78
  20. 2023SKED: Sketch-guided Text-based 3D Editingcited by 73
  21. 2023Forward Flow for Novel View Synthesis of Dynamic Scenescited by 68
  22. 2022Removing Objects From Neural Radiance Fieldscited by 66
  23. 2021CoNeRF: Controllable Neural Radiance Fieldscited by 65
  24. 2022Control-NeRF: Editable Feature Volumes for Scene Rendering and Manipulationcited by 57
  25. 2022IntrinsicNeRF: Learning Intrinsic Neural Radiance Fields for Editable Novel View Synthesiscited by 50
  26. 2022NeuPhysics: Editable Neural Geometry and Physics from Monocular Videoscited by 50
  27. 2022Neural Deformable Voxel Grid for Fast Optimization of Dynamic View Synthesiscited by 43
  28. 2023NeuralEditor: Editing Neural Radiance Fields via Manipulating Point Cloudscited by 41
  29. 2022FDNeRF: Few-shot Dynamic Neural Radiance Fields for Face Reconstruction and Expression Editingcited by 38
  30. 2023Dynamic Point Fieldscited by 37
  31. 2022VolTeMorph: Realtime, Controllable and Generalisable Animation of Volumetric Representationscited by 36
  32. 2022NeRFFaceEditing: Disentangled Face Editing in Neural Radiance Fieldscited by 33
  33. 2022EditableNeRF: Editing Topologically Varying Neural Radiance Fields by Key Pointscited by 30
  34. 2023Blending-NeRF: Text-Driven Localized Editing in Neural Radiance Fieldscited by 28
  35. 2023RecolorNeRF: Layer Decomposed Radiance Fields for Efficient Color Editing of 3D Scenescited by 25
  36. 2022Neural Implicit Representations for Physical Parameter Inference from a Single Videocited by 19
  37. 2022PaletteNeRF: Palette-based Color Editing for NeRFscited by 18
  38. 2023Seal-3D: Interactive Pixel-Level Editing for Neural Radiance Fieldscited by 18

50 most cited of 52 All 52 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 14; 2025: 26; 2026: 11.

51 papers.

Sort:

By area:

  1. 2024PhysDreamer: Physics-Based Interaction with 3D Objects via Video Generationcited by 191
  2. 2024VR-GS: A Physical Dynamics-Aware Interactive Gaussian Splatting System in Virtual Realitycited by 179
  3. 2025PhysTwin: Physics-Informed Reconstruction and Simulation of Deformable Objects from Videoscited by 87
  4. 2024GIC: Gaussian-Informed Continuum for Physical Property Identification and Simulationcited by 49
  5. 2024Physically Compatible 3D Object Modeling from a Single Imagecited by 39
  6. 2024Gaussian Splashing: Unified Particles for Versatile Motion Synthesis and Renderingcited by 37
  7. 2024Neural Material Adaptor for Visual Grounding of Intrinsic Dynamicscited by 32
  8. 2024Efficient Physics Simulation for 3D Scenes via MLLM-Guided Gaussian Splattingcited by 32
  9. 2025Exploring the Evolution of Physics Cognition in Video Generation: A Surveycited by 31
  10. 2024Simplicits: Mesh-Free, Geometry-Agnostic, Elastic Simulationcited by 27
  11. 2024AutoVFX: Physically Realistic Video Editing from Natural Language Instructionscited by 27
  12. 2025DSO: Aligning 3D Generators with Simulation Feedback for Physical Soundnesscited by 25
38 more
  1. 2025Generative Physical AI in Vision: A Surveycited by 24
  2. 2024Neural Fields in Robotics: A Surveycited by 21
  3. 2025FluidNexus: 3D Fluid Reconstruction and Prediction from a Single Videocited by 21
  4. 2025Vid2Sim: Generalizable, Video-based Reconstruction of Appearance, Geometry and Physics for Mesh-free Simulationcited by 20
  5. 2025DecoupledGaussian: Object-Scene Decoupling for Physics-Based Interactioncited by 17
  6. 2025Articulated Kinematics Distillation from Video Diffusion Modelscited by 13
  7. 2025Grounding Creativity in Physics: A Brief Survey of Physical Priors in AIGCcited by 12
  8. 2024ElastoGen: 4D Generative Elastodynamicscited by 10
  9. 2025PhysWorld: From Real Videos to World Models of Deformable Objects via Physics-Aware Demonstration Synthesiscited by 10
  10. 2025MASIV: Toward Material-Agnostic System Identification from Videoscited by 9
  11. 2026PhyScensis: Physics-Augmented LLM Agents for Complex Physical Scene Arrangementcited by 7
  12. 2025Is Single-View Mesh Reconstruction Ready for Robotics?cited by 6
  13. 2026MOSIV: Multi-Object System Identification from Videoscited by 6
  14. 2024Freditor: High-Fidelity and Transferable NeRF Editing by Frequency Decompositioncited by 5
  15. 2025ParticleGS: Learning Neural Gaussian Particle Dynamics from Videos for Prior-free Physical Motion Extrapolationcited by 5
  16. 2025NeuSpring: Neural Spring Fields for Reconstruction and Simulation of Deformable Objects from Videoscited by 5
  17. 2024GausSim: Foreseeing Reality by Gaussian Simulator for Elastic Objectscited by 4
  18. 2025From 2D to 3D Cognition: A Brief Survey of General World Modelscited by 4
  19. 2025Affine-Equivariant Kernel Space Encoding for NeRF Editingcited by 4
  20. 2025Advances in 4D Representation: Geometry, Motion, and Interactioncited by 4
  21. 2025EA3D: Online Open-World 3D Object Extraction from Streaming Videoscited by 4
  22. 2025Gaussian-Augmented Physics Simulation and System Identification with Complex Colliderscited by 4
  23. 2025VisionLaw: Inferring Interpretable Intrinsic Dynamics from Visual Observations via Bilevel Optimizationcited by 3
  24. 2025VDAWorld: World Modelling via VLM-Directed Abstraction and Simulationcited by 3
  25. 2026NeuROK: Generative 4D Neural Object Kinematicscited by 3
  26. 2025Structure from Collisioncited by 1
  27. 2025From images to properties: a NeRF-driven framework for granular material parameter inversioncited by 1
  28. 2025DEM-NeRF: A Neuro-Symbolic Method for Scientific Discovery through Physics-Informed Simulationcited by 1
  29. 2025DensiCrafter: Physically-Constrained Generation and Fabrication of Self-Supporting Hollow Structurescited by 1
  30. 2026NEXUS: Neural Energy Fields for Physically Consistent Contact-Rich 3D Object Dynamicscited by 1
  31. 2026Adaptive Volumetric Mechanical Property Fields Invariant to Resolutioncited by 1
  32. 2024Deformable NeRF using Recursively Subdivided Tetrahedracited by 0
  33. 2025Gaussian Swaying: Surface-Based Framework for Aerodynamic Simulation with 3D Gaussianscited by 0
  34. 2026EgoPhys: Learning Generalizable Physics Models of Deformable Objects from Egocentric Videocited by 0
  35. 2026MeGAS: Thermomechanical Dynamic Gaussian Splatting for Thermophysical Scene Editingcited by 0
  36. 2026Coarse-to-fine Framework for Generative MEF via Implicit Neural Representationcited by 0
  37. 2026BendTwin: Robust Dense-to-Sparse Physical Reconstruction with Bending-Aware Differentiable Spring-Mass Modelscited by 0
  38. 2026Learning Implicit Constitutive Laws for Dynamic 3D Gaussian Splatting from Monocular Videoscited by 0

50 most cited of 51 All 51 (JSON)