D-Prism: Differentiable Primitives for Structured Dynamic Modeling
Not on the map. Why?
Abstract (arXiv)
Capturing both geometry and rigid motion for structured dynamic objects, like multi-part assemblies or jointed mechanisms, remains a key challenge. Existing dynamic methods, such as deformable meshes or 3DGS, rely on unstructured representations and fail to jointly model suitable geometry and articulated motion. Primitive-based methods excel at structured static scenes, but their dynamic potential is still unexplored. We propose D-Prism, the first framework to achieve high-fidelity structured dynamic modeling by extending differentiable primitives to the dynamic domain. Specifically, we bind 3DGS to primitive surfaces, leveraging their respective strengths in appearance and geometry. We introduce a deformation network to control primitive motion, ensuring it accurately matches the object's movement. Furthermore, we design a novel adaptive control strategy to dynamically adjust primitive counts, better matching objects' true spatial footprint. Experiments confirm that our method excels at structured dynamic modeling, providing both structured geometry and precise motion tracking.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 62 of its 74 references that are in the map. First posted on arXiv 18 Apr 2026.
Builds on
62 of 74 references.
References · 62
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
- 2020Fourier Features Let Networks Learn High Frequency Functions in Low Dimensional Domainscited by 2,170
- 2021NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstructioncited by 1,701
- 2020D-NeRF: Neural Radiance Fields for Dynamic Scenescited by 1,459
- 2020Nerfies: Deformable Neural Radiance Fieldscited by 1,194
- 2018On the Continuity of Rotation Representations in Neural Networkscited by 1,186
- 20234D Gaussian Splatting for Real-Time Dynamic Scene Renderingcited by 1,144
- 2023Deformable 3D Gaussians for High-Fidelity Monocular Dynamic Scene Reconstructioncited by 753
- 2020Neural Scene Flow Fields for Space-Time View Synthesis of Dynamic Scenescited by 750
- 2023K-Planes: Explicit Radiance Fields in Space, Time, and Appearancecited by 742
- 2023Dynamic 3D Gaussians: Tracking by Persistent Dynamic View Synthesiscited by 731
- 2018Pixel2Mesh: Generating 3D Mesh Models from Single RGB Imagescited by 649
38 more
- 2020SAPIEN: A SimulAted Part-based Interactive ENvironmentcited by 584
- 2023HexPlane: A Fast Representation for Dynamic Scenescited by 582
- 2023Real-time Photorealistic Dynamic Scene Representation and Rendering with 4D Gaussian Splattingcited by 470
- 2021Deep Marching Tetrahedra: a Hybrid Representation for High-Resolution 3D Shape Synthesiscited by 459
- 2020Modular Primitives for High-Performance Differentiable Renderingcited by 439
- 2021Dynamic View Synthesis from Dynamic Monocular Videocited by 420
- 2020Space-time Neural Irradiance Fields for Free-Viewpoint Videocited by 414
- 2022Fast Dynamic Radiance Fields with Time-Aware Neural Voxelscited by 344
- 2023Spacetime Gaussian Feature Splatting for Real-Time Dynamic View Synthesiscited by 341
- 2018Learning Category-Specific Mesh Reconstruction from Image Collectionscited by 317
- 2020Neural Radiance Flow for 4D View Synthesis and Video Processingcited by 270
- 2024Shape of Motion: 4D Reconstruction from a Single Videocited by 247
- 2022Tensor4D : Efficient Neural 4D Decomposition for High-fidelity Dynamic Reconstruction and Renderingcited by 217
- 2019BSP-Net: Generating Compact Meshes via Binary Space Partitioningcited by 205
- 2022Monocular Dynamic View Synthesis: A Reality Checkcited by 199
- 2016Learning Shape Abstractions by Assembling Volumetric Primitivescited by 181
- 2019CvxNet: Learnable Convex Decompositioncited by 173
- 2023Flexible Isosurface Extraction for Gradient-Based Mesh Optimizationcited by 138
- 2024Recent Advances in 3D Gaussian Splattingcited by 130
- 2019Superquadrics Revisited: Learning 3D Shape Parsing beyond Cuboidscited by 123
- 2021LASR: Learning Articulated Shape Reconstruction from a Monocular Videocited by 115
- 2019SDM-NET: Deep Generative Network for Structured Deformable Meshcited by 113
- 2020MeshSDF: Differentiable Iso-Surface Extractioncited by 112
- 2019Deep Mesh Reconstruction from Single RGB Images via Topology Modification Networkscited by 106
- 2021Neural Parts: Learning Expressive 3D Shape Abstractions with Invertible Neural Networkscited by 101
- 2020Learning Unsupervised Hierarchical Part Decomposition of 3D Objects from a Single RGB Imagecited by 72
- 2022Neural Dual Contouringcited by 71
- 2024GaMeS: Mesh-Based Adapting and Modification of Gaussian Splattingcited by 69
- 2021DOVE: Learning Deformable 3D Objects by Watching Videoscited by 61
- 2020Online Adaptation for Consistent Mesh Reconstruction in the Wildcited by 51
- 2020Implicit Mesh Reconstruction from Unannotated Image Collectionscited by 49
- 2024Superpoint Gaussian Splatting for Real-Time High-Fidelity Dynamic Scene Reconstructioncited by 43
- 2023Differentiable Blocks World: Qualitative 3D Decomposition by Rendering Primitivescited by 37
- 2023PartNeRF: Generating Part-Aware Editable 3D Shapes without 3D Supervisioncited by 36
- 2022Neural Template: Topology-aware Reconstruction and Disentangled Generation of 3D Meshescited by 34
- 2021Robust and Accurate Superquadric Recovery: a Probabilistic Approachcited by 29
- 2022Unbiased 4D: Monocular 4D Reconstruction with a Neural Deformation Modelcited by 25
- 2023NeuManifold: Neural Watertight Manifold Reconstruction with Efficient and High-Quality Rendering Supportcited by 25
50 most cited of 62 All 62 (JSON)
Built on by
Not cited yet.