mlsanityData to 14 Oct 2026

Real-Time Physics Simulation with Dynamic Mesh-Gaussian Reconstructions

arXiv 2606.00444 ↗First posted 30 May 2026cs.CV cs.GRcited by 0

Not on the map. Why?

Abstract (arXiv)

Integrating dynamic 3D reconstructions into physics simulation requires fixed mesh topology for efficient collision detection, but state-of-the-art methods like DG-Mesh produce varying topology optimized for geometric quality. We investigate whether topology conversion can enable physics integration while preserving reconstruction fidelity. We propose a dual-representation framework combining fixed-topology meshes for physics with Gaussian splatting for rendering, achieving 4.65× speedup over varying-topology baselines through runtime vertex buffer updates. We evaluate two conversion strategies, temporal correspondence tracking and template-based projection, against native fixed-topology methods (MaGS) on the DG-Mesh dataset. Our evaluation reveals that both conversion approaches incur 65-80% geometric degradation, producing results inferior to MaGS despite DG-Mesh's superior initial quality. This demonstrates that high-quality reconstruction and physics-compatible topology represent fundamentally distinct objectives that cannot be reconciled through post-processing. Our findings inform future development of physics-aware reconstruction methods and our framework enables real-time simulation with any fixed-topology approach.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 17 of its 25 references that are in the map. First posted on arXiv 30 May 2026.

Builds on

17 of 25 references.

References · 17

  1. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
  2. 2020D-NeRF: Neural Radiance Fields for Dynamic Scenescited by 1,465
  3. 2020Nerfies: Deformable Neural Radiance Fieldscited by 1,198
  4. 20234D Gaussian Splatting for Real-Time Dynamic Scene Renderingcited by 1,157
  5. 2023Deformable 3D Gaussians for High-Fidelity Monocular Dynamic Scene Reconstructioncited by 759
  6. 2023Dynamic 3D Gaussians: Tracking by Persistent Dynamic View Synthesiscited by 737
  7. 2023SuGaR: Surface-Aligned Gaussian Splatting for Efficient 3D Mesh Reconstruction and High-Quality Mesh Renderingcited by 616
  8. 2021Dynamic View Synthesis from Dynamic Monocular Videocited by 420
  9. 2023PhysGaussian: Physics-Integrated 3D Gaussians for Generative Dynamicscited by 377
  10. 2023SC-GS: Sparse-Controlled Gaussian Splatting for Editable Dynamic Scenescited by 347
  11. 2024GaMeS: Mesh-Based Adapting and Modification of Gaussian Splattingcited by 70
  12. 2024Gaussian Garments: Reconstructing Simulation-Ready Clothing with Photorealistic Appearance from Multi-View Videocited by 25
5 more
  1. 2024GASP: Gaussian Splatting for Physic-Based Simulationscited by 24
  2. 2025PGC: Physics-Based Gaussian Cloth from a Single Posecited by 11
  3. 2024MaGS: Reconstructing and Simulating Dynamic 3D Objects with Mesh-adsorbed Gaussian Splattingcited by 9
  4. 2025Splatting Physical Scenes: End-to-End Real-to-Sim from Imperfect Robot Datacited by 5
  5. 2025GS-Verse: Mesh-based Gaussian Splatting for Physics-aware Interaction in Virtual Realitycited by 2

Built on by

Not cited yet.