Resonance4D: Frequency-Domain Motion Supervision for Preset-Free Physical Parameter Learning in 4D Dynamic Physical Scene Simulation
On the map: Diffusion models → Video generation
Abstract (arXiv)
Physics-driven 4D dynamic simulation from static 3D scenes remains constrained by an overlooked contradiction: reliable motion supervision often relies on online video diffusion or optical-flow pipelines whose computational cost exceeds that of the simulator itself. Existing methods further simplify inverse physical modeling by optimizing only partial material parameters, limiting realism in scenes with complex materials and dynamics. We present Resonance4D, a physics-driven 4D dynamic simulation framework that couples 3D Gaussian Splatting with the Material Point Method through lightweight yet physically expressive supervision. Our key insight is that dynamic consistency can be enforced without dense temporal generation by jointly constraining motion in complementary domains. To this end, we introduce Dual-domain Motion Supervision (DMS), which combines spatial structural consistency for local deformation with frequency-domain spectral consistency for oscillatory and global dynamic patterns, substantially reducing training cost and memory overhead while preserving physically meaningful motion cues. To enable stable full-parameter physical recovery, we further combine zero-shot text-prompted segmentation with simulation-guided initialization to automatically decompose Gaussians into object-part-level regions and support joint optimization of full material parameters. Experiments on both synthetic and real scenes show that Resonance4D achieves strong physical fidelity and motion consistency while reducing peak GPU memory from over 35,GB to around 20,GB, enabling high-fidelity physics-driven 4D simulation on a single consumer-grade GPU.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Video generation, one of 14 directions in Diffusion models. First posted on arXiv 2 Apr 2026.
Builds on
0 of 0 references.
No references here yet.
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026MotionPhysics: Learnable Motion Distillation for Text-Guided Simulation
- 2026Phys4D: Fine-Grained Physics-Consistent 4D Modeling from Video Diffusion
- 2024Phy124: Fast Physics-Driven 4D Content Generation from a Single Image
- 2024DreamPhysics: Learning Physics-Based 3D Dynamics with Video Diffusion Priors
- 2024PhysFlow: Unleashing the Potential of Multi-modal Foundation Models and Video Diffusion for 4D Dynamic Physical Scene Simulation
- 2025PhysGM: Large Physical Gaussian Model for Feed-Forward 4D Synthesis
- 2026CP4D: Compositional Physics-aware 4D Scene Generation
- 2026Learning Explicit Physical Parameter Control and Benchmarking for Video Generation