mlsanityData to 14 Oct 2026

Let it Snow! Animating 3D Gaussian Scenes with Dynamic Weather Effects via Physics-Guided Score Distillation

arXiv 2504.05296 ↗First posted 7 Apr 2025cs.GR cs.CVcited by 7

Not on the map. Why?

Abstract (arXiv)

3D Gaussian Splatting has recently enabled fast and photorealistic reconstruction of static 3D scenes. However, dynamic editing of such scenes remains a significant challenge. We introduce a novel framework, Physics-Guided Score Distillation, to address a fundamental conflict: physics simulation provides a strong motion prior that is insufficient for photorealism , while video-based Score Distillation Sampling (SDS) alone cannot generate coherent motion for complex, multi-particle scenarios. We resolve this through a unified optimization framework where physics simulation guides Score Distillation to jointly refine the motion prior for photorealism while simultaneously optimizing appearance. Specifically, we learn a neural dynamics model that predicts particle motion and appearance, optimized end-to-end via a combined loss integrating Video-SDS for photorealism with our physics-guidance prior. This allows for photorealistic refinements while ensuring the dynamics remain plausible. Our framework enables scene-wide dynamic weather effects, including snowfall, rainfall, fog, and sandstorms, with physically plausible motion. Experiments demonstrate our physics-guided approach significantly outperforms baselines, with ablations confirming this joint refinement is essential for generating coherent, high-fidelity dynamics.

Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Builds on 34 of its 45 references that are in the map. First posted on arXiv 7 Apr 2025.

Builds on

34 of 45 references.

References · 34

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
  3. 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,025
  4. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
  5. 2021Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fieldscited by 2,032
  6. 20234D Gaussian Splatting for Real-Time Dynamic Scene Renderingcited by 1,157
  7. 20242D Gaussian Splatting for Geometrically Accurate Radiance Fieldscited by 1,076
  8. 2018Open3D: A Modern Library for 3D Data Processingcited by 721
  9. 2023Instruct-NeRF2NeRF: Editing 3D Scenes with Instructionscited by 484
  10. 2024Evaluating Text-to-Visual Generation with Image-to-Text Generationcited by 474
  11. 2023PhysGaussian: Physics-Integrated 3D Gaussians for Generative Dynamicscited by 377
  12. 2023GaussianEditor: Swift and Controllable 3D Editing with Gaussian Splattingcited by 335
22 more
  1. 2023Text-To-4D Dynamic Scene Generationcited by 205
  2. 2023DreamGaussian4D: Generative 4D Gaussian Splattingcited by 194
  3. 2024PhysDreamer: Physics-Based Interaction with 3D Objects via Video Generationcited by 191
  4. 2023Align Your Gaussians: Text-to-4D with Dynamic 3D Gaussians and Composed Diffusion Modelscited by 169
  5. 2023GaussianEditor: Editing 3D Gaussians Delicately with Text Instructionscited by 168
  6. 2023DreamEditor: Text-Driven 3D Scene Editing with Neural Fieldscited by 155
  7. 2023PAC-NeRF: Physics Augmented Continuum Neural Radiance Fields for Geometry-Agnostic System Identificationcited by 154
  8. 2023Vox-E: Text-guided Voxel Editing of 3D Objectscited by 115
  9. 2023Animate124: Animating One Image to 4D Dynamic Scenecited by 115
  10. 2024GaussCtrl: Multi-View Consistent Text-Driven 3D Gaussian Splatting Editingcited by 115
  11. 2023Noise-Free Score Distillationcited by 99
  12. 2024Feature Splatting: Language-Driven Physics-Based Scene Synthesis and Editingcited by 45
  13. 2024DreamPhysics: Learning Physics-Based 3D Dynamics with Video Diffusion Priorscited by 41
  14. 2024Rethinking Score Distillation as a Bridge Between Image Distributionscited by 38
  15. 2022ClimateNeRF: Extreme Weather Synthesis in Neural Radiance Fieldcited by 37
  16. 2024Gaussian Splashing: Unified Particles for Versatile Motion Synthesis and Renderingcited by 37
  17. 2024Instruct 4D-to-4D: Editing 4D Scenes as Pseudo-3D Scenes Using 2D Diffusioncited by 24
  18. 2025Through-The-Mask: Mask-based Motion Trajectories for Image-to-Video Generationcited by 20
  19. 2025RainyGS: Efficient Rain Synthesis with Physically-Based Gaussian Splattingcited by 13
  20. 2024GenN2N: Generative NeRF2NeRF Translationcited by 11
  21. 2024VE-Bench: Subjective-Aligned Benchmark Suite for Text-Driven Video Editing Quality Assessmentcited by 11
  22. 2024Gaussians-to-Life: Text-Driven Animation of 3D Gaussian Splatting Scenescited by 9

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 3; 2026: 4.

7 papers.