Let it Snow! Animating 3D Gaussian Scenes with Dynamic Weather Effects via Physics-Guided Score Distillation
Not on the map. Why?
Abstract (arXiv)
3D Gaussian Splatting has recently enabled fast and photorealistic reconstruction of static 3D scenes. However, dynamic editing of such scenes remains a significant challenge. We introduce a novel framework, Physics-Guided Score Distillation, to address a fundamental conflict: physics simulation provides a strong motion prior that is insufficient for photorealism , while video-based Score Distillation Sampling (SDS) alone cannot generate coherent motion for complex, multi-particle scenarios. We resolve this through a unified optimization framework where physics simulation guides Score Distillation to jointly refine the motion prior for photorealism while simultaneously optimizing appearance. Specifically, we learn a neural dynamics model that predicts particle motion and appearance, optimized end-to-end via a combined loss integrating Video-SDS for photorealism with our physics-guidance prior. This allows for photorealistic refinements while ensuring the dynamics remain plausible. Our framework enables scene-wide dynamic weather effects, including snowfall, rainfall, fog, and sandstorms, with physically plausible motion. Experiments demonstrate our physics-guided approach significantly outperforms baselines, with ablations confirming this joint refinement is essential for generating coherent, high-fidelity dynamics.
Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Builds on 34 of its 45 references that are in the map. First posted on arXiv 7 Apr 2025.
Builds on
34 of 45 references.
References · 34
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
- 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,025
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
- 2021Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fieldscited by 2,032
- 20234D Gaussian Splatting for Real-Time Dynamic Scene Renderingcited by 1,157
- 20242D Gaussian Splatting for Geometrically Accurate Radiance Fieldscited by 1,076
- 2018Open3D: A Modern Library for 3D Data Processingcited by 721
- 2023Instruct-NeRF2NeRF: Editing 3D Scenes with Instructionscited by 484
- 2024Evaluating Text-to-Visual Generation with Image-to-Text Generationcited by 474
- 2023PhysGaussian: Physics-Integrated 3D Gaussians for Generative Dynamicscited by 377
- 2023GaussianEditor: Swift and Controllable 3D Editing with Gaussian Splattingcited by 335
22 more
- 2023Text-To-4D Dynamic Scene Generationcited by 205
- 2023DreamGaussian4D: Generative 4D Gaussian Splattingcited by 194
- 2024PhysDreamer: Physics-Based Interaction with 3D Objects via Video Generationcited by 191
- 2023Align Your Gaussians: Text-to-4D with Dynamic 3D Gaussians and Composed Diffusion Modelscited by 169
- 2023GaussianEditor: Editing 3D Gaussians Delicately with Text Instructionscited by 168
- 2023DreamEditor: Text-Driven 3D Scene Editing with Neural Fieldscited by 155
- 2023PAC-NeRF: Physics Augmented Continuum Neural Radiance Fields for Geometry-Agnostic System Identificationcited by 154
- 2023Vox-E: Text-guided Voxel Editing of 3D Objectscited by 115
- 2023Animate124: Animating One Image to 4D Dynamic Scenecited by 115
- 2024GaussCtrl: Multi-View Consistent Text-Driven 3D Gaussian Splatting Editingcited by 115
- 2023Noise-Free Score Distillationcited by 99
- 2024Feature Splatting: Language-Driven Physics-Based Scene Synthesis and Editingcited by 45
- 2024DreamPhysics: Learning Physics-Based 3D Dynamics with Video Diffusion Priorscited by 41
- 2024Rethinking Score Distillation as a Bridge Between Image Distributionscited by 38
- 2022ClimateNeRF: Extreme Weather Synthesis in Neural Radiance Fieldcited by 37
- 2024Gaussian Splashing: Unified Particles for Versatile Motion Synthesis and Renderingcited by 37
- 2024Instruct 4D-to-4D: Editing 4D Scenes as Pseudo-3D Scenes Using 2D Diffusioncited by 24
- 2025Through-The-Mask: Mask-based Motion Trajectories for Image-to-Video Generationcited by 20
- 2025RainyGS: Efficient Rain Synthesis with Physically-Based Gaussian Splattingcited by 13
- 2024GenN2N: Generative NeRF2NeRF Translationcited by 11
- 2024VE-Bench: Subjective-Aligned Benchmark Suite for Text-Driven Video Editing Quality Assessmentcited by 11
- 2024Gaussians-to-Life: Text-Driven Animation of 3D Gaussian Splatting Scenescited by 9
Built on by
Citing papers per year: 2025: 3; 2026: 4.
7 papers.
- 2025RealX3D: A Physically-Degraded 3D Benchmark for Multi-view Visual Restoration and Reconstructioncited by 19
- 2025Controllable Weather Synthesis and Removal with Video Diffusion Modelscited by 11
- 2025Weather-Magician: Reconstruction and Rendering Framework for 4D Weather Synthesis In Real Timecited by 4
- 2026WeatherCity: Urban Scene Reconstruction with Controllable Multi-Weather Transformationcited by 2
- 2026Semantic-Aware, Physics-Informed, Geometry-Grounded Weather Video Synthesiscited by 1
- 2026MV-Forcing: Long Multi-View Video Generation via 4D-Grounded Spatio-Temporal Self-Forcingcited by 1
- 2026Make It Flow: Animating Water in 3D Gaussian Splatting Scenescited by 0
- 2026Make It Flow: Animating Water in 3D Gaussian Splatting Scenes9 Oct 2026
- 2026MV-Forcing: Long Multi-View Video Generation via 4D-Grounded Spatio-Temporal Self-Forcing6 Jul 2026
- 2026Semantic-Aware, Physics-Informed, Geometry-Grounded Weather Video Synthesis27 Jun 2026
- 2026WeatherCity: Urban Scene Reconstruction with Controllable Multi-Weather Transformation25 Feb 2026
- 2025RealX3D: A Physically-Degraded 3D Benchmark for Multi-view Visual Restoration and Reconstruction29 Dec 2025
- 2025Weather-Magician: Reconstruction and Rendering Framework for 4D Weather Synthesis In Real Time26 May 2025
- 2025Controllable Weather Synthesis and Removal with Video Diffusion Models1 May 2025