mlsanityData to 13 Oct 2026

Grounding Creativity in Physics: A Brief Survey of Physical Priors in AIGC

arXiv 2502.07007 ↗First posted 10 Feb 2025cs.CVcited by 11

Not on the map. Why?

Abstract (arXiv)

Recent advancements in AI-generated content have significantly improved the realism of 3D and 4D generation. However, most existing methods prioritize appearance consistency while neglecting underlying physical principles, leading to artifacts such as unrealistic deformations, unstable dynamics, and implausible objects interactions. Incorporating physics priors into generative models has become a crucial research direction to enhance structural integrity and motion realism. This survey provides a review of physics-aware generative methods, systematically analyzing how physical constraints are integrated into 3D and 4D generation. First, we examine recent works in incorporating physical priors into static and dynamic 3D generation, categorizing methods based on representation types, including vision-based, NeRF-based, and Gaussian Splatting-based approaches. Second, we explore emerging techniques in 4D generation, focusing on methods that model temporal dynamics with physical simulations. Finally, we conduct a comparative analysis of major methods, highlighting their strengths, limitations, and suitability for different materials and motion dynamics. By presenting an in-depth analysis of physics-grounded AIGC, this survey aims to bridge the gap between generative models and physical realism, providing insights that inspire future research in physically consistent content generation.

Key facts. Cited by 11 papers in the map (data through 13 Oct 2026). Builds on 55 of its 66 references that are in the map. First posted on arXiv 10 Feb 2025.

Builds on

55 of 66 references.

References · 55

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,588
  2. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,170
  3. 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,712
  4. 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,019
  5. 2020D-NeRF: Neural Radiance Fields for Dynamic Scenescited by 1,462
  6. 2020Nerfies: Deformable Neural Radiance Fieldscited by 1,195
  7. 20234D Gaussian Splatting for Real-Time Dynamic Scene Renderingcited by 1,150
  8. 2023DreamGaussian: Generative Gaussian Splatting for Efficient 3D Content Creationcited by 839
  9. 2023K-Planes: Explicit Radiance Fields in Space, Time, and Appearancecited by 744
  10. 2023Real-time Photorealistic Dynamic Scene Representation and Rendering with 4D Gaussian Splattingcited by 474
  11. 2021Dynamic View Synthesis from Dynamic Monocular Videocited by 420
  12. 2023PhysGaussian: Physics-Integrated 3D Gaussians for Generative Dynamicscited by 370
38 more
  1. 2019SynSin: End-to-end View Synthesis from a Single Imagecited by 364
  2. 2022Fast Dynamic Radiance Fields with Time-Aware Neural Voxelscited by 344
  3. 2023OmniObject3D: Large-Vocabulary 3D Object Dataset for Realistic Perception, Reconstruction and Generationcited by 326
  4. 2023GaussianDreamer: Fast Generation from Text to 3D Gaussians by Bridging 2D and 3D Diffusion Modelscited by 255
  5. 2019DiffTaichi: Differentiable Programming for Physical Simulationcited by 252
  6. 2023A Comprehensive Survey of AI-Generated Content (AIGC): A History of Generative AI from GAN to ChatGPTcited by 224
  7. 2024VideoPhy: Evaluating Physical Commonsense for Video Generationcited by 219
  8. 2024PhysDreamer: Physics-Based Interaction with 3D Objects via Video Generationcited by 188
  9. 2024PhysGen: Rigid-Body Physics-Grounded Image-to-Video Generationcited by 170
  10. 2023PAC-NeRF: Physics Augmented Continuum Neural Radiance Fields for Geometry-Agnostic System Identificationcited by 148
  11. 2023Generative Image Dynamicscited by 94
  12. 2024Reconstruction and Simulation of Elastic Objects with Spring-Mass 3D Gaussianscited by 94
  13. 2024PhyT2V: LLM-Guided Iterative Self-Refinement for Physics-Grounded Text-to-Video Generationcited by 78
  14. 2024Physics3D: Learning Physical Properties of 3D Gaussians via Video Diffusioncited by 77
  15. 2024GaMeS: Mesh-Based Adapting and Modification of Gaussian Splattingcited by 70
  16. 2025OmniPhysGS: 3D Constitutive Gaussians for General Physics-Based Dynamics Generationcited by 66
  17. 2024Advances in 3D Generation: A Surveycited by 63
  18. 2019Neural Point Cloud Rendering via Multi-Plane Projectioncited by 60
  19. 2023PIE-NeRF: Physics-based Interactive Elastodynamics with NeRFcited by 51
  20. 2024GIC: Gaussian-Informed Continuum for Physical Property Identification and Simulationcited by 48
  21. 2024MotionCraft: Physics-based Zero-Shot Video Generationcited by 46
  22. 2024MEGA: Memory-Efficient 4D Gaussian Splatting for Dynamic Scenescited by 46
  23. 2022Differentiable Physics Simulation of Dynamics-Augmented Neural Objectscited by 45
  24. 2024PhysMotion: Physics-Grounded Dynamics From a Single Imagecited by 45
  25. 2024Physically Compatible 3D Object Modeling from a Single Imagecited by 38
  26. 2024PhysFlow: Unleashing the Potential of Multi-modal Foundation Models and Video Diffusion for 4D Dynamic Physical Scene Simulationcited by 36
  27. 2024Gaussian Splashing: Unified Particles for Versatile Motion Synthesis and Renderingcited by 35
  28. 2024Neural Material Adaptor for Visual Grounding of Intrinsic Dynamicscited by 31
  29. 2023Physics-Informed Computer Vision: A Review and Perspectivescited by 28
  30. 2024A Comprehensive Survey on 3D Content Generationcited by 28
  31. 2022ParticleNeRF: A Particle-Based Encoding for Online Neural Radiance Fieldscited by 27
  32. 2024GASP: Gaussian Splatting for Physic-Based Simulationscited by 24
  33. 2025Generative Physical AI in Vision: A Surveycited by 24
  34. 2024Phy124: Fast Physics-Driven 4D Content Generation from a Single Imagecited by 22
  35. 2024Atlas3D: Physically Constrained Self-Supporting Text-to-3D for Simulation and Fabricationcited by 19
  36. 2024Trans4D: Realistic Geometry-Aware Transition for Compositional Text-to-4D Synthesiscited by 19
  37. 2024PhyCAGE: Physically Plausible Compositional 3D Asset Generation from a Single Imagecited by 19
  38. 2024Compositional 4D Dynamic Scenes Understanding with Physics Priors for Video Question Answeringcited by 18

50 most cited of 55 All 55 (JSON)

Built on by

Cited by year (2026 to 13 Oct)

Citing papers per year: 2025: 7; 2026: 4.

11 papers.