Grounding Creativity in Physics: A Brief Survey of Physical Priors in AIGC
Not on the map. Why?
Abstract (arXiv)
Recent advancements in AI-generated content have significantly improved the realism of 3D and 4D generation. However, most existing methods prioritize appearance consistency while neglecting underlying physical principles, leading to artifacts such as unrealistic deformations, unstable dynamics, and implausible objects interactions. Incorporating physics priors into generative models has become a crucial research direction to enhance structural integrity and motion realism. This survey provides a review of physics-aware generative methods, systematically analyzing how physical constraints are integrated into 3D and 4D generation. First, we examine recent works in incorporating physical priors into static and dynamic 3D generation, categorizing methods based on representation types, including vision-based, NeRF-based, and Gaussian Splatting-based approaches. Second, we explore emerging techniques in 4D generation, focusing on methods that model temporal dynamics with physical simulations. Finally, we conduct a comparative analysis of major methods, highlighting their strengths, limitations, and suitability for different materials and motion dynamics. By presenting an in-depth analysis of physics-grounded AIGC, this survey aims to bridge the gap between generative models and physical realism, providing insights that inspire future research in physically consistent content generation.
Key facts. Cited by 11 papers in the map (data through 13 Oct 2026). Builds on 55 of its 66 references that are in the map. First posted on arXiv 10 Feb 2025.
Builds on
55 of 66 references.
References · 55
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,588
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,170
- 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,712
- 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,019
- 2020D-NeRF: Neural Radiance Fields for Dynamic Scenescited by 1,462
- 2020Nerfies: Deformable Neural Radiance Fieldscited by 1,195
- 20234D Gaussian Splatting for Real-Time Dynamic Scene Renderingcited by 1,150
- 2023DreamGaussian: Generative Gaussian Splatting for Efficient 3D Content Creationcited by 839
- 2023K-Planes: Explicit Radiance Fields in Space, Time, and Appearancecited by 744
- 2023Real-time Photorealistic Dynamic Scene Representation and Rendering with 4D Gaussian Splattingcited by 474
- 2021Dynamic View Synthesis from Dynamic Monocular Videocited by 420
- 2023PhysGaussian: Physics-Integrated 3D Gaussians for Generative Dynamicscited by 370
38 more
- 2019SynSin: End-to-end View Synthesis from a Single Imagecited by 364
- 2022Fast Dynamic Radiance Fields with Time-Aware Neural Voxelscited by 344
- 2023OmniObject3D: Large-Vocabulary 3D Object Dataset for Realistic Perception, Reconstruction and Generationcited by 326
- 2023GaussianDreamer: Fast Generation from Text to 3D Gaussians by Bridging 2D and 3D Diffusion Modelscited by 255
- 2019DiffTaichi: Differentiable Programming for Physical Simulationcited by 252
- 2023A Comprehensive Survey of AI-Generated Content (AIGC): A History of Generative AI from GAN to ChatGPTcited by 224
- 2024VideoPhy: Evaluating Physical Commonsense for Video Generationcited by 219
- 2024PhysDreamer: Physics-Based Interaction with 3D Objects via Video Generationcited by 188
- 2024PhysGen: Rigid-Body Physics-Grounded Image-to-Video Generationcited by 170
- 2023PAC-NeRF: Physics Augmented Continuum Neural Radiance Fields for Geometry-Agnostic System Identificationcited by 148
- 2023Generative Image Dynamicscited by 94
- 2024Reconstruction and Simulation of Elastic Objects with Spring-Mass 3D Gaussianscited by 94
- 2024PhyT2V: LLM-Guided Iterative Self-Refinement for Physics-Grounded Text-to-Video Generationcited by 78
- 2024Physics3D: Learning Physical Properties of 3D Gaussians via Video Diffusioncited by 77
- 2024GaMeS: Mesh-Based Adapting and Modification of Gaussian Splattingcited by 70
- 2025OmniPhysGS: 3D Constitutive Gaussians for General Physics-Based Dynamics Generationcited by 66
- 2024Advances in 3D Generation: A Surveycited by 63
- 2019Neural Point Cloud Rendering via Multi-Plane Projectioncited by 60
- 2023PIE-NeRF: Physics-based Interactive Elastodynamics with NeRFcited by 51
- 2024GIC: Gaussian-Informed Continuum for Physical Property Identification and Simulationcited by 48
- 2024MotionCraft: Physics-based Zero-Shot Video Generationcited by 46
- 2024MEGA: Memory-Efficient 4D Gaussian Splatting for Dynamic Scenescited by 46
- 2022Differentiable Physics Simulation of Dynamics-Augmented Neural Objectscited by 45
- 2024PhysMotion: Physics-Grounded Dynamics From a Single Imagecited by 45
- 2024Physically Compatible 3D Object Modeling from a Single Imagecited by 38
- 2024PhysFlow: Unleashing the Potential of Multi-modal Foundation Models and Video Diffusion for 4D Dynamic Physical Scene Simulationcited by 36
- 2024Gaussian Splashing: Unified Particles for Versatile Motion Synthesis and Renderingcited by 35
- 2024Neural Material Adaptor for Visual Grounding of Intrinsic Dynamicscited by 31
- 2023Physics-Informed Computer Vision: A Review and Perspectivescited by 28
- 2024A Comprehensive Survey on 3D Content Generationcited by 28
- 2022ParticleNeRF: A Particle-Based Encoding for Online Neural Radiance Fieldscited by 27
- 2024GASP: Gaussian Splatting for Physic-Based Simulationscited by 24
- 2025Generative Physical AI in Vision: A Surveycited by 24
- 2024Phy124: Fast Physics-Driven 4D Content Generation from a Single Imagecited by 22
- 2024Atlas3D: Physically Constrained Self-Supporting Text-to-3D for Simulation and Fabricationcited by 19
- 2024Trans4D: Realistic Geometry-Aware Transition for Compositional Text-to-4D Synthesiscited by 19
- 2024PhyCAGE: Physically Plausible Compositional 3D Asset Generation from a Single Imagecited by 19
- 2024Compositional 4D Dynamic Scenes Understanding with Physics Priors for Video Question Answeringcited by 18
50 most cited of 55 All 55 (JSON)
Built on by
Citing papers per year: 2025: 7; 2026: 4.
11 papers.
- 2025Exploring the Evolution of Physics Cognition in Video Generation: A Surveycited by 31
- 2026PhysRVG: Physics-Aware Unified Reinforcement Learning for Video Generative Modelscited by 15
- 2025PhysMaster: Mastering Physical Representation for Video Generation via Reinforcement Learningcited by 11
- 2025MIND-V: Hierarchical World Model for Long-Horizon Robotic Manipulation with RL-based Physical Alignmentcited by 9
- 2025PhyMAGIC: Physical Motion-Aware Generative Inference with Confidence-guided LLMcited by 3
- 2025Aligning Perception, Reasoning, Modeling and Interaction: A Survey on Physical AIcited by 3
- 2026When Physical Preferences Meet Semantic Constraints: Physical and Semantic Direct Preference Optimization for Text-to-Video Generationcited by 3
- 2025Advances in 4D Generation: A Surveycited by 1
- 2025Fundamentals of Physical AIcited by 0
- 2026PhysRAG: Enhancing Physics-Awareness in Video Generation via Retrieval-Augmented Generationcited by 0
- 2026Beyond Visual Similarity: Entity-Aligned Retrieval for Knowledge-Based Visual Question Answeringcited by 0
- 2026Beyond Visual Similarity: Entity-Aligned Retrieval for Knowledge-Based Visual Question Answering19 Aug 2026
- 2026When Physical Preferences Meet Semantic Constraints: Physical and Semantic Direct Preference Optimization for Text-to-Video Generation18 Jul 2026
- 2026PhysRAG: Enhancing Physics-Awareness in Video Generation via Retrieval-Augmented Generation25 Jun 2026
- 2026PhysRVG: Physics-Aware Unified Reinforcement Learning for Video Generative Models16 Jan 2026
- 2025MIND-V: Hierarchical World Model for Long-Horizon Robotic Manipulation with RL-based Physical Alignment7 Dec 2025
- 2025Fundamentals of Physical AI12 Nov 2025
- 2025PhysMaster: Mastering Physical Representation for Video Generation via Reinforcement Learning15 Oct 2025
- 2025Aligning Perception, Reasoning, Modeling and Interaction: A Survey on Physical AI6 Oct 2025
- 2025PhyMAGIC: Physical Motion-Aware Generative Inference with Confidence-guided LLM22 May 2025
- 2025Exploring the Evolution of Physics Cognition in Video Generation: A Survey27 Mar 2025
- 2025Advances in 4D Generation: A Survey18 Mar 2025