CP4D: Compositional Physics-aware 4D Scene Generation
Not on the map. Why?
Abstract (arXiv)
4D generation (textiti.e., dynamic 3D generation) has recently emerged as a rapidly growing research frontier due to its powerful spatiotemporal modeling capabilities. However, despite notable advances, existing approaches typically fail to capture the underlying physical principles, producing results that are both physically inconsistent and visually implausible. To overcome this limitation, we present CP4D, a novel paradigm for photorealistic 4D scene synthesis with faithful adherence to complex physical dynamics. Drawing inspiration from the compositional nature of real-world scenes, where immutable static backgrounds coexist with dynamic, physically plausible foregrounds, CP4D reformulates 4D generation as the integration of a static 3D environment with physically grounded dynamic objects. On this basis, our framework follows a three-stage pipeline: 1) Firstly, we leverage pre-trained expert models to generate high-fidelity 3D representations of the environment and foreground objects respectively. 2) Subsequently, to produce physically plausible trajectories and realistic interactions for these objects, we propose a hybrid motion synthesis strategy that integrates priors from physical simulators with the common sense embedded in video diffusion models. 3) Finally, we develop an automated composition mechanism that seamlessly fuses the static environment and dynamic objects into coherent, physically consistent 4D scenes. Extensive experiments demonstrate that CP4D can generate explorable and interactive 4D scenes with high visual fidelity, strong physical plausibility, and fine-grained controllability, significantly outperforming existing methods. The project page: https://anonymous.4open.science/w/CP4D/.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 51 of its 61 references that are in the map. First posted on arXiv 8 Jun 2026.
Builds on
51 of 61 references.
References · 51
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2023GPT-4 Technical Reportcited by 18,396
- 2020Denoising Diffusion Implicit Modelscited by 9,781
- 2023Segment Anythingcited by 8,234
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
- 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,025
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
- 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
- 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,540
- 2024Depth Anything: Unleashing the Power of Large-Scale Unlabeled Datacited by 1,360
- 20234D Gaussian Splatting for Real-Time Dynamic Scene Renderingcited by 1,157
38 more
- 2025Qwen-Image Technical Reportcited by 1,044
- 2024Structured 3D Latents for Scalable and Versatile 3D Generationcited by 770
- 2024CameraCtrl: Enabling Camera Control for Text-to-Video Generationcited by 460
- 2024ViewCrafter: Taming Video Diffusion Models for High-fidelity Novel View Synthesiscited by 403
- 2023PhysGaussian: Physics-Integrated 3D Gaussians for Generative Dynamicscited by 377
- 2024OpenVid-1M: A Large-Scale High-Quality Dataset for Text-to-video Generationcited by 341
- 2025ReCamMaster: Camera-Controlled Generative Rendering from A Single Videocited by 287
- 2024VideoPhy: Evaluating Physical Commonsense for Video Generationcited by 228
- 2023DreamGaussian4D: Generative 4D Gaussian Splattingcited by 194
- 20234D-fy: Text-to-4D Generation Using Hybrid Score Distillation Samplingcited by 185
- 2024PhysGen: Rigid-Body Physics-Grounded Image-to-Video Generationcited by 174
- 2025WorldScore: A Unified Evaluation Benchmark for World Generationcited by 156
- 2024L4GM: Large 4D Gaussian Reconstruction Modelcited by 144
- 2024SV4D: Dynamic 3D Content Generation with Multi-Frame and Multi-View Consistencycited by 144
- 2023Consistent4D: Consistent 360deg Dynamic Object Generation from Monocular Videocited by 125
- 2025TrajectoryCrafter: Redirecting Camera Trajectory for Monocular Videos via Diffusion Modelscited by 125
- 2024STAG4D: Spatial-Temporal Anchored Generative 4D Gaussianscited by 102
- 2024GaussianFlow: Splatting Gaussian Dynamics for 4D Content Creationcited by 100
- 2024Diffusion4D: Fast Spatial-temporal Consistent 4D Generation via Video Diffusion Modelscited by 100
- 2024Physics3D: Learning Physical Properties of 3D Gaussians via Video Diffusioncited by 80
- 2024TC4D: Trajectory-Conditioned Text-to-4D Generationcited by 77
- 2025OmniPhysGS: 3D Constitutive Gaussians for General Physics-Based Dynamics Generationcited by 69
- 2024SG-I2V: Self-Guided Trajectory Control in Image-to-Video Generationcited by 68
- 2025PhysGen3D: Crafting a Miniature Interactive World from a Single Imagecited by 66
- 2025Follow-Your-Creation: Empowering 4D Creation through Video Inpaintingcited by 62
- 2024DreamMesh4D: Video-to-4D Generation with Sparse-Controlled Gaussian-Mesh Hybrid Representationcited by 58
- 20244K4DGen: Panoramic 4D Generation at 4K Resolutioncited by 54
- 2024Comp4D: LLM-Guided Compositional 4D Scene Generationcited by 50
- 2024PhysMotion: Physics-Grounded Dynamics From a Single Imagecited by 45
- 2024DreamPhysics: Learning Physics-Based 3D Dynamics with Video Diffusion Priorscited by 41
- 2025DeepVerse: 4D Autoregressive Video Generation as a World Modelcited by 40
- 2024PhysFlow: Unleashing the Potential of Multi-modal Foundation Models and Video Diffusion for 4D Dynamic Physical Scene Simulationcited by 36
- 2024Efficient Physics Simulation for 3D Scenes via MLLM-Guided Gaussian Splattingcited by 32
- 2025Geometry-aware 4D Video Generation for Robot Manipulationcited by 24
- 2024Phy124: Fast Physics-Driven 4D Content Generation from a Single Imagecited by 23
- 2024Phys4DGen: Physics-Compliant 4D Generation with Multi-Material Composition Perceptioncited by 23
- 2025FluidNexus: 3D Fluid Reconstruction and Prediction from a Single Videocited by 21
- 2024Compositional 3D-aware Video Generation with LLM Directorcited by 18
50 most cited of 51 All 51 (JSON)
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2025CoCo4D: Comprehensive and Complex 4D Scene Generation
- 20244Real: Towards Photorealistic 4D Scene Generation via Video Diffusion Models
- 2024PaintScene4D: Consistent 4D Scene Generation from Text Prompts
- 2024Trans4D: Realistic Geometry-Aware Transition for Compositional Text-to-4D Synthesis
- 2024VividDream: Generating 3D Scene with Ambient Dynamics
- 2025FB-4D: Spatial-Temporal Coherent Dynamic 3D Content Generation with Feature Banks
- 2025PhysGM: Large Physical Gaussian Model for Feed-Forward 4D Synthesis
- 2025WorldReel: 4D Video Generation with Consistent Geometry and Motion Modeling