Phy124: Fast Physics-Driven 4D Content Generation from a Single Image
On the map: Diffusion models → Video generation
Abstract (arXiv)
4D content generation focuses on creating dynamic 3D objects that change over time. Existing methods primarily rely on pre-trained video diffusion models, utilizing sampling processes or reference videos. However, these approaches face significant challenges. Firstly, the generated 4D content often fails to adhere to real-world physics since video diffusion models do not incorporate physical priors. Secondly, the extensive sampling process and the large number of parameters in diffusion models result in exceedingly time-consuming generation processes. To address these issues, we introduce Phy124, a novel, fast, and physics-driven method for controllable 4D content generation from a single image. Phy124 integrates physical simulation directly into the 4D generation process, ensuring that the resulting 4D content adheres to natural physical laws. Phy124 also eliminates the use of diffusion models during the 4D dynamics generation phase, significantly speeding up the process. Phy124 allows for the control of 4D dynamics, including movement speed and direction, by manipulating external forces. Extensive experiments demonstrate that Phy124 generates high-fidelity 4D content with significantly reduced inference times, achieving stateof-the-art performance. The code and generated 4D content are available at the provided link: https://anonymous.4open.science/r/BBF2/.
Key facts. Cited by 22 papers in the map (data through 7 Oct 2026). Placed in Video generation, one of 14 directions in Diffusion models. Builds on 52 of its 65 references that are in the map. First posted on arXiv 11 Sep 2024.
Builds on
52 of 65 references.
Closest ancestors · 2
Same direction, newest first
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasets25 Nov
- 2023LAVIE: High-Quality Video Generation with Cascaded Latent Diffusion Models26 Sep
Other references · 50
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2020Denoising Diffusion Implicit Modelscited by 9,655
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
- 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,698
- 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,006
- 2021Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fieldscited by 1,957
- 2023Zero-1-to-3: Zero-shot One Image to 3D Objectcited by 1,483
- 2023ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillationcited by 1,207
- 2023MVDream: Multi-view Diffusion for 3D Generationcited by 928
38 more
- 2023DreamGaussian: Generative Gaussian Splatting for Efficient 3D Content Creationcited by 837
- 2023Deformable 3D Gaussians for High-Fidelity Monocular Dynamic Scene Reconstructioncited by 753
- 2024LGM: Large Multi-View Gaussian Model for High-Resolution 3D Content Creationcited by 730
- 2022Point-E: A System for Generating 3D Point Clouds from Complex Promptscited by 694
- 2023Fantasia3D: Disentangling Geometry and Appearance for High-quality Text-to-3D Content Creationcited by 684
- 2023Wonder3D: Single Image to 3D using Cross-Domain Diffusioncited by 682
- 2023SyncDreamer: Generating Multiview-consistent Images from a Single-view Imagecited by 638
- 2023HexPlane: A Fast Representation for Dynamic Scenescited by 582
- 2023One-2-3-45: Any Single Image to 3D Mesh in 45 Seconds without Per-Shape Optimizationcited by 555
- 2020U2-Net: Going Deeper with Nested U-Structure for Salient Object Detectioncited by 410
- 2023Magic123: One Image to High-Quality 3D Object Generation Using Both 2D and 3D Diffusion Priorscited by 395
- 2023Shap-E: Generating Conditional 3D Implicit Functionscited by 379
- 2023PhysGaussian: Physics-Integrated 3D Gaussians for Generative Dynamicscited by 368
- 2023Make-It-3D: High-Fidelity 3D Creation from A Single Image with Diffusion Priorcited by 341
- 2023RealFusion: 360deg Reconstruction of Any Object from a Single Imagecited by 305
- 2023ImageDream: Image-Prompt Multi-view Diffusion for 3D Generationcited by 256
- 2023Text-To-4D Dynamic Scene Generationcited by 204
- 2023DreamGaussian4D: Generative 4D Gaussian Splattingcited by 191
- 20234D-fy: Text-to-4D Generation Using Hybrid Score Distillation Samplingcited by 184
- 2023Let 2D Diffusion Model Know 3D-Consistency for Robust Text-to-3D Generationcited by 133
- 2023Consistent4D: Consistent 360deg Dynamic Object Generation from Monocular Videocited by 124
- 20234DGen: Grounded 4D Content Generation with Spatial-temporal Consistencycited by 117
- 2023Animate124: Animating One Image to 4D Dynamic Scenecited by 113
- 2024GaussianFlow: Splatting Gaussian Dynamics for 4D Content Creationcited by 99
- 2024Diffusion4D: Fast Spatial-temporal Consistent 4D Generation via Video Diffusion Modelscited by 99
- 2023A Unified Approach for Text- and Image-guided 4D Scene Generationcited by 82
- 2023FocalDreamer: Text-driven 3D Editing via Focal-fusion Assemblycited by 75
- 2024DreamScene4D: Dynamic Multi-Object Scene Generation from Monocular Videoscited by 63
- 2021Person Re-identification Method Based on Color Attack and Joint Defencecited by 56
- 2024Cross-Modality Perturbation Synergy Attack for Person Re-identificationcited by 45
- 2024EG4D: Explicit Generation of 4D Object without Score Distillationcited by 45
- 2021Eliminate Deviation with Deviation for Data Augmentation and a General Multi-modal Data Learning Methodcited by 42
- 2024Exploring Color Invariance through Image-Level Ensemble Learningcited by 23
- 2024Beyond Augmentation: Empowering Model Robustness under Extreme Capture Environmentscited by 23
- 2024Beyond Dropout: Robust Convolutional Neural Networks Based on Local Feature Maskingcited by 19
- 2024Cross-Task Attack: A Self-Supervision Generative Framework Based on Attention Shiftcited by 9
- 2024Multi-View Subgraph Neural Networks: Self-Supervised Learning with Scarce Labeled Datacited by 5
- 2024Ask, Attend, Attack: A Effective Decision-Based Black-Box Targeted Attack for Image-to-Text Modelscited by 5
Built on by
Citing papers per year: 2024: 3; 2025: 13; 2026: 6.
22 papers.
Sort:
By area:
- 2024AC3D: Analyzing and Improving 3D Camera Control in Video Diffusion Transformerscited by 151
- 2025VideoREPA: Learning Physics for Video Generation through Relational Alignment with Foundation Modelscited by 88
- 2024PhysMotion: Physics-Grounded Dynamics From a Single Imagecited by 45
- 2025Puppeteer: Rig and Animate Your 3D Modelscited by 41
- 2025Lyra: Generative 3D Scene Reconstruction via Video Diffusion Model Self-Distillationcited by 37
- 2025Exploring the Evolution of Physics Cognition in Video Generation: A Surveycited by 31
- 2025Generative Physical AI in Vision: A Surveycited by 24
- 2024Phys4DGen: Physics-Compliant 4D Generation with Multi-Material Composition Perceptioncited by 23
- 2025MoAlign: Motion-Centric Representation Alignment for Video Diffusion Modelscited by 13
- 2025Grounding Creativity in Physics: A Brief Survey of Physical Priors in AIGCcited by 11
- 2025StruSR: Structure-Aware Symbolic Regression with Physics-Informed Taylor Guidancecited by 5
- 2025From 2D to 3D Cognition: A Brief Survey of General World Modelscited by 4
10 more
- 2025VisionLaw: Inferring Interpretable Intrinsic Dynamics from Visual Observations via Bilevel Optimizationcited by 3
- 2026CP4D: Compositional Physics-aware 4D Scene Generationcited by 2
- 2025Advances in 4D Generation: A Surveycited by 1
- 2026Pixel-to-4D: Camera-Controlled Image-to-Video Generation with Dynamic 3D Gaussianscited by 1
- 2026Tempered Self-Similarity Alignment for Physically Plausible Video Generationcited by 1
- 2026Adaptive Volumetric Mechanical Property Fields Invariant to Resolutioncited by 1
- 2025FADE: Adversarial Concept Erasure in Flow Modelscited by 0
- 2025Robust Concept Erasure in Diffusion Models: A Theoretical Perspective on Security and Robustnesscited by 0
- 2026VersaGauss: A Versatile Framework for Generating Multiphase Dynamics with 3D Gaussianscited by 0
- 2026NeuIDO: Neural Intrinsic Dynamics Operator for Physics-Informed 4D World Modelscited by 0
- 2026NeuIDO: Neural Intrinsic Dynamics Operator for Physics-Informed 4D World Models21 Sep 2026
- 2026VersaGauss: A Versatile Framework for Generating Multiphase Dynamics with 3D Gaussians28 Aug 2026
- 2026Adaptive Volumetric Mechanical Property Fields Invariant to Resolution16 Jun 2026
- 2026CP4D: Compositional Physics-aware 4D Scene Generation8 Jun 2026
- 2026Tempered Self-Similarity Alignment for Physically Plausible Video Generation24 May 2026
- 2026Pixel-to-4D: Camera-Controlled Image-to-Video Generation with Dynamic 3D Gaussians2 Jan 2026
- 2025MoAlign: Motion-Centric Representation Alignment for Video Diffusion Models21 Oct 2025
- 2025StruSR: Structure-Aware Symbolic Regression with Physics-Informed Taylor Guidance8 Oct 2025
- 2025Lyra: Generative 3D Scene Reconstruction via Video Diffusion Model Self-Distillation23 Sep 2025
- 2025Robust Concept Erasure in Diffusion Models: A Theoretical Perspective on Security and Robustness15 Sep 2025
- 2025VisionLaw: Inferring Interpretable Intrinsic Dynamics from Visual Observations via Bilevel Optimization19 Aug 2025
- 2025Puppeteer: Rig and Animate Your 3D Models14 Aug 2025
10 more
- 2025FADE: Adversarial Concept Erasure in Flow Models16 Jul 2025
- 2025From 2D to 3D Cognition: A Brief Survey of General World Models25 Jun 2025
- 2025VideoREPA: Learning Physics for Video Generation through Relational Alignment with Foundation Models29 May 2025
- 2025Exploring the Evolution of Physics Cognition in Video Generation: A Survey27 Mar 2025
- 2025Advances in 4D Generation: A Survey18 Mar 2025
- 2025Grounding Creativity in Physics: A Brief Survey of Physical Priors in AIGC10 Feb 2025
- 2025Generative Physical AI in Vision: A Survey19 Jan 2025
- 2024AC3D: Analyzing and Improving 3D Camera Control in Video Diffusion Transformers27 Nov 2024
- 2024PhysMotion: Physics-Grounded Dynamics From a Single Image26 Nov 2024
- 2024Phys4DGen: Physics-Compliant 4D Generation with Multi-Material Composition Perception25 Nov 2024
- 2024AC3D: Analyzing and Improving 3D Camera Control in Video Diffusion Transformerscited by 151
- 2025VideoREPA: Learning Physics for Video Generation through Relational Alignment with Foundation Modelscited by 88
- 2025Lyra: Generative 3D Scene Reconstruction via Video Diffusion Model Self-Distillationcited by 37
- 2025Exploring the Evolution of Physics Cognition in Video Generation: A Surveycited by 31
- 2025MoAlign: Motion-Centric Representation Alignment for Video Diffusion Modelscited by 13
- 2025FADE: Adversarial Concept Erasure in Flow Modelscited by 0
- 2025Robust Concept Erasure in Diffusion Models: A Theoretical Perspective on Security and Robustnesscited by 0
- 2025MoAlign: Motion-Centric Representation Alignment for Video Diffusion Models21 Oct 2025
- 2025Lyra: Generative 3D Scene Reconstruction via Video Diffusion Model Self-Distillation23 Sep 2025
- 2025Robust Concept Erasure in Diffusion Models: A Theoretical Perspective on Security and Robustness15 Sep 2025
- 2025FADE: Adversarial Concept Erasure in Flow Models16 Jul 2025
- 2025VideoREPA: Learning Physics for Video Generation through Relational Alignment with Foundation Models29 May 2025
- 2025Exploring the Evolution of Physics Cognition in Video Generation: A Survey27 Mar 2025
- 2024AC3D: Analyzing and Improving 3D Camera Control in Video Diffusion Transformers27 Nov 2024
- 2024PhysMotion: Physics-Grounded Dynamics From a Single Imagecited by 45
- 2025Puppeteer: Rig and Animate Your 3D Modelscited by 41
- 2025Generative Physical AI in Vision: A Surveycited by 24
- 2024Phys4DGen: Physics-Compliant 4D Generation with Multi-Material Composition Perceptioncited by 23
- 2025Grounding Creativity in Physics: A Brief Survey of Physical Priors in AIGCcited by 11
- 2025StruSR: Structure-Aware Symbolic Regression with Physics-Informed Taylor Guidancecited by 5
- 2025VisionLaw: Inferring Interpretable Intrinsic Dynamics from Visual Observations via Bilevel Optimizationcited by 3
- 2026CP4D: Compositional Physics-aware 4D Scene Generationcited by 2
- 2025Advances in 4D Generation: A Surveycited by 1
- 2026Pixel-to-4D: Camera-Controlled Image-to-Video Generation with Dynamic 3D Gaussianscited by 1
- 2026Tempered Self-Similarity Alignment for Physically Plausible Video Generationcited by 1
- 2026Adaptive Volumetric Mechanical Property Fields Invariant to Resolutioncited by 1
12 most cited of 13 All 13 (JSON)
- 2026VersaGauss: A Versatile Framework for Generating Multiphase Dynamics with 3D Gaussians28 Aug 2026
- 2026Adaptive Volumetric Mechanical Property Fields Invariant to Resolution16 Jun 2026
- 2026CP4D: Compositional Physics-aware 4D Scene Generation8 Jun 2026
- 2026Tempered Self-Similarity Alignment for Physically Plausible Video Generation24 May 2026
- 2026Pixel-to-4D: Camera-Controlled Image-to-Video Generation with Dynamic 3D Gaussians2 Jan 2026
- 2025StruSR: Structure-Aware Symbolic Regression with Physics-Informed Taylor Guidance8 Oct 2025
- 2025VisionLaw: Inferring Interpretable Intrinsic Dynamics from Visual Observations via Bilevel Optimization19 Aug 2025
- 2025Puppeteer: Rig and Animate Your 3D Models14 Aug 2025
- 2025Advances in 4D Generation: A Survey18 Mar 2025
- 2025Grounding Creativity in Physics: A Brief Survey of Physical Priors in AIGC10 Feb 2025
- 2025Generative Physical AI in Vision: A Survey19 Jan 2025
- 2024PhysMotion: Physics-Grounded Dynamics From a Single Image26 Nov 2024
12 newest of 13 All 13 (JSON)
Similar, not cited
Close in wording, no citation either way
- 2026Phys4D: Fine-Grained Physics-Consistent 4D Modeling from Video Diffusion
- 2025PhysCtrl: Generative Physics for Controllable and Physics-Grounded Video Generation
- 2026PhyCo: Learning Controllable Physical Priors for Generative Motion
- 20244Real: Towards Photorealistic 4D Scene Generation via Video Diffusion Models
- 2025Diff4Splat: Controllable 4D Scene Generation with Latent Dynamic Reconstruction Models
- 2026Resonance4D: Frequency-Domain Motion Supervision for Preset-Free Physical Parameter Learning in 4D Dynamic Physical Scene Simulation
- 20244Diffusion: Multi-view Video Diffusion Model for 4D Generation
- 20254DNeX: Feed-Forward 4D Generative Modeling Made Easy