mlsanityData to 7 Oct 2026

Phy124: Fast Physics-Driven 4D Content Generation from a Single Image

arXiv 2409.07179 ↗First posted 11 Sep 2024cs.CVcited by 22

On the map: Diffusion models → Video generation

Abstract (arXiv)

4D content generation focuses on creating dynamic 3D objects that change over time. Existing methods primarily rely on pre-trained video diffusion models, utilizing sampling processes or reference videos. However, these approaches face significant challenges. Firstly, the generated 4D content often fails to adhere to real-world physics since video diffusion models do not incorporate physical priors. Secondly, the extensive sampling process and the large number of parameters in diffusion models result in exceedingly time-consuming generation processes. To address these issues, we introduce Phy124, a novel, fast, and physics-driven method for controllable 4D content generation from a single image. Phy124 integrates physical simulation directly into the 4D generation process, ensuring that the resulting 4D content adheres to natural physical laws. Phy124 also eliminates the use of diffusion models during the 4D dynamics generation phase, significantly speeding up the process. Phy124 allows for the control of 4D dynamics, including movement speed and direction, by manipulating external forces. Extensive experiments demonstrate that Phy124 generates high-fidelity 4D content with significantly reduced inference times, achieving stateof-the-art performance. The code and generated 4D content are available at the provided link: https://anonymous.4open.science/r/BBF2/.

Key facts. Cited by 22 papers in the map (data through 7 Oct 2026). Placed in Video generation, one of 14 directions in Diffusion models. Builds on 52 of its 65 references that are in the map. First posted on arXiv 11 Sep 2024.

Builds on

52 of 65 references.

Closest ancestors · 2

Same direction, newest first

  1. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasets25 Nov
  2. 2023LAVIE: High-Quality Video Generation with Cascaded Latent Diffusion Models26 Sep

Other references · 50

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  4. 2020Denoising Diffusion Implicit Modelscited by 9,655
  5. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
  6. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
  7. 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,698
  8. 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,006
  9. 2021Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fieldscited by 1,957
  10. 2023Zero-1-to-3: Zero-shot One Image to 3D Objectcited by 1,483
  11. 2023ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillationcited by 1,207
  12. 2023MVDream: Multi-view Diffusion for 3D Generationcited by 928
38 more
  1. 2023DreamGaussian: Generative Gaussian Splatting for Efficient 3D Content Creationcited by 837
  2. 2023Deformable 3D Gaussians for High-Fidelity Monocular Dynamic Scene Reconstructioncited by 753
  3. 2024LGM: Large Multi-View Gaussian Model for High-Resolution 3D Content Creationcited by 730
  4. 2022Point-E: A System for Generating 3D Point Clouds from Complex Promptscited by 694
  5. 2023Fantasia3D: Disentangling Geometry and Appearance for High-quality Text-to-3D Content Creationcited by 684
  6. 2023Wonder3D: Single Image to 3D using Cross-Domain Diffusioncited by 682
  7. 2023SyncDreamer: Generating Multiview-consistent Images from a Single-view Imagecited by 638
  8. 2023HexPlane: A Fast Representation for Dynamic Scenescited by 582
  9. 2023One-2-3-45: Any Single Image to 3D Mesh in 45 Seconds without Per-Shape Optimizationcited by 555
  10. 2020U2-Net: Going Deeper with Nested U-Structure for Salient Object Detectioncited by 410
  11. 2023Magic123: One Image to High-Quality 3D Object Generation Using Both 2D and 3D Diffusion Priorscited by 395
  12. 2023Shap-E: Generating Conditional 3D Implicit Functionscited by 379
  13. 2023PhysGaussian: Physics-Integrated 3D Gaussians for Generative Dynamicscited by 368
  14. 2023Make-It-3D: High-Fidelity 3D Creation from A Single Image with Diffusion Priorcited by 341
  15. 2023RealFusion: 360deg Reconstruction of Any Object from a Single Imagecited by 305
  16. 2023ImageDream: Image-Prompt Multi-view Diffusion for 3D Generationcited by 256
  17. 2023Text-To-4D Dynamic Scene Generationcited by 204
  18. 2023DreamGaussian4D: Generative 4D Gaussian Splattingcited by 191
  19. 20234D-fy: Text-to-4D Generation Using Hybrid Score Distillation Samplingcited by 184
  20. 2023Let 2D Diffusion Model Know 3D-Consistency for Robust Text-to-3D Generationcited by 133
  21. 2023Consistent4D: Consistent 360deg Dynamic Object Generation from Monocular Videocited by 124
  22. 20234DGen: Grounded 4D Content Generation with Spatial-temporal Consistencycited by 117
  23. 2023Animate124: Animating One Image to 4D Dynamic Scenecited by 113
  24. 2024GaussianFlow: Splatting Gaussian Dynamics for 4D Content Creationcited by 99
  25. 2024Diffusion4D: Fast Spatial-temporal Consistent 4D Generation via Video Diffusion Modelscited by 99
  26. 2023A Unified Approach for Text- and Image-guided 4D Scene Generationcited by 82
  27. 2023FocalDreamer: Text-driven 3D Editing via Focal-fusion Assemblycited by 75
  28. 2024DreamScene4D: Dynamic Multi-Object Scene Generation from Monocular Videoscited by 63
  29. 2021Person Re-identification Method Based on Color Attack and Joint Defencecited by 56
  30. 2024Cross-Modality Perturbation Synergy Attack for Person Re-identificationcited by 45
  31. 2024EG4D: Explicit Generation of 4D Object without Score Distillationcited by 45
  32. 2021Eliminate Deviation with Deviation for Data Augmentation and a General Multi-modal Data Learning Methodcited by 42
  33. 2024Exploring Color Invariance through Image-Level Ensemble Learningcited by 23
  34. 2024Beyond Augmentation: Empowering Model Robustness under Extreme Capture Environmentscited by 23
  35. 2024Beyond Dropout: Robust Convolutional Neural Networks Based on Local Feature Maskingcited by 19
  36. 2024Cross-Task Attack: A Self-Supervision Generative Framework Based on Attention Shiftcited by 9
  37. 2024Multi-View Subgraph Neural Networks: Self-Supervised Learning with Scarce Labeled Datacited by 5
  38. 2024Ask, Attend, Attack: A Effective Decision-Based Black-Box Targeted Attack for Image-to-Text Modelscited by 5

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 3; 2025: 13; 2026: 6.

22 papers.

Sort:

By area:

  1. 2024AC3D: Analyzing and Improving 3D Camera Control in Video Diffusion Transformerscited by 151
  2. 2025VideoREPA: Learning Physics for Video Generation through Relational Alignment with Foundation Modelscited by 88
  3. 2024PhysMotion: Physics-Grounded Dynamics From a Single Imagecited by 45
  4. 2025Puppeteer: Rig and Animate Your 3D Modelscited by 41
  5. 2025Lyra: Generative 3D Scene Reconstruction via Video Diffusion Model Self-Distillationcited by 37
  6. 2025Exploring the Evolution of Physics Cognition in Video Generation: A Surveycited by 31
  7. 2025Generative Physical AI in Vision: A Surveycited by 24
  8. 2024Phys4DGen: Physics-Compliant 4D Generation with Multi-Material Composition Perceptioncited by 23
  9. 2025MoAlign: Motion-Centric Representation Alignment for Video Diffusion Modelscited by 13
  10. 2025Grounding Creativity in Physics: A Brief Survey of Physical Priors in AIGCcited by 11
  11. 2025StruSR: Structure-Aware Symbolic Regression with Physics-Informed Taylor Guidancecited by 5
  12. 2025From 2D to 3D Cognition: A Brief Survey of General World Modelscited by 4
10 more
  1. 2025VisionLaw: Inferring Interpretable Intrinsic Dynamics from Visual Observations via Bilevel Optimizationcited by 3
  2. 2026CP4D: Compositional Physics-aware 4D Scene Generationcited by 2
  3. 2025Advances in 4D Generation: A Surveycited by 1
  4. 2026Pixel-to-4D: Camera-Controlled Image-to-Video Generation with Dynamic 3D Gaussianscited by 1
  5. 2026Tempered Self-Similarity Alignment for Physically Plausible Video Generationcited by 1
  6. 2026Adaptive Volumetric Mechanical Property Fields Invariant to Resolutioncited by 1
  7. 2025FADE: Adversarial Concept Erasure in Flow Modelscited by 0
  8. 2025Robust Concept Erasure in Diffusion Models: A Theoretical Perspective on Security and Robustnesscited by 0
  9. 2026VersaGauss: A Versatile Framework for Generating Multiphase Dynamics with 3D Gaussianscited by 0
  10. 2026NeuIDO: Neural Intrinsic Dynamics Operator for Physics-Informed 4D World Modelscited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2026Phys4D: Fine-Grained Physics-Consistent 4D Modeling from Video Diffusion
  2. 2025PhysCtrl: Generative Physics for Controllable and Physics-Grounded Video Generation
  3. 2026PhyCo: Learning Controllable Physical Priors for Generative Motion
  4. 20244Real: Towards Photorealistic 4D Scene Generation via Video Diffusion Models
  5. 2025Diff4Splat: Controllable 4D Scene Generation with Latent Dynamic Reconstruction Models
  6. 2026Resonance4D: Frequency-Domain Motion Supervision for Preset-Free Physical Parameter Learning in 4D Dynamic Physical Scene Simulation
  7. 20244Diffusion: Multi-view Video Diffusion Model for 4D Generation
  8. 20254DNeX: Feed-Forward 4D Generative Modeling Made Easy