mlsanityData to 14 Oct 2026

Atlas3D: Physically Constrained Self-Supporting Text-to-3D for Simulation and Fabrication

arXiv 2405.18515 ↗First posted 28 May 2024cs.LGcited by 20

On the map: Diffusion models → 3D, point cloud and scene generation

Abstract (arXiv)

Existing diffusion-based text-to-3D generation methods primarily focus on producing visually realistic shapes and appearances, often neglecting the physical constraints necessary for downstream tasks. Generated models frequently fail to maintain balance when placed in physics-based simulations or 3D printed. This balance is crucial for satisfying user design intentions in interactive gaming, embodied AI, and robotics, where stable models are needed for reliable interaction. Additionally, stable models ensure that 3D-printed objects, such as figurines for home decoration, can stand on their own without requiring additional supports. To fill this gap, we introduce Atlas3D, an automatic and easy-to-implement method that enhances existing Score Distillation Sampling (SDS)-based text-to-3D tools. Atlas3D ensures the generation of self-supporting 3D models that adhere to physical laws of stability under gravity, contact, and friction. Our approach combines a novel differentiable simulation-based loss function with physically inspired regularization, serving as either a refinement or a post-processing module for existing frameworks. We verify Atlas3D's efficacy through extensive generation tasks and validate the resulting 3D models in both simulated and real-world environments.

Key facts. Cited by 20 papers in the map (data through 14 Oct 2026). Placed in 3D, point cloud and scene generation, one of 14 directions in Diffusion models. Builds on 88 of its 111 references that are in the map. First posted on arXiv 28 May 2024.

Builds on

88 of 111 references.

Closest ancestors · 40

Same direction, newest first

  1. 2024SV3D: Novel Multi-view Synthesis and 3D Generation from a Single Image using Latent Video Diffusion18 Mar
  2. 2024V3D: Video Diffusion Models are Effective 3D Generators11 Mar
  3. 2024EscherNet: A Generative Model for Scalable View Synthesis6 Feb
  4. 2023Learn to Optimize Denoising Scores for 3D Generation: A Unified and Improved Diffusion Prior on NeRF and 3D Gaussian Splatting8 Dec
  5. 2023ImageDream: Image-Prompt Multi-view Diffusion for 3D Generation2 Dec
  6. 2023CG3D: Compositional Generation for Text-to-3D via Gaussian Splatting29 Nov
  7. 2023One-2-3-45++: Fast Single Image to 3D Objects with Consistent Multi-View Generation and 3D Diffusion14 Nov
  8. 2023Instant3D: Fast Text-to-3D with Sparse-View Generation and Large Reconstruction Model10 Nov
  9. 2023Text-to-3D with Classifier Score Distillation30 Oct
  10. 2023Zero123++: a Single Image to Consistent Multi-view Diffusion Base Model23 Oct
  11. 2023Wonder3D: Single Image to 3D using Cross-Domain Diffusion23 Oct
  12. 2023Consistent123: Improve Consistency for One Image to 3D Object Synthesis12 Oct
28 more
  1. 2023Consistent-1-to-3: Consistent Image to 3D View Synthesis via Geometry-aware Diffusion Models4 Oct
  2. 2023SweetDreamer: Aligning Geometric Priors in 2D Diffusion for Consistent Text-to-3D4 Oct
  3. 2023Large-Vocabulary 3D Diffusion Model with Transformer14 Sep
  4. 2023SyncDreamer: Generating Multiview-consistent Images from a Single-view Image7 Sep
  5. 2023MVDream: Multi-view Diffusion for 3D Generation31 Aug
  6. 2023AutoDecoding Latent 3D Diffusion Models7 Jul
  7. 2023DiT-3D: Exploring Plain Diffusion Transformers for 3D Shape Generation4 Jul
  8. 2023Magic123: One Image to High-Quality 3D Object Generation Using Both 2D and 3D Diffusion Priors30 Jun
  9. 2023One-2-3-45: Any Single Image to 3D Mesh in 45 Seconds without Per-Shape Optimization29 Jun
  10. 2023DreamTime: An Improved Optimization Strategy for Diffusion-Guided 3D Generation21 Jun
  11. 2023Viewset Diffusion: (0-)Image-Conditioned 3D Generative Models from 2D Data13 Jun
  12. 2023ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillation25 May
  13. 2023Single-Stage Diffusion NeRF: A Unified Approach to 3D Generation and Reconstruction13 Apr
  14. 2023HoloDiffusion: Training a 3D Diffusion Model using 2D Images29 Mar
  15. 2023Debiasing Scores and Prompts of 2D Diffusion for View-consistent Text-to-3D Generation27 Mar
  16. 2023Make-It-3D: High-Fidelity 3D Creation from A Single Image with Diffusion Prior24 Mar
  17. 2023Fantasia3D: Disentangling Geometry and Appearance for High-quality Text-to-3D Content Creation24 Mar
  18. 2023Zero-1-to-3: Zero-shot One Image to 3D Object20 Mar
  19. 2023Let 2D Diffusion Model Know 3D-Consistency for Robust Text-to-3D Generation14 Mar
  20. 20233DGen: Triplane Latent Diffusion for Textured Mesh Generation9 Mar
  21. 2022DiffRF: Rendering-Guided 3D Radiance Field Diffusion2 Dec
  22. 2022Score Jacobian Chaining: Lifting Pretrained 2D Diffusion Models for 3D Generation1 Dec
  23. 20223D Neural Field Generation using Triplane Diffusion30 Nov
  24. 2022Magic3D: High-Resolution Text-to-3D Content Creation18 Nov
  25. 2022RenderDiffusion: Image Diffusion for 3D Reconstruction, Inpainting and Generation17 Nov
  26. 2022LION: Latent Point Diffusion Models for 3D Shape Generation12 Oct
  27. 2022DreamFusion: Text-to-3D using 2D Diffusion29 Sep
  28. 2021Diffusion Probabilistic Models for 3D Point Cloud Generation2 Mar

Other references · 48

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  3. 2021NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstructioncited by 1,712
  4. 2023DreamGaussian: Generative Gaussian Splatting for Efficient 3D Content Creationcited by 843
  5. 2022Latent-NeRF for Shape-Guided Generation of 3D Shapes and Texturescited by 506
  6. 2021Deep Marching Tetrahedra: a Hybrid Representation for High-Resolution 3D Shape Synthesiscited by 460
  7. 2023Emergent Correspondence from Image Diffusioncited by 446
  8. 2020Modular Primitives for High-Performance Differentiable Renderingcited by 441
  9. 2023PhysGaussian: Physics-Integrated 3D Gaussians for Generative Dynamicscited by 377
  10. 2022PhysDiff: Physics-Guided Human Motion Diffusion Modelcited by 368
  11. 2021Text2Mesh: Text-Driven Neural Stylization for Meshescited by 334
  12. 2023Holodeck: Language Guided Generation of 3D Embodied AI Environmentscited by 268
36 more
  1. 2023Diffusion-based Generation, Optimization, and Planning in 3D Scenescited by 239
  2. 2022SparseFusion: Distilling View-conditioned Diffusion for 3D Reconstructioncited by 216
  3. 2023DMV3D: Denoising Multi-View Diffusion using 3D Large Reconstruction Modelcited by 214
  4. 2024PhysDreamer: Physics-Based Interaction with 3D Objects via Video Generationcited by 191
  5. 2022From data to functa: Your data point is a function and you can treat it like onecited by 187
  6. 2024VR-GS: A Physical Dynamics-Aware Interactive Gaussian Splatting System in Virtual Realitycited by 179
  7. 2023PAC-NeRF: Physics Augmented Continuum Neural Radiance Fields for Geometry-Agnostic System Identificationcited by 154
  8. 2024GPT-4V(ision) is a Human-Aligned Evaluator for Text-to-3D Generationcited by 153
  9. 2023HyperDiffusion: Generating Implicit Neural Fields with Weight-Space Diffusioncited by 152
  10. 2022GAUDI: A Neural Architect for Immersive 3D Scene Generationcited by 136
  11. 2023Locally Attentional SDF Diffusion for Controllable 3D Shape Generationcited by 130
  12. 2022Diffusion-SDF: Text-to-Shape via Voxelized Diffusioncited by 128
  13. 2024PhyScene: Physically Interactable 3D Scene Synthesis for Embodied AIcited by 125
  14. 2021PlasticineLab: A Soft-Body Manipulation Benchmark with Differentiable Physicscited by 103
  15. 2023Compositional 3D Scene Generation using Locally Conditioned Diffusioncited by 101
  16. 2021gradSim: Differentiable simulation for system identification and visuomotor controlcited by 100
  17. 2023Noise-Free Score Distillationcited by 99
  18. 2023Free3D: Consistent Novel View Synthesis without 3D Representationcited by 72
  19. 2021DiffCloth: Differentiable Cloth Simulation with Dry Frictional Contactcited by 65
  20. 2023ConsistNet: Enforcing 3D Consistency for Multi-view Images Diffusioncited by 65
  21. 2024Feature Splatting: Language-Driven Physics-Based Scene Synthesis and Editingcited by 45
  22. 2024PhyRecon: Physically Plausible Neural Scene Reconstructioncited by 45
  23. 2023DiffAvatar: Simulation-Ready Garment Optimization with Differentiable Simulationcited by 41
  24. 2021Efficient Differentiable Simulation of Articulated Bodiescited by 39
  25. 2022Virtual Elastic Objectscited by 35
  26. 2022DiffCloud: Real-to-Sim from Point Clouds with Differentiable Simulation and Rendering of Deformable Objectscited by 31
  27. 2023Stable Score Distillation for High-Quality 3D Generationcited by 27
  28. 2024HexaGen3D: StableDiffusion is just one step away from Fast and Diverse Text-to-3D Generationcited by 21
  29. 2024Diffusion Time-step Curriculum for One Image to 3D Generationcited by 21
  30. 2021DiffSDFSim: Differentiable Rigid-Body Dynamics With Implicit Shapescited by 14
  31. 2022Differentiable solver for time-dependent deformation problems with contactcited by 12
  32. 2024DreamPolisher: Towards High-Quality Text-to-3D Generation via Geometric Diffusioncited by 12
  33. 2024Precise-Physics Driven Text-to-3D Generationcited by 10
  34. 2023Few-Shot Physically-Aware Articulated Mesh Generation via Hierarchical Deformationcited by 8
  35. 2021Learning Body-Aware 3D Shape Generative Modelscited by 5
  36. 2023HandyPriors: Physically Consistent Perception of Hand-Object Interactions with Differentiable Priorscited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 1; 2025: 11; 2026: 8.

20 papers.

Sort:

By area:

  1. 2025CAST: Component-Aligned 3D Scene Reconstruction from an RGB Imagecited by 106
  2. 2025Scenethesis: A Language and Vision Agentic Framework for 3D Scene Generationcited by 67
  3. 2025DSO: Aligning 3D Generators with Simulation Feedback for Physical Soundnesscited by 25
  4. 2025Generative Physical AI in Vision: A Surveycited by 24
  5. 2024PhyCAGE: Physically Plausible Compositional 3D Asset Generation from a Single Imagecited by 19
  6. 2025PAT3D: Physics-Augmented Text-to-3D Scene Generationcited by 16
  7. 2025Grounding Creativity in Physics: A Brief Survey of Physical Priors in AIGCcited by 12
  8. 2025Is Single-View Mesh Reconstruction Ready for Robotics?cited by 6
  9. 2025SOPHY: Learning to Generate Simulation-Ready Objects with Physical Materialscited by 5
  10. 2025MIND: Microstructure INverse Design with Generative Hybrid Neural Representationcited by 4
  11. 2026φ-Scene: Physically Grounded Image-to-3D Scene Reconstructioncited by 3
  12. 2025CADKnitter: Compositional CAD Generation from Text and Geometry Guidancecited by 2
8 more
  1. 2026HSImul3R: Physics-in-the-Loop Reconstruction of Simulation-Ready Human-Scene Interactionscited by 2
  2. 2025DensiCrafter: Physically-Constrained Generation and Fabrication of Self-Supporting Hollow Structurescited by 1
  3. 20263D Generation for Embodied AI and Robotic Simulation: A Surveycited by 1
  4. 2026Generating Physically Sound Designs from Text and a Set of Physical Constraintscited by 0
  5. 2026Physically Grounded 3D Generative Reconstruction under Hand Occlusion using Proprioception and Multi-Contact Touchcited by 0
  6. 2026SNAP3D: Physically Grounded 3D Parts for Assembly from a Single Imagecited by 0
  7. 2026CODA: Depth-Aligned Scene Completion and Object Decomposition from a Single RGB-D Imagecited by 0
  8. 2026Towards Physically Grounded Articulated 3D Assets: A Multi-Agent Pipeline and Benchmarkcited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2026PhyScene3D: Physically Consistent Interactive 3D Tabletop Scene Generation
  2. 2024Consistent3D: Towards Consistent High-Fidelity Text-to-3D Generation with Deterministic Sampling Prior
  3. 2026From Visual Synthesis to Interactive Worlds: Toward Production-Ready 3D Asset Generation
  4. 2025Dive3D: Diverse Distillation-based Text-to-3D Generation via Score Implicit Matching
  5. 2024A Survey On Text-to-3D Contents Generation In The Wild
  6. 2026PhysX-Omni: Unified Simulation-Ready Physical 3D Generation for Rigid, Deformable, and Articulated Objects
  7. 2026ArtLLM: Generating Articulated Assets via 3D LLM
  8. 2024Text-to-3D Gaussian Splatting with Physics-Grounded Motion Generation