Atlas3D: Physically Constrained Self-Supporting Text-to-3D for Simulation and Fabrication
On the map: Diffusion models → 3D, point cloud and scene generation
Abstract (arXiv)
Existing diffusion-based text-to-3D generation methods primarily focus on producing visually realistic shapes and appearances, often neglecting the physical constraints necessary for downstream tasks. Generated models frequently fail to maintain balance when placed in physics-based simulations or 3D printed. This balance is crucial for satisfying user design intentions in interactive gaming, embodied AI, and robotics, where stable models are needed for reliable interaction. Additionally, stable models ensure that 3D-printed objects, such as figurines for home decoration, can stand on their own without requiring additional supports. To fill this gap, we introduce Atlas3D, an automatic and easy-to-implement method that enhances existing Score Distillation Sampling (SDS)-based text-to-3D tools. Atlas3D ensures the generation of self-supporting 3D models that adhere to physical laws of stability under gravity, contact, and friction. Our approach combines a novel differentiable simulation-based loss function with physically inspired regularization, serving as either a refinement or a post-processing module for existing frameworks. We verify Atlas3D's efficacy through extensive generation tasks and validate the resulting 3D models in both simulated and real-world environments.
Key facts. Cited by 20 papers in the map (data through 14 Oct 2026). Placed in 3D, point cloud and scene generation, one of 14 directions in Diffusion models. Builds on 88 of its 111 references that are in the map. First posted on arXiv 28 May 2024.
Builds on
88 of 111 references.
Closest ancestors · 40
Same direction, newest first
- 2024SV3D: Novel Multi-view Synthesis and 3D Generation from a Single Image using Latent Video Diffusion18 Mar
- 2024V3D: Video Diffusion Models are Effective 3D Generators11 Mar
- 2024EscherNet: A Generative Model for Scalable View Synthesis6 Feb
- 2023Learn to Optimize Denoising Scores for 3D Generation: A Unified and Improved Diffusion Prior on NeRF and 3D Gaussian Splatting8 Dec
- 2023ImageDream: Image-Prompt Multi-view Diffusion for 3D Generation2 Dec
- 2023CG3D: Compositional Generation for Text-to-3D via Gaussian Splatting29 Nov
- 2023One-2-3-45++: Fast Single Image to 3D Objects with Consistent Multi-View Generation and 3D Diffusion14 Nov
- 2023Instant3D: Fast Text-to-3D with Sparse-View Generation and Large Reconstruction Model10 Nov
- 2023Text-to-3D with Classifier Score Distillation30 Oct
- 2023Zero123++: a Single Image to Consistent Multi-view Diffusion Base Model23 Oct
- 2023Wonder3D: Single Image to 3D using Cross-Domain Diffusion23 Oct
- 2023Consistent123: Improve Consistency for One Image to 3D Object Synthesis12 Oct
28 more
- 2023Consistent-1-to-3: Consistent Image to 3D View Synthesis via Geometry-aware Diffusion Models4 Oct
- 2023SweetDreamer: Aligning Geometric Priors in 2D Diffusion for Consistent Text-to-3D4 Oct
- 2023Large-Vocabulary 3D Diffusion Model with Transformer14 Sep
- 2023SyncDreamer: Generating Multiview-consistent Images from a Single-view Image7 Sep
- 2023MVDream: Multi-view Diffusion for 3D Generation31 Aug
- 2023AutoDecoding Latent 3D Diffusion Models7 Jul
- 2023DiT-3D: Exploring Plain Diffusion Transformers for 3D Shape Generation4 Jul
- 2023Magic123: One Image to High-Quality 3D Object Generation Using Both 2D and 3D Diffusion Priors30 Jun
- 2023One-2-3-45: Any Single Image to 3D Mesh in 45 Seconds without Per-Shape Optimization29 Jun
- 2023DreamTime: An Improved Optimization Strategy for Diffusion-Guided 3D Generation21 Jun
- 2023Viewset Diffusion: (0-)Image-Conditioned 3D Generative Models from 2D Data13 Jun
- 2023ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillation25 May
- 2023Single-Stage Diffusion NeRF: A Unified Approach to 3D Generation and Reconstruction13 Apr
- 2023HoloDiffusion: Training a 3D Diffusion Model using 2D Images29 Mar
- 2023Debiasing Scores and Prompts of 2D Diffusion for View-consistent Text-to-3D Generation27 Mar
- 2023Make-It-3D: High-Fidelity 3D Creation from A Single Image with Diffusion Prior24 Mar
- 2023Fantasia3D: Disentangling Geometry and Appearance for High-quality Text-to-3D Content Creation24 Mar
- 2023Zero-1-to-3: Zero-shot One Image to 3D Object20 Mar
- 2023Let 2D Diffusion Model Know 3D-Consistency for Robust Text-to-3D Generation14 Mar
- 20233DGen: Triplane Latent Diffusion for Textured Mesh Generation9 Mar
- 2022DiffRF: Rendering-Guided 3D Radiance Field Diffusion2 Dec
- 2022Score Jacobian Chaining: Lifting Pretrained 2D Diffusion Models for 3D Generation1 Dec
- 20223D Neural Field Generation using Triplane Diffusion30 Nov
- 2022Magic3D: High-Resolution Text-to-3D Content Creation18 Nov
- 2022RenderDiffusion: Image Diffusion for 3D Reconstruction, Inpainting and Generation17 Nov
- 2022LION: Latent Point Diffusion Models for 3D Shape Generation12 Oct
- 2022DreamFusion: Text-to-3D using 2D Diffusion29 Sep
- 2021Diffusion Probabilistic Models for 3D Point Cloud Generation2 Mar
Other references · 48
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2021NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstructioncited by 1,712
- 2023DreamGaussian: Generative Gaussian Splatting for Efficient 3D Content Creationcited by 843
- 2022Latent-NeRF for Shape-Guided Generation of 3D Shapes and Texturescited by 506
- 2021Deep Marching Tetrahedra: a Hybrid Representation for High-Resolution 3D Shape Synthesiscited by 460
- 2023Emergent Correspondence from Image Diffusioncited by 446
- 2020Modular Primitives for High-Performance Differentiable Renderingcited by 441
- 2023PhysGaussian: Physics-Integrated 3D Gaussians for Generative Dynamicscited by 377
- 2022PhysDiff: Physics-Guided Human Motion Diffusion Modelcited by 368
- 2021Text2Mesh: Text-Driven Neural Stylization for Meshescited by 334
- 2023Holodeck: Language Guided Generation of 3D Embodied AI Environmentscited by 268
36 more
- 2023Diffusion-based Generation, Optimization, and Planning in 3D Scenescited by 239
- 2022SparseFusion: Distilling View-conditioned Diffusion for 3D Reconstructioncited by 216
- 2023DMV3D: Denoising Multi-View Diffusion using 3D Large Reconstruction Modelcited by 214
- 2024PhysDreamer: Physics-Based Interaction with 3D Objects via Video Generationcited by 191
- 2022From data to functa: Your data point is a function and you can treat it like onecited by 187
- 2024VR-GS: A Physical Dynamics-Aware Interactive Gaussian Splatting System in Virtual Realitycited by 179
- 2023PAC-NeRF: Physics Augmented Continuum Neural Radiance Fields for Geometry-Agnostic System Identificationcited by 154
- 2024GPT-4V(ision) is a Human-Aligned Evaluator for Text-to-3D Generationcited by 153
- 2023HyperDiffusion: Generating Implicit Neural Fields with Weight-Space Diffusioncited by 152
- 2022GAUDI: A Neural Architect for Immersive 3D Scene Generationcited by 136
- 2023Locally Attentional SDF Diffusion for Controllable 3D Shape Generationcited by 130
- 2022Diffusion-SDF: Text-to-Shape via Voxelized Diffusioncited by 128
- 2024PhyScene: Physically Interactable 3D Scene Synthesis for Embodied AIcited by 125
- 2021PlasticineLab: A Soft-Body Manipulation Benchmark with Differentiable Physicscited by 103
- 2023Compositional 3D Scene Generation using Locally Conditioned Diffusioncited by 101
- 2021gradSim: Differentiable simulation for system identification and visuomotor controlcited by 100
- 2023Noise-Free Score Distillationcited by 99
- 2023Free3D: Consistent Novel View Synthesis without 3D Representationcited by 72
- 2021DiffCloth: Differentiable Cloth Simulation with Dry Frictional Contactcited by 65
- 2023ConsistNet: Enforcing 3D Consistency for Multi-view Images Diffusioncited by 65
- 2024Feature Splatting: Language-Driven Physics-Based Scene Synthesis and Editingcited by 45
- 2024PhyRecon: Physically Plausible Neural Scene Reconstructioncited by 45
- 2023DiffAvatar: Simulation-Ready Garment Optimization with Differentiable Simulationcited by 41
- 2021Efficient Differentiable Simulation of Articulated Bodiescited by 39
- 2022Virtual Elastic Objectscited by 35
- 2022DiffCloud: Real-to-Sim from Point Clouds with Differentiable Simulation and Rendering of Deformable Objectscited by 31
- 2023Stable Score Distillation for High-Quality 3D Generationcited by 27
- 2024HexaGen3D: StableDiffusion is just one step away from Fast and Diverse Text-to-3D Generationcited by 21
- 2024Diffusion Time-step Curriculum for One Image to 3D Generationcited by 21
- 2021DiffSDFSim: Differentiable Rigid-Body Dynamics With Implicit Shapescited by 14
- 2022Differentiable solver for time-dependent deformation problems with contactcited by 12
- 2024DreamPolisher: Towards High-Quality Text-to-3D Generation via Geometric Diffusioncited by 12
- 2024Precise-Physics Driven Text-to-3D Generationcited by 10
- 2023Few-Shot Physically-Aware Articulated Mesh Generation via Hierarchical Deformationcited by 8
- 2021Learning Body-Aware 3D Shape Generative Modelscited by 5
- 2023HandyPriors: Physically Consistent Perception of Hand-Object Interactions with Differentiable Priorscited by 3
Built on by
Citing papers per year: 2024: 1; 2025: 11; 2026: 8.
20 papers.
Sort:
By area:
- 2025CAST: Component-Aligned 3D Scene Reconstruction from an RGB Imagecited by 106
- 2025Scenethesis: A Language and Vision Agentic Framework for 3D Scene Generationcited by 67
- 2025DSO: Aligning 3D Generators with Simulation Feedback for Physical Soundnesscited by 25
- 2025Generative Physical AI in Vision: A Surveycited by 24
- 2024PhyCAGE: Physically Plausible Compositional 3D Asset Generation from a Single Imagecited by 19
- 2025PAT3D: Physics-Augmented Text-to-3D Scene Generationcited by 16
- 2025Grounding Creativity in Physics: A Brief Survey of Physical Priors in AIGCcited by 12
- 2025Is Single-View Mesh Reconstruction Ready for Robotics?cited by 6
- 2025SOPHY: Learning to Generate Simulation-Ready Objects with Physical Materialscited by 5
- 2025MIND: Microstructure INverse Design with Generative Hybrid Neural Representationcited by 4
- 2026φ-Scene: Physically Grounded Image-to-3D Scene Reconstructioncited by 3
- 2025CADKnitter: Compositional CAD Generation from Text and Geometry Guidancecited by 2
8 more
- 2026HSImul3R: Physics-in-the-Loop Reconstruction of Simulation-Ready Human-Scene Interactionscited by 2
- 2025DensiCrafter: Physically-Constrained Generation and Fabrication of Self-Supporting Hollow Structurescited by 1
- 20263D Generation for Embodied AI and Robotic Simulation: A Surveycited by 1
- 2026Generating Physically Sound Designs from Text and a Set of Physical Constraintscited by 0
- 2026Physically Grounded 3D Generative Reconstruction under Hand Occlusion using Proprioception and Multi-Contact Touchcited by 0
- 2026SNAP3D: Physically Grounded 3D Parts for Assembly from a Single Imagecited by 0
- 2026CODA: Depth-Aligned Scene Completion and Object Decomposition from a Single RGB-D Imagecited by 0
- 2026Towards Physically Grounded Articulated 3D Assets: A Multi-Agent Pipeline and Benchmarkcited by 0
- 2026Towards Physically Grounded Articulated 3D Assets: A Multi-Agent Pipeline and Benchmark9 Oct 2026
- 2026CODA: Depth-Aligned Scene Completion and Object Decomposition from a Single RGB-D Image22 Sep 2026
- 2026SNAP3D: Physically Grounded 3D Parts for Assembly from a Single Image11 Sep 2026
- 2026φ-Scene: Physically Grounded Image-to-3D Scene Reconstruction19 Jun 2026
- 20263D Generation for Embodied AI and Robotic Simulation: A Survey29 Apr 2026
- 2026Physically Grounded 3D Generative Reconstruction under Hand Occlusion using Proprioception and Multi-Contact Touch10 Apr 2026
- 2026HSImul3R: Physics-in-the-Loop Reconstruction of Simulation-Ready Human-Scene Interactions16 Mar 2026
- 2026Generating Physically Sound Designs from Text and a Set of Physical Constraints2 Feb 2026
- 2025CADKnitter: Compositional CAD Generation from Text and Geometry Guidance12 Dec 2025
- 2025PAT3D: Physics-Augmented Text-to-3D Scene Generation26 Nov 2025
- 2025DensiCrafter: Physically-Constrained Generation and Fabrication of Self-Supporting Hollow Structures12 Nov 2025
- 2025Is Single-View Mesh Reconstruction Ready for Robotics?23 May 2025
8 more
- 2025Scenethesis: A Language and Vision Agentic Framework for 3D Scene Generation5 May 2025
- 2025SOPHY: Learning to Generate Simulation-Ready Objects with Physical Materials17 Apr 2025
- 2025DSO: Aligning 3D Generators with Simulation Feedback for Physical Soundness28 Mar 2025
- 2025CAST: Component-Aligned 3D Scene Reconstruction from an RGB Image18 Feb 2025
- 2025Grounding Creativity in Physics: A Brief Survey of Physical Priors in AIGC10 Feb 2025
- 2025MIND: Microstructure INverse Design with Generative Hybrid Neural Representation1 Feb 2025
- 2025Generative Physical AI in Vision: A Survey19 Jan 2025
- 2024PhyCAGE: Physically Plausible Compositional 3D Asset Generation from a Single Image27 Nov 2024
- 2025PAT3D: Physics-Augmented Text-to-3D Scene Generationcited by 16
- 2025PAT3D: Physics-Augmented Text-to-3D Scene Generation26 Nov 2025
- 2025CAST: Component-Aligned 3D Scene Reconstruction from an RGB Imagecited by 106
- 2025DSO: Aligning 3D Generators with Simulation Feedback for Physical Soundnesscited by 25
- 2025Generative Physical AI in Vision: A Surveycited by 24
- 2024PhyCAGE: Physically Plausible Compositional 3D Asset Generation from a Single Imagecited by 19
- 2025Grounding Creativity in Physics: A Brief Survey of Physical Priors in AIGCcited by 12
- 2025Is Single-View Mesh Reconstruction Ready for Robotics?cited by 6
- 2025SOPHY: Learning to Generate Simulation-Ready Objects with Physical Materialscited by 5
- 2025MIND: Microstructure INverse Design with Generative Hybrid Neural Representationcited by 4
- 2026φ-Scene: Physically Grounded Image-to-3D Scene Reconstructioncited by 3
- 2025CADKnitter: Compositional CAD Generation from Text and Geometry Guidancecited by 2
- 2026HSImul3R: Physics-in-the-Loop Reconstruction of Simulation-Ready Human-Scene Interactionscited by 2
- 2025DensiCrafter: Physically-Constrained Generation and Fabrication of Self-Supporting Hollow Structurescited by 1
12 most cited of 17 All 17 (JSON)
- 2026Towards Physically Grounded Articulated 3D Assets: A Multi-Agent Pipeline and Benchmark9 Oct 2026
- 2026CODA: Depth-Aligned Scene Completion and Object Decomposition from a Single RGB-D Image22 Sep 2026
- 2026SNAP3D: Physically Grounded 3D Parts for Assembly from a Single Image11 Sep 2026
- 2026φ-Scene: Physically Grounded Image-to-3D Scene Reconstruction19 Jun 2026
- 20263D Generation for Embodied AI and Robotic Simulation: A Survey29 Apr 2026
- 2026HSImul3R: Physics-in-the-Loop Reconstruction of Simulation-Ready Human-Scene Interactions16 Mar 2026
- 2026Generating Physically Sound Designs from Text and a Set of Physical Constraints2 Feb 2026
- 2025CADKnitter: Compositional CAD Generation from Text and Geometry Guidance12 Dec 2025
- 2025DensiCrafter: Physically-Constrained Generation and Fabrication of Self-Supporting Hollow Structures12 Nov 2025
- 2025Is Single-View Mesh Reconstruction Ready for Robotics?23 May 2025
- 2025SOPHY: Learning to Generate Simulation-Ready Objects with Physical Materials17 Apr 2025
- 2025DSO: Aligning 3D Generators with Simulation Feedback for Physical Soundness28 Mar 2025
12 newest of 17 All 17 (JSON)
Similar, not cited
Close in wording, no citation either way
- 2026PhyScene3D: Physically Consistent Interactive 3D Tabletop Scene Generation
- 2024Consistent3D: Towards Consistent High-Fidelity Text-to-3D Generation with Deterministic Sampling Prior
- 2026From Visual Synthesis to Interactive Worlds: Toward Production-Ready 3D Asset Generation
- 2025Dive3D: Diverse Distillation-based Text-to-3D Generation via Score Implicit Matching
- 2024A Survey On Text-to-3D Contents Generation In The Wild
- 2026PhysX-Omni: Unified Simulation-Ready Physical 3D Generation for Rigid, Deformable, and Articulated Objects
- 2026ArtLLM: Generating Articulated Assets via 3D LLM
- 2024Text-to-3D Gaussian Splatting with Physics-Grounded Motion Generation