SALAD: Part-Level Latent Diffusion for 3D Shape Generation and Manipulation
On the map: Diffusion models → 3D, point cloud and scene generation
Abstract (arXiv)
We present a cascaded diffusion model based on a part-level implicit 3D representation. Our model achieves state-of-the-art generation quality and also enables part-level shape editing and manipulation without any additional training in conditional setup. Diffusion models have demonstrated impressive capabilities in data generation as well as zero-shot completion and editing via a guided reverse process. Recent research on 3D diffusion models has focused on improving their generation capabilities with various data representations, while the absence of structural information has limited their capability in completion and editing tasks. We thus propose our novel diffusion model using a part-level implicit representation. To effectively learn diffusion with high-dimensional embedding vectors of parts, we propose a cascaded framework, learning diffusion first on a low-dimensional subspace encoding extrinsic parameters of parts and then on the other high-dimensional subspace encoding intrinsic attributes. In the experiments, we demonstrate the outperformance of our method compared with the previous ones both in generation and part-level completion and manipulation tasks.
Key facts. Cited by 66 papers in the map (data through 7 Oct 2026). Placed in 3D, point cloud and scene generation, one of 14 directions in Diffusion models. Builds on 59 of its 72 references that are in the map. First posted on arXiv 21 Mar 2023.
Builds on
59 of 72 references.
Closest ancestors · 7
Same direction, newest first
- 2022Point-E: A System for Generating 3D Point Clouds from Complex Prompts16 Dec
- 20223D-LDM: Neural Implicit 3D Shape Generation with Latent Diffusion Models1 Dec
- 20223D Neural Field Generation using Triplane Diffusion30 Nov
- 2022Diffusion-SDF: Conditional Generative Modeling of Signed Distance Functions24 Nov
- 2022LION: Latent Point Diffusion Models for 3D Shape Generation12 Oct
- 2022RePaint: Inpainting using Denoising Diffusion Probabilistic Models24 Jan
- 2021Diffusion Probabilistic Models for 3D Point Cloud Generation2 Mar
Other references · 52
- 2017Attention Is All You Needcited by 59,932
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
- 2022Classifier-Free Diffusion Guidancecited by 5,717
- 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,223
- 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,384
- 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,880
- 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,682
- 2017FiLM: Visual Reasoning with a General Conditioning Layercited by 2,286
38 more
- 2018Occupancy Networks: Learning 3D Reconstruction in Function Spacecited by 2,037
- 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,903
- 2021Efficient Geometry-aware 3D Generative Adversarial Networkscited by 1,204
- 2021Cascaded Diffusion Models for High Fidelity Image Generationcited by 1,155
- 2018Learning Implicit Fields for Generative Shape Modelingcited by 1,060
- 2018PartNet: A Large-scale Benchmark for Fine-grained and Hierarchical Part-level 3D Object Understandingcited by 521
- 20213D Shape Generation and Completion through Point-Voxel Diffusioncited by 516
- 2022Improving Diffusion Models for Inverse Problems using Manifold Constraintscited by 501
- 2022GET3D: A Generative Model of High Quality 3D Textured Shapes Learned from Imagescited by 446
- 2020Modular Primitives for High-Performance Differentiable Renderingcited by 439
- 2022SDFusion: Multimodal 3D Shape Completion, Reconstruction, and Generationcited by 287
- 2020PolyGen: An Autoregressive Generative Model of 3D Meshescited by 267
- 2016Revisiting Classifier Two-Sample Testscited by 258
- 2020Learning Gradient Fields for Shape Generationcited by 245
- 2019Learning Shape Templates with Structured Implicit Functionscited by 242
- 2022Riemannian Score-Based Generative Modellingcited by 216
- 2022AutoSDF: Shape Priors for 3D Completion, Reconstruction and Generationcited by 208
- 2019BSP-Net: Generating Compact Meshes via Binary Space Partitioningcited by 205
- 2016Learning Shape Abstractions by Assembling Volumetric Primitivescited by 181
- 20193D Point Cloud Generative Adversarial Network Based on Tree Structured Graph Convolutionscited by 173
- 2019CvxNet: Learnable Convex Decompositioncited by 173
- 2023Video Probabilistic Diffusion Models in Projected Latent Spacecited by 171
- 2022Neural Wavelet-domain Diffusion for 3D Shape Generationcited by 132
- 2022Diffusion-SDF: Text-to-Shape via Voxelized Diffusioncited by 128
- 2019Superquadrics Revisited: Learning 3D Shape Parsing beyond Cuboidscited by 123
- 2022ShapeFormer: Transformer-based Shape Completion via Sparse Representationcited by 106
- 2018PointGrow: Autoregressively Learned Point Cloud Generation with Self-Attentioncited by 105
- 2021Neural Parts: Learning Expressive 3D Shape Abstractions with Invertible Neural Networkscited by 101
- 20223DILG: Irregular Latent Grids for 3D Generative Modelingcited by 92
- 2022SDF-StyleGAN: Implicit SDF-Based StyleGAN for 3D Shape Generationcited by 92
- 2020DualSDF: Semantic Shape Manipulation using a Two-Level Representationcited by 82
- 2022ShapeCrafter: A Recursive Text-Conditioned 3D Shape Generation Modelcited by 62
- 2019ShapeGlot: Learning Language for Shape Differentiationcited by 54
- 20213D Shape Generation with Grid-based Implicit Functionscited by 48
- 2020Adversarial Generation of Continuous Implicit Shape Representationscited by 46
- 2021Unsupervised Learning for Cuboid Shape Abstraction via Joint Segmentation from Point Cloudscited by 44
- 2022Neural Template: Topology-aware Reconstruction and Disentangled Generation of 3D Meshescited by 34
- 2021PartGlot: Learning Shape Part Segmentation from Language Reference Gamescited by 30
50 most cited of 52 All 52 (JSON)
Built on by
Citing papers per year: 2023: 9; 2024: 21; 2025: 22; 2026: 14.
66 papers.
Sort:
By area:
- 2025PartCrafter: Structured 3D Mesh Generation via Compositional Latent Diffusion Transformerscited by 78
- 2024D4M: Dataset Distillation via Disentangled Diffusion Modelcited by 76
- 2024SINGAPO: Single Image Controlled Generation of Articulated Parts in Objectscited by 66
- 2024SPAD : Spatially Aware Multiview Diffuserscited by 62
- 2024Generating CAD Code with Vision-Language Models for 3D Designscited by 61
- 2024PartGen: Part-level 3D Generation and Reconstruction with Multi-View Diffusion Modelscited by 60
- 2025OmniPart: Part-Aware 3D Generation with Semantic Decoupling and Structural Cohesioncited by 60
- 2025HoloPart: Generative 3D Part Amodal Segmentationcited by 57
- 2024Part123: Part-aware 3D Reconstruction from a Single-view Imagecited by 54
- 2023DiffCAD: Weakly-Supervised Probabilistic CAD Model Retrieval and Alignment from an RGB Imagecited by 48
- 2023Posterior Distillation Samplingcited by 45
- 2025Articulate AnyMesh: Open-Vocabulary 3D Articulated Objects Modelingcited by 41
38 more
- 2025AutoPartGen: Autogressive 3D Part Generation and Discoverycited by 33
- 2023UniGS: Unified Representation for Image Generation and Segmentationcited by 29
- 2025From One to More: Contextual Part Latents for 3D Generationcited by 26
- 2023As-Plausible-As-Possible: Plausibility-Aware Mesh Deformation Using 2D Diffusion Priorscited by 24
- 2024UDiFF: Generating Conditional Unsigned Distance Fields with Optimal Wavelet Diffusioncited by 23
- 2023CAD: Photorealistic 3D Generation via Adversarial Distillationcited by 18
- 2025FullPart: Generating each 3D Part at Full Resolutioncited by 17
- 2025MeshCoder: LLM-Powered Structured Mesh Code Generation from Point Cloudscited by 15
- 2024Text-to-3D Shape Generationcited by 13
- 2024Diffusion Models in 3D Vision: A Surveycited by 11
- 2024Selectively Informative Description can Reduce Undesired Embedding Entanglements in Text-to-Image Personalizationcited by 10
- 2023Surf-D: Generating High-Quality Surfaces of Arbitrary Topologies Using Diffusion Modelscited by 8
- 2023Advances in 3D Neural Stylization: A Surveycited by 8
- 2024CNS-Edit: 3D Shape Editing via Coupled Neural Shape Optimizationcited by 8
- 2024Coherent 3D Scene Diffusion From a Single RGB Imagecited by 8
- 2025PartSDF: Part-Based Implicit Neural Representation for Composite 3D Shape Parametrization and Optimizationcited by 8
- 2023Spice-E : Structural Priors in 3D Diffusion using Cross-Entity Attentioncited by 7
- 2024Neural Pose Representation Learning for Generating and Transferring Non-Rigid Object Posescited by 6
- 2025MeshPad: Interactive Sketch-Conditioned Artist-Reminiscent Mesh Generation and Editingcited by 6
- 2026VGGT-Motion: Motion-Aware Calibration-Free Monocular SLAM for Long-Range Consistencycited by 6
- 2024Part-aware Shape Generation with Latent 3D Diffusion of Neural Voxel Fieldscited by 5
- 2024Multi-hypotheses Conditioned Point Cloud Diffusion for 3D Human Reconstruction from Occluded Imagescited by 5
- 2025Toward Ambulatory Vision: Learning Visually-Grounded Active View Selectioncited by 5
- 2026CubePart: An Open-Vocabulary Part-Controllable 3D Generatorcited by 5
- 2025Fine-Grained Image-Text Correspondence with Cost Aggregation for Open-Vocabulary Part Segmentationcited by 4
- 2023ToddlerDiffusion: Interactive Structured Image Generation with Cascaded Schr"odinger Bridgecited by 3
- 2024Occupancy-Based Dual Contouringcited by 3
- 2024GenUDC: High Quality 3D Mesh Generation with Unsigned Dual Contouring Representationcited by 3
- 2025LAMP: Data-Efficient Linear Affine Weight-Space Models for Parameter-Controlled 3D Shape Generation and Extrapolationcited by 3
- 2026Deep Sketch-Based 3D Modeling: A Surveycited by 3
- 2024Diffusion Models for Generating Ballistic Spacecraft Trajectoriescited by 2
- 20243D-WAG: Hierarchical Wavelet-Guided Autoregressive Generation for High-Fidelity 3D Shapescited by 2
- 2024JADE: Joint-aware Latent Diffusion for 3D Human Generative Modelingcited by 2
- 2026DreamPartGen: Semantically Grounded Part-Level 3D Generation via Collaborative Latent Denoisingcited by 2
- 2024Parameterize Structure with Differentiable Template for 3D Shape Generationcited by 1
- 2025Chirpy3D: Part-Aware Multi-View Diffusion for Creative Fine-Grained Object Generationcited by 1
- 2025PrITTI: Primitive-based Generation of Controllable and Editable 3D Semantic Urban Scenescited by 1
- 2025CardioComposer: Leveraging Differentiable Geometry for Compositional Control of Anatomical Diffusion Modelscited by 1
50 most cited of 66 All 66 (JSON)
- 2026KaiNinja: Extending Native 3D Generators to the Part Level14 Sep 2026
- 2026Hierarchical Flow Matching for 3D Point Cloud Generation6 Aug 2026
- 2026CNS-Edit++: Category-Agnostic 3D Editing with Coupled Neural Shape Representation18 Jul 2026
- 2026Arbor: Explicit Geometric Conditioning for Controllable 3D Asset Generation22 Jun 2026
- 20263DMorph: Single-Image-Guided Local 3D Shape Editing and Morphing5 Jun 2026
- 2026CubePart: An Open-Vocabulary Part-Controllable 3D Generator27 May 2026
- 2026CompoSE: Compositional Synthesis and Editing of 3D Shapes via Part-Aware Control19 May 2026
- 2026EditCrafter: Tuning-free High-Resolution Image Editing via Pretrained Diffusion Model11 Apr 2026
- 2026DreamPartGen: Semantically Grounded Part-Level 3D Generation via Collaborative Latent Denoising19 Mar 2026
- 2026MotionAnymesh: Physics-Grounded Articulation for Simulation-Ready Digital Twins13 Mar 2026
- 2026BoxSplitGen: A Generative Model for 3D Part Bounding Boxes in Varying Granularity24 Feb 2026
- 2026VGGT-Motion: Motion-Aware Calibration-Free Monocular SLAM for Long-Range Consistency5 Feb 2026
38 more
- 2026Quartet of Diffusions: Structure-Aware Point Cloud Generation through Part and Symmetry Guidance28 Jan 2026
- 2026Deep Sketch-Based 3D Modeling: A Survey22 Jan 2026
- 2025Toward Ambulatory Vision: Learning Visually-Grounded Active View Selection15 Dec 2025
- 2025Anatomica: Localized Control over Geometric and Topological Properties for Anatomical Diffusion Models25 Nov 2025
- 2025FullPart: Generating each 3D Part at Full Resolution30 Oct 2025
- 2025LAMP: Data-Efficient Linear Affine Weight-Space Models for Parameter-Controlled 3D Shape Generation and Extrapolation26 Oct 2025
- 2025Cascaded Diffusion Framework for Probabilistic Coarse-to-Fine Hand Pose Estimation1 Oct 2025
- 2025StrucADT: Generating Structure-controlled 3D Point Clouds with Adjacency Diffusion Transformer28 Sep 2025
- 2025CardioComposer: Leveraging Differentiable Geometry for Compositional Control of Anatomical Diffusion Models8 Sep 2025
- 2025MeshCoder: LLM-Powered Structured Mesh Code Generation from Point Clouds20 Aug 2025
- 2025AutoPartGen: Autogressive 3D Part Generation and Discovery17 Jul 2025
- 2025From One to More: Contextual Part Latents for 3D Generation11 Jul 2025
- 2025OmniPart: Part-Aware 3D Generation with Semantic Decoupling and Structural Cohesion8 Jul 2025
- 20253D Shape Generation: A Survey27 Jun 2025
- 2025PrITTI: Primitive-based Generation of Controllable and Editable 3D Semantic Urban Scenes23 Jun 2025
- 2025PartCrafter: Structured 3D Mesh Generation via Compositional Latent Diffusion Transformers5 Jun 2025
- 2025HoloPart: Generative 3D Part Amodal Segmentation10 Apr 2025
- 2025QEMesh: Employing A Quadric Error Metrics-Based Representation for Mesh Generation8 Apr 2025
- 2025PRISM: Probabilistic Representation for Integrated Shape Modeling and Generation6 Apr 2025
- 2025MeshPad: Interactive Sketch-Conditioned Artist-Reminiscent Mesh Generation and Editing3 Mar 2025
- 2025PartSDF: Part-Based Implicit Neural Representation for Composite 3D Shape Parametrization and Optimization18 Feb 2025
- 2025Articulate AnyMesh: Open-Vocabulary 3D Articulated Objects Modeling4 Feb 2025
- 2025Fine-Grained Image-Text Correspondence with Cost Aggregation for Open-Vocabulary Part Segmentation16 Jan 2025
- 2025Chirpy3D: Part-Aware Multi-View Diffusion for Creative Fine-Grained Object Generation7 Jan 2025
- 2024JADE: Joint-aware Latent Diffusion for 3D Human Generative Modeling29 Dec 2024
- 2024PartGen: Part-level 3D Generation and Reconstruction with Multi-View Diffusion Models24 Dec 2024
- 2024Coherent 3D Scene Diffusion From a Single RGB Image13 Dec 2024
- 20243D-WAG: Hierarchical Wavelet-Guided Autoregressive Generation for High-Fidelity 3D Shapes28 Nov 2024
- 2024GenUDC: High Quality 3D Mesh Generation with Unsigned Dual Contouring Representation23 Oct 2024
- 2024SINGAPO: Single Image Controlled Generation of Articulated Parts in Objects21 Oct 2024
- 2024Parameterize Structure with Differentiable Template for 3D Shape Generation14 Oct 2024
- 2024Generating CAD Code with Vision-Language Models for 3D Designs7 Oct 2024
- 2024Diffusion Models in 3D Vision: A Survey7 Oct 2024
- 2024Multi-hypotheses Conditioned Point Cloud Diffusion for 3D Human Reconstruction from Occluded Images27 Sep 2024
- 2024Occupancy-Based Dual Contouring20 Sep 2024
- 2024D4M: Dataset Distillation via Disentangled Diffusion Model21 Jul 2024
- 2024Neural Pose Representation Learning for Generating and Transferring Non-Rigid Object Poses14 Jun 2024
- 2024Part123: Part-aware 3D Reconstruction from a Single-view Image27 May 2024
50 newest of 66 All 66 (JSON)
- 2025PartCrafter: Structured 3D Mesh Generation via Compositional Latent Diffusion Transformerscited by 78
- 2024D4M: Dataset Distillation via Disentangled Diffusion Modelcited by 76
- 2024PartGen: Part-level 3D Generation and Reconstruction with Multi-View Diffusion Modelscited by 60
- 2024Part123: Part-aware 3D Reconstruction from a Single-view Imagecited by 54
- 2023Posterior Distillation Samplingcited by 45
- 2023UniGS: Unified Representation for Image Generation and Segmentationcited by 29
- 2025From One to More: Contextual Part Latents for 3D Generationcited by 26
- 2023As-Plausible-As-Possible: Plausibility-Aware Mesh Deformation Using 2D Diffusion Priorscited by 24
- 2024UDiFF: Generating Conditional Unsigned Distance Fields with Optimal Wavelet Diffusioncited by 23
- 2023CAD: Photorealistic 3D Generation via Adversarial Distillationcited by 18
- 2024Diffusion Models in 3D Vision: A Surveycited by 11
- 2023Surf-D: Generating High-Quality Surfaces of Arbitrary Topologies Using Diffusion Modelscited by 8
12 most cited of 26 All 26 (JSON)
- 2026Hierarchical Flow Matching for 3D Point Cloud Generation6 Aug 2026
- 2026EditCrafter: Tuning-free High-Resolution Image Editing via Pretrained Diffusion Model11 Apr 2026
- 2026BoxSplitGen: A Generative Model for 3D Part Bounding Boxes in Varying Granularity24 Feb 2026
- 2025Anatomica: Localized Control over Geometric and Topological Properties for Anatomical Diffusion Models25 Nov 2025
- 2025Cascaded Diffusion Framework for Probabilistic Coarse-to-Fine Hand Pose Estimation1 Oct 2025
- 2025StrucADT: Generating Structure-controlled 3D Point Clouds with Adjacency Diffusion Transformer28 Sep 2025
- 2025CardioComposer: Leveraging Differentiable Geometry for Compositional Control of Anatomical Diffusion Models8 Sep 2025
- 2025From One to More: Contextual Part Latents for 3D Generation11 Jul 2025
- 2025PartCrafter: Structured 3D Mesh Generation via Compositional Latent Diffusion Transformers5 Jun 2025
- 2025QEMesh: Employing A Quadric Error Metrics-Based Representation for Mesh Generation8 Apr 2025
- 2024JADE: Joint-aware Latent Diffusion for 3D Human Generative Modeling29 Dec 2024
- 2024PartGen: Part-level 3D Generation and Reconstruction with Multi-View Diffusion Models24 Dec 2024
12 newest of 26 All 26 (JSON)
- 2024SINGAPO: Single Image Controlled Generation of Articulated Parts in Objectscited by 66
- 2024SPAD : Spatially Aware Multiview Diffuserscited by 62
- 2024Generating CAD Code with Vision-Language Models for 3D Designscited by 61
- 2025OmniPart: Part-Aware 3D Generation with Semantic Decoupling and Structural Cohesioncited by 60
- 2025HoloPart: Generative 3D Part Amodal Segmentationcited by 57
- 2023DiffCAD: Weakly-Supervised Probabilistic CAD Model Retrieval and Alignment from an RGB Imagecited by 48
- 2025Articulate AnyMesh: Open-Vocabulary 3D Articulated Objects Modelingcited by 41
- 2025AutoPartGen: Autogressive 3D Part Generation and Discoverycited by 33
- 2025FullPart: Generating each 3D Part at Full Resolutioncited by 17
- 2025MeshCoder: LLM-Powered Structured Mesh Code Generation from Point Cloudscited by 15
- 2024Text-to-3D Shape Generationcited by 13
- 2024Selectively Informative Description can Reduce Undesired Embedding Entanglements in Text-to-Image Personalizationcited by 10
12 most cited of 38 All 38 (JSON)
- 2026KaiNinja: Extending Native 3D Generators to the Part Level14 Sep 2026
- 2026CNS-Edit++: Category-Agnostic 3D Editing with Coupled Neural Shape Representation18 Jul 2026
- 2026Arbor: Explicit Geometric Conditioning for Controllable 3D Asset Generation22 Jun 2026
- 20263DMorph: Single-Image-Guided Local 3D Shape Editing and Morphing5 Jun 2026
- 2026CubePart: An Open-Vocabulary Part-Controllable 3D Generator27 May 2026
- 2026CompoSE: Compositional Synthesis and Editing of 3D Shapes via Part-Aware Control19 May 2026
- 2026DreamPartGen: Semantically Grounded Part-Level 3D Generation via Collaborative Latent Denoising19 Mar 2026
- 2026MotionAnymesh: Physics-Grounded Articulation for Simulation-Ready Digital Twins13 Mar 2026
- 2026VGGT-Motion: Motion-Aware Calibration-Free Monocular SLAM for Long-Range Consistency5 Feb 2026
- 2026Quartet of Diffusions: Structure-Aware Point Cloud Generation through Part and Symmetry Guidance28 Jan 2026
- 2026Deep Sketch-Based 3D Modeling: A Survey22 Jan 2026
- 2025FullPart: Generating each 3D Part at Full Resolution30 Oct 2025
12 newest of 38 All 38 (JSON)
Similar, not cited
Close in wording, no citation either way
- 2024ShapeFusion: A 3D diffusion model for localized shape editing
- 2026ShapeUP: Scalable Image-Conditioned 3D Editing
- 2025Evaluating Latent Generative Paradigms for High-Fidelity 3D Shape Completion from a Single Depth Image
- 2025HierOctFusion: Multi-scale Octree-based 3D Shape Generation via Part-Whole-Hierarchy Message Passing
- 2025Repurposing 2D Diffusion Models for 3D Shape Completion
- 2024Topology-Aware Latent Diffusion for 3D Shape Generation
- 2023Diffusion Handles: Enabling 3D Edits for Diffusion Models by Lifting Activations to 3D
- 2024SC-Diff: 3D Shape Completion with Latent Diffusion Models