OmniPart: Part-Aware 3D Generation with Semantic Decoupling and Structural Cohesion
Not on the map. Why?
Abstract (arXiv)
The creation of 3D assets with explicit, editable part structures is crucial for advancing interactive applications, yet most generative methods produce only monolithic shapes, limiting their utility. We introduce OmniPart, a novel framework for part-aware 3D object generation designed to achieve high semantic decoupling among components while maintaining robust structural cohesion. OmniPart uniquely decouples this complex task into two synergistic stages: (1) an autoregressive structure planning module generates a controllable, variable-length sequence of 3D part bounding boxes, critically guided by flexible 2D part masks that allow for intuitive control over part decomposition without requiring direct correspondences or semantic labels; and (2) a spatially-conditioned rectified flow model, efficiently adapted from a pre-trained holistic 3D generator, synthesizes all 3D parts simultaneously and consistently within the planned layout. Our approach supports user-defined part granularity, precise localization, and enables diverse downstream applications. Extensive experiments demonstrate that OmniPart achieves state-of-the-art performance, paving the way for more interpretable, editable, and versatile 3D content.
Key facts. Cited by 61 papers in the map (data through 14 Oct 2026). Builds on 61 of its 80 references that are in the map. First posted on arXiv 8 Jul 2025.
Builds on
61 of 80 references.
References · 61
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2023Segment Anythingcited by 8,234
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
- 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,248
- 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,401
- 2022OPT: Open Pre-trained Transformer Language Modelscited by 3,512
- 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,025
- 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,540
- 2020Point Transformercited by 1,470
- 2024Structured 3D Latents for Scalable and Versatile 3D Generationcited by 770
- 2018PointCNN: Convolution On X-Transformed Pointscited by 764
38 more
- 2023Zero123++: a Single Image to Consistent Multi-view Diffusion Base Modelcited by 521
- 20233DShape2VecSet: A 3D Shape Representation for Neural Fields and Generative Diffusion Modelscited by 458
- 2024CLAY: A Controllable Large-scale Generative Model for Creating High-quality 3D Assetscited by 455
- 2022PointNeXt: Revisiting PointNet++ with Improved Training and Scaling Strategiescited by 436
- 2023MeshGPT: Generating Triangle Meshes with Decoder-Only Transformerscited by 259
- 2023Triplane Meets Gaussian Splatting: Fast and Generalizable Single-View 3D Reconstruction with Transformerscited by 258
- 2023Michelangelo: Conditional 3D Shape Generation based on Shape-Image-Text Aligned Latent Representationcited by 228
- 2016Shape Completion using 3D-Encoder-Predictor CNNs and Shape Synthesiscited by 219
- 2024Direct3D: Scalable Image-to-3D Generation via 3D Latent Diffusion Transformercited by 210
- 2023SAM3D: Segment Anything in 3D Scenescited by 157
- 2022Diffusion-SDF: Conditional Generative Modeling of Signed Distance Functionscited by 133
- 2022Neural Wavelet-domain Diffusion for 3D Shape Generationcited by 132
- 2022Diffusion-SDF: Text-to-Shape via Voxelized Diffusioncited by 128
- 2022PartSLIP: Low-Shot Part Segmentation for 3D Point Clouds via Pretrained Image-Language Modelscited by 118
- 2024MIDI: Multi-Instance Diffusion for Single Image to 3D Scene Generationcited by 117
- 2024Transparent Image Layer Diffusion using Latent Transparencycited by 114
- 2024MV-Adapter: Multi-view Consistent Image Generation Made Easycited by 112
- 2024MeshAnything V2: Artist-Created Mesh Generation With Adjacent Mesh Tokenizationcited by 104
- 2024MeshXL: Neural Coordinate Field for Generative 3D Foundation Modelscited by 103
- 2024SAMPart3D: Segment Any Part in 3D Objectscited by 97
- 2024LN3DIFF++: Scalable Latent Neural Fields Diffusion for Speedy 3D Generationcited by 92
- 2024Meshtron: High-Fidelity, Artist-Like 3D Mesh Generation at Scalecited by 89
- 2024EdgeRunner: Auto-regressive Auto-encoder for Artistic Mesh Generationcited by 87
- 2025PartCrafter: Structured 3D Mesh Generation via Compositional Latent Diffusion Transformerscited by 84
- 2024Scaling Mesh Generation via Compressive Tokenizationcited by 73
- 2023EpiDiff: Enhancing Multi-View Synthesis via Localized Epipolar-Constrained Diffusioncited by 72
- 2023SALAD: Part-Level Latent Diffusion for 3D Shape Generation and Manipulationcited by 66
- 2025DeepMesh: Auto-Regressive Artist-mesh Creation with Reinforcement Learningcited by 65
- 2023SATR: Zero-Shot Semantic Segmentation of 3D Shapescited by 62
- 2024PartGen: Part-level 3D Generation and Reconstruction with Multi-View Diffusion Modelscited by 62
- 2025HoloPart: Generative 3D Part Amodal Segmentationcited by 60
- 2024ComboVerse: Compositional 3D Assets Creation Using Spatially-Aware Diffusion Guidancecited by 59
- 2024Part123: Part-aware 3D Reconstruction from a Single-view Imagecited by 55
- 2025Efficient Part-level 3D Object Generation via Dual Volume Packingcited by 48
- 2023COLE: A Hierarchical Generation Framework for Multi-Layered and Editable Graphic Designcited by 43
- 2024Segment Any Meshcited by 37
- 2025ART: Anonymous Region Transformer for Variable Multi-Layer Transparent Image Generationcited by 37
- 2024Tailor3D: Customized 3D Assets Editing and Generation with Dual-Side Imagescited by 35
50 most cited of 61 All 61 (JSON)
Built on by
Citing papers per year: 2025: 19; 2026: 42.
61 papers.
Sort:
By area:
- 2025VoxHammer: Training-Free Precise and Coherent 3D Editing in Native 3D Spacecited by 45
- 2025X-Part: high fidelity and structure coherent shape decompositioncited by 44
- 2025LATTICE: Democratize High-Fidelity 3D Generation at Scalecited by 44
- 2025P3-SAM: Native 3D Part Segmentationcited by 43
- 2025PhysX-Anything: Simulation-Ready Physical 3D Assets from Single Imagecited by 37
- 2025ReconViaGen: Towards Accurate Multi-view 3D Object Reconstruction via Generationcited by 33
- 2025NANO3D: A Training-Free Approach for Efficient 3D Editing Without Maskscited by 31
- 2025UniLat3D: Geometry-Appearance Unified Latents for Single-Stage 3D Generationcited by 20
- 2025FullPart: Generating each 3D Part at Full Resolutioncited by 17
- 2026Pixal3D: Pixel-Aligned 3D Generation from Imagescited by 14
- 2025Hunyuan3D Studio: End-to-End AI Pipeline for Game-Ready 3D Asset Generationcited by 13
- 2026HY3D-Bench: Generation of 3D Assetscited by 11
38 more
- 2026PhysX-Omni: Unified Simulation-Ready Physical 3D Generation for Rigid, Deformable, and Articulated Objectscited by 11
- 2026Feedforward 3D Editing Learns from Semantic-Part Transformationcited by 10
- 2025UniPart: Part-Level 3D Generation with Unified 3D Geom-Seg Latentscited by 9
- 2026PAct: Part-Decomposed Single-View Articulated Object Generationcited by 8
- 2026ArtLLM: Generating Articulated Assets via 3D LLMcited by 8
- 2025Part-X-MLLM: Part-aware 3D Multimodal Large Language Modelcited by 7
- 2025SPARK: Sim-ready Part-level Articulated Reconstruction with VLM Knowledgecited by 7
- 2026GaussianFluent: Gaussian Simulation for Dynamic Scenes with Mixed Materialscited by 7
- 2025M3DLayout: A Multi-Source Dataset of 3D Indoor Layouts and Structured Descriptions for 3D Generationcited by 6
- 2026LATO.2: Factorized 3D Mesh Generation with Vertex and Topology Flowcited by 6
- 2026CubePart: An Open-Vocabulary Part-Controllable 3D Generatorcited by 5
- 2026Points-to-3D: Structure-Aware 3D Generation with Point Cloud Priorscited by 4
- 2025CaliTex: Geometry-Calibrated Attention for View-Coherent 3D Texture Generationcited by 3
- 2025Fast3Dcache: Training-free 3D Geometry Synthesis Accelerationcited by 3
- 2026Interact3D: Compositional 3D Generation of Interactive Objectscited by 3
- 2026Strips as Tokens: Artist Mesh Generation with Native UV Segmentationcited by 3
- 2025CADKnitter: Compositional CAD Generation from Text and Geometry Guidancecited by 2
- 2026DreamPartGen: Semantically Grounded Part-Level 3D Generation via Collaborative Latent Denoisingcited by 2
- 2025MMPart: Harnessing Multi-Modal Large Language Models for Part-Aware 3D Generationcited by 1
- 2026EI-Part: Explode for Completion and Implode for Refinementcited by 1
- 2026SK-Adapter: Skeleton-Based Structural Control for Native 3D Generationcited by 1
- 2026AnySurf: Any Surface Generation with Directed Edgecited by 1
- 2026GASE: Gaussian Splatting-Based Automated System for Reconstructing Embodied-Simulation Environmentscited by 1
- 2026Artic-O: End-to-End Articulated Object Reconstruction via Latent Geometry Learningcited by 1
- 2026UnfoldArt: Zero-Shot Recovery of Full Articulated 3D Objects from Text or Imagecited by 1
- 2026EditVerse3D: High-Quality 3D Object Editing with Region-Aware Learningcited by 1
- 2026ViSculpt: Visual-Centric Agentic Geometry Editingcited by 1
- 2026DiagGen: Agentic Generation of Deformable Assets with Sim-based Diagnostics for Robotic Simulationcited by 1
- 2025XDen-1K: A Density Field Dataset of Real-World Objectscited by 0
- 2026Muses: Designing, Composing, Generating Nonexistent Fantasy 3D Creatures without Trainingcited by 0
- 2026Functionalization via Structure Completion and Motion Rectificationcited by 0
- 2026CompoSE: Compositional Synthesis and Editing of 3D Shapes via Part-Aware Controlcited by 0
- 2026ISAP-3D: Identity-Slot Aligned Part-Aware 3D Generationcited by 0
- 20263D-PLOT-LLM: Part-Level Object Tokens for 3D Large Language Modelscited by 0
- 2026Arbor: Explicit Geometric Conditioning for Controllable 3D Asset Generationcited by 0
- 2026InSpace: Structure-Aware 3D Indoor Scene Generation from a Single 360deg Imagecited by 0
- 2026Hi-TOPS: Hierarchical Topology-aware Scoring Prior for 3D Part Decompositioncited by 0
- 2026PartMat: Material-Aware 3D Part Decomposition with a Single Global Latentcited by 0
50 most cited of 61 All 61 (JSON)
- 2026NOFACE3D: NOise-scheduled Focused Anchoring and Controlled Enhancement for 3D Generation9 Oct 2026
- 2026Point2Part: Unified 3D Partitioning from Point Prompts29 Sep 2026
- 2026Seg3DParts: Segmentation-Grounded Controllable Part-Level 3D Generation29 Sep 2026
- 2026Fysiverse-3D-Vision Technical Report: Generating Executable 3D Worlds from Images through Unified Spatial Reasoning22 Sep 2026
- 2026ProxyBuild: Text-Guided Structured 3D Building Generation with Mesh-Anchored Procedural Proxies20 Sep 2026
- 2026DiagGen: Agentic Generation of Deformable Assets with Sim-based Diagnostics for Robotic Simulation19 Sep 2026
- 2026KaiNinja: Extending Native 3D Generators to the Part Level14 Sep 2026
- 2026SNAP3D: Physically Grounded 3D Parts for Assembly from a Single Image11 Sep 2026
- 2026ViSculpt: Visual-Centric Agentic Geometry Editing25 Aug 2026
- 2026MultiCube: Compositional 3D Generation With Part-Level Semantic and Spatial Control20 Aug 2026
- 2026MegaParts: Scaling Part-Aware 3D Object Generation to 300 Parts via Token-Efficient Autoregressive Modeling14 Aug 2026
- 2026SCULPT: Subtractive Composition for 3D Part Generation13 Aug 2026
38 more
- 2026Hunyuan3D-Buffalo 1.0: A Unified Multimodal Model for Scalable 3D Generation, Understanding, and Editing3 Aug 2026
- 2026PartMat: Material-Aware 3D Part Decomposition with a Single Global Latent3 Aug 2026
- 2026Hi-TOPS: Hierarchical Topology-aware Scoring Prior for 3D Part Decomposition1 Aug 2026
- 2026LATO.2: Factorized 3D Mesh Generation with Vertex and Topology Flow12 Jul 2026
- 2026EditVerse3D: High-Quality 3D Object Editing with Region-Aware Learning8 Jul 2026
- 2026InSpace: Structure-Aware 3D Indoor Scene Generation from a Single 360deg Image4 Jul 2026
- 2026UnfoldArt: Zero-Shot Recovery of Full Articulated 3D Objects from Text or Image29 Jun 2026
- 2026Arbor: Explicit Geometric Conditioning for Controllable 3D Asset Generation22 Jun 2026
- 2026Artic-O: End-to-End Articulated Object Reconstruction via Latent Geometry Learning20 Jun 2026
- 20263D-PLOT-LLM: Part-Level Object Tokens for 3D Large Language Models18 Jun 2026
- 2026GASE: Gaussian Splatting-Based Automated System for Reconstructing Embodied-Simulation Environments16 Jun 2026
- 2026ISAP-3D: Identity-Slot Aligned Part-Aware 3D Generation10 Jun 2026
- 2026CubePart: An Open-Vocabulary Part-Controllable 3D Generator27 May 2026
- 2026Feedforward 3D Editing Learns from Semantic-Part Transformation26 May 2026
- 2026AnySurf: Any Surface Generation with Directed Edge23 May 2026
- 2026PhysX-Omni: Unified Simulation-Ready Physical 3D Generation for Rigid, Deformable, and Articulated Objects20 May 2026
- 2026CompoSE: Compositional Synthesis and Editing of 3D Shapes via Part-Aware Control19 May 2026
- 2026Functionalization via Structure Completion and Motion Rectification18 May 2026
- 2026Pixal3D: Pixel-Aligned 3D Generation from Images11 May 2026
- 2026Strips as Tokens: Artist Mesh Generation with Native UV Segmentation10 Apr 2026
- 2026DreamPartGen: Semantically Grounded Part-Level 3D Generation via Collaborative Latent Denoising19 Mar 2026
- 2026Points-to-3D: Structure-Aware 3D Generation with Point Cloud Priors19 Mar 2026
- 2026Interact3D: Compositional 3D Generation of Interactive Objects17 Mar 2026
- 2026SK-Adapter: Skeleton-Based Structural Control for Native 3D Generation14 Mar 2026
- 2026EI-Part: Explode for Completion and Implode for Refinement14 Mar 2026
- 2026ArtLLM: Generating Articulated Assets via 3D LLM1 Mar 2026
- 2026PAct: Part-Decomposed Single-View Articulated Object Generation16 Feb 2026
- 2026HY3D-Bench: Generation of 3D Assets3 Feb 2026
- 2026GaussianFluent: Gaussian Simulation for Dynamic Scenes with Mixed Materials14 Jan 2026
- 2026Muses: Designing, Composing, Generating Nonexistent Fantasy 3D Creatures without Training6 Jan 2026
- 2025CADKnitter: Compositional CAD Generation from Text and Geometry Guidance12 Dec 2025
- 2025XDen-1K: A Density Field Dataset of Real-World Objects11 Dec 2025
- 2025UniPart: Part-Level 3D Generation with Unified 3D Geom-Seg Latents10 Dec 2025
- 2025SPARK: Sim-ready Part-level Articulated Reconstruction with VLM Knowledge1 Dec 2025
- 2025Fast3Dcache: Training-free 3D Geometry Synthesis Acceleration27 Nov 2025
- 2025CaliTex: Geometry-Calibrated Attention for View-Coherent 3D Texture Generation26 Nov 2025
- 2025LATTICE: Democratize High-Fidelity 3D Generation at Scale24 Nov 2025
- 2025PhysX-Anything: Simulation-Ready Physical 3D Assets from Single Image17 Nov 2025
50 newest of 61 All 61 (JSON)
- 2025UniLat3D: Geometry-Appearance Unified Latents for Single-Stage 3D Generationcited by 20
- 2026LATO.2: Factorized 3D Mesh Generation with Vertex and Topology Flowcited by 6
- 2025Fast3Dcache: Training-free 3D Geometry Synthesis Accelerationcited by 3
- 2026PartMat: Material-Aware 3D Part Decomposition with a Single Global Latentcited by 0
- 2026PartMat: Material-Aware 3D Part Decomposition with a Single Global Latent3 Aug 2026
- 2026LATO.2: Factorized 3D Mesh Generation with Vertex and Topology Flow12 Jul 2026
- 2025Fast3Dcache: Training-free 3D Geometry Synthesis Acceleration27 Nov 2025
- 2025UniLat3D: Geometry-Appearance Unified Latents for Single-Stage 3D Generation29 Sep 2025
- 2025VoxHammer: Training-Free Precise and Coherent 3D Editing in Native 3D Spacecited by 45
- 2025X-Part: high fidelity and structure coherent shape decompositioncited by 44
- 2025LATTICE: Democratize High-Fidelity 3D Generation at Scalecited by 44
- 2025P3-SAM: Native 3D Part Segmentationcited by 43
- 2025PhysX-Anything: Simulation-Ready Physical 3D Assets from Single Imagecited by 37
- 2025ReconViaGen: Towards Accurate Multi-view 3D Object Reconstruction via Generationcited by 33
- 2025NANO3D: A Training-Free Approach for Efficient 3D Editing Without Maskscited by 31
- 2025FullPart: Generating each 3D Part at Full Resolutioncited by 17
- 2026Pixal3D: Pixel-Aligned 3D Generation from Imagescited by 14
- 2025Hunyuan3D Studio: End-to-End AI Pipeline for Game-Ready 3D Asset Generationcited by 13
- 2026HY3D-Bench: Generation of 3D Assetscited by 11
- 2026PhysX-Omni: Unified Simulation-Ready Physical 3D Generation for Rigid, Deformable, and Articulated Objectscited by 11
12 most cited of 51 All 51 (JSON)
- 2026NOFACE3D: NOise-scheduled Focused Anchoring and Controlled Enhancement for 3D Generation9 Oct 2026
- 2026Point2Part: Unified 3D Partitioning from Point Prompts29 Sep 2026
- 2026Seg3DParts: Segmentation-Grounded Controllable Part-Level 3D Generation29 Sep 2026
- 2026ProxyBuild: Text-Guided Structured 3D Building Generation with Mesh-Anchored Procedural Proxies20 Sep 2026
- 2026KaiNinja: Extending Native 3D Generators to the Part Level14 Sep 2026
- 2026SNAP3D: Physically Grounded 3D Parts for Assembly from a Single Image11 Sep 2026
- 2026MultiCube: Compositional 3D Generation With Part-Level Semantic and Spatial Control20 Aug 2026
- 2026MegaParts: Scaling Part-Aware 3D Object Generation to 300 Parts via Token-Efficient Autoregressive Modeling14 Aug 2026
- 2026SCULPT: Subtractive Composition for 3D Part Generation13 Aug 2026
- 2026Hunyuan3D-Buffalo 1.0: A Unified Multimodal Model for Scalable 3D Generation, Understanding, and Editing3 Aug 2026
- 2026Hi-TOPS: Hierarchical Topology-aware Scoring Prior for 3D Part Decomposition1 Aug 2026
- 2026EditVerse3D: High-Quality 3D Object Editing with Region-Aware Learning8 Jul 2026
12 newest of 51 All 51 (JSON)
Similar, not cited
Close in wording, no citation either way
- 2026From Part to Whole: 3D Generative World Model with an Adaptive Structural Hierarchy
- 2025From One to More: Contextual Part Latents for 3D Generation
- 2025Chirpy3D: Part-Aware Multi-View Diffusion for Creative Fine-Grained Object Generation
- 2025HierOctFusion: Multi-scale Octree-based 3D Shape Generation via Part-Whole-Hierarchy Message Passing
- 2026Quartet of Diffusions: Structure-Aware Point Cloud Generation through Part and Symmetry Guidance
- 2025Assembler: Scalable 3D Part Assembly via Anchor Point Diffusion
- 2026PartRAG: Retrieval-Augmented Part-Level 3D Generation and Editing
- 2024MeshArt: Generating Articulated Meshes with Structure-Guided Transformers