mlsanityData to 14 Oct 2026

OmniPart: Part-Aware 3D Generation with Semantic Decoupling and Structural Cohesion

arXiv 2507.06165 ↗First posted 8 Jul 2025cs.CVcited by 61

Not on the map. Why?

Abstract (arXiv)

The creation of 3D assets with explicit, editable part structures is crucial for advancing interactive applications, yet most generative methods produce only monolithic shapes, limiting their utility. We introduce OmniPart, a novel framework for part-aware 3D object generation designed to achieve high semantic decoupling among components while maintaining robust structural cohesion. OmniPart uniquely decouples this complex task into two synergistic stages: (1) an autoregressive structure planning module generates a controllable, variable-length sequence of 3D part bounding boxes, critically guided by flexible 2D part masks that allow for intuitive control over part decomposition without requiring direct correspondences or semantic labels; and (2) a spatially-conditioned rectified flow model, efficiently adapted from a pre-trained holistic 3D generator, synthesizes all 3D parts simultaneously and consistently within the planned layout. Our approach supports user-defined part granularity, precise localization, and enables diverse downstream applications. Extensive experiments demonstrate that OmniPart achieves state-of-the-art performance, paving the way for more interpretable, editable, and versatile 3D content.

Key facts. Cited by 61 papers in the map (data through 14 Oct 2026). Builds on 61 of its 80 references that are in the map. First posted on arXiv 8 Jul 2025.

Builds on

61 of 80 references.

References · 61

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2023Segment Anythingcited by 8,234
  3. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
  4. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
  5. 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,248
  6. 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,401
  7. 2022OPT: Open Pre-trained Transformer Language Modelscited by 3,512
  8. 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,025
  9. 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,540
  10. 2020Point Transformercited by 1,470
  11. 2024Structured 3D Latents for Scalable and Versatile 3D Generationcited by 770
  12. 2018PointCNN: Convolution On X-Transformed Pointscited by 764
38 more
  1. 2023Zero123++: a Single Image to Consistent Multi-view Diffusion Base Modelcited by 521
  2. 20233DShape2VecSet: A 3D Shape Representation for Neural Fields and Generative Diffusion Modelscited by 458
  3. 2024CLAY: A Controllable Large-scale Generative Model for Creating High-quality 3D Assetscited by 455
  4. 2022PointNeXt: Revisiting PointNet++ with Improved Training and Scaling Strategiescited by 436
  5. 2023MeshGPT: Generating Triangle Meshes with Decoder-Only Transformerscited by 259
  6. 2023Triplane Meets Gaussian Splatting: Fast and Generalizable Single-View 3D Reconstruction with Transformerscited by 258
  7. 2023Michelangelo: Conditional 3D Shape Generation based on Shape-Image-Text Aligned Latent Representationcited by 228
  8. 2016Shape Completion using 3D-Encoder-Predictor CNNs and Shape Synthesiscited by 219
  9. 2024Direct3D: Scalable Image-to-3D Generation via 3D Latent Diffusion Transformercited by 210
  10. 2023SAM3D: Segment Anything in 3D Scenescited by 157
  11. 2022Diffusion-SDF: Conditional Generative Modeling of Signed Distance Functionscited by 133
  12. 2022Neural Wavelet-domain Diffusion for 3D Shape Generationcited by 132
  13. 2022Diffusion-SDF: Text-to-Shape via Voxelized Diffusioncited by 128
  14. 2022PartSLIP: Low-Shot Part Segmentation for 3D Point Clouds via Pretrained Image-Language Modelscited by 118
  15. 2024MIDI: Multi-Instance Diffusion for Single Image to 3D Scene Generationcited by 117
  16. 2024Transparent Image Layer Diffusion using Latent Transparencycited by 114
  17. 2024MV-Adapter: Multi-view Consistent Image Generation Made Easycited by 112
  18. 2024MeshAnything V2: Artist-Created Mesh Generation With Adjacent Mesh Tokenizationcited by 104
  19. 2024MeshXL: Neural Coordinate Field for Generative 3D Foundation Modelscited by 103
  20. 2024SAMPart3D: Segment Any Part in 3D Objectscited by 97
  21. 2024LN3DIFF++: Scalable Latent Neural Fields Diffusion for Speedy 3D Generationcited by 92
  22. 2024Meshtron: High-Fidelity, Artist-Like 3D Mesh Generation at Scalecited by 89
  23. 2024EdgeRunner: Auto-regressive Auto-encoder for Artistic Mesh Generationcited by 87
  24. 2025PartCrafter: Structured 3D Mesh Generation via Compositional Latent Diffusion Transformerscited by 84
  25. 2024Scaling Mesh Generation via Compressive Tokenizationcited by 73
  26. 2023EpiDiff: Enhancing Multi-View Synthesis via Localized Epipolar-Constrained Diffusioncited by 72
  27. 2023SALAD: Part-Level Latent Diffusion for 3D Shape Generation and Manipulationcited by 66
  28. 2025DeepMesh: Auto-Regressive Artist-mesh Creation with Reinforcement Learningcited by 65
  29. 2023SATR: Zero-Shot Semantic Segmentation of 3D Shapescited by 62
  30. 2024PartGen: Part-level 3D Generation and Reconstruction with Multi-View Diffusion Modelscited by 62
  31. 2025HoloPart: Generative 3D Part Amodal Segmentationcited by 60
  32. 2024ComboVerse: Compositional 3D Assets Creation Using Spatially-Aware Diffusion Guidancecited by 59
  33. 2024Part123: Part-aware 3D Reconstruction from a Single-view Imagecited by 55
  34. 2025Efficient Part-level 3D Object Generation via Dual Volume Packingcited by 48
  35. 2023COLE: A Hierarchical Generation Framework for Multi-Layered and Editable Graphic Designcited by 43
  36. 2024Segment Any Meshcited by 37
  37. 2025ART: Anonymous Region Transformer for Variable Multi-Layer Transparent Image Generationcited by 37
  38. 2024Tailor3D: Customized 3D Assets Editing and Generation with Dual-Side Imagescited by 35

50 most cited of 61 All 61 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 19; 2026: 42.

61 papers.

Sort:

By area:

  1. 2025VoxHammer: Training-Free Precise and Coherent 3D Editing in Native 3D Spacecited by 45
  2. 2025X-Part: high fidelity and structure coherent shape decompositioncited by 44
  3. 2025LATTICE: Democratize High-Fidelity 3D Generation at Scalecited by 44
  4. 2025P3-SAM: Native 3D Part Segmentationcited by 43
  5. 2025PhysX-Anything: Simulation-Ready Physical 3D Assets from Single Imagecited by 37
  6. 2025ReconViaGen: Towards Accurate Multi-view 3D Object Reconstruction via Generationcited by 33
  7. 2025NANO3D: A Training-Free Approach for Efficient 3D Editing Without Maskscited by 31
  8. 2025UniLat3D: Geometry-Appearance Unified Latents for Single-Stage 3D Generationcited by 20
  9. 2025FullPart: Generating each 3D Part at Full Resolutioncited by 17
  10. 2026Pixal3D: Pixel-Aligned 3D Generation from Imagescited by 14
  11. 2025Hunyuan3D Studio: End-to-End AI Pipeline for Game-Ready 3D Asset Generationcited by 13
  12. 2026HY3D-Bench: Generation of 3D Assetscited by 11
38 more
  1. 2026PhysX-Omni: Unified Simulation-Ready Physical 3D Generation for Rigid, Deformable, and Articulated Objectscited by 11
  2. 2026Feedforward 3D Editing Learns from Semantic-Part Transformationcited by 10
  3. 2025UniPart: Part-Level 3D Generation with Unified 3D Geom-Seg Latentscited by 9
  4. 2026PAct: Part-Decomposed Single-View Articulated Object Generationcited by 8
  5. 2026ArtLLM: Generating Articulated Assets via 3D LLMcited by 8
  6. 2025Part-X-MLLM: Part-aware 3D Multimodal Large Language Modelcited by 7
  7. 2025SPARK: Sim-ready Part-level Articulated Reconstruction with VLM Knowledgecited by 7
  8. 2026GaussianFluent: Gaussian Simulation for Dynamic Scenes with Mixed Materialscited by 7
  9. 2025M3DLayout: A Multi-Source Dataset of 3D Indoor Layouts and Structured Descriptions for 3D Generationcited by 6
  10. 2026LATO.2: Factorized 3D Mesh Generation with Vertex and Topology Flowcited by 6
  11. 2026CubePart: An Open-Vocabulary Part-Controllable 3D Generatorcited by 5
  12. 2026Points-to-3D: Structure-Aware 3D Generation with Point Cloud Priorscited by 4
  13. 2025CaliTex: Geometry-Calibrated Attention for View-Coherent 3D Texture Generationcited by 3
  14. 2025Fast3Dcache: Training-free 3D Geometry Synthesis Accelerationcited by 3
  15. 2026Interact3D: Compositional 3D Generation of Interactive Objectscited by 3
  16. 2026Strips as Tokens: Artist Mesh Generation with Native UV Segmentationcited by 3
  17. 2025CADKnitter: Compositional CAD Generation from Text and Geometry Guidancecited by 2
  18. 2026DreamPartGen: Semantically Grounded Part-Level 3D Generation via Collaborative Latent Denoisingcited by 2
  19. 2025MMPart: Harnessing Multi-Modal Large Language Models for Part-Aware 3D Generationcited by 1
  20. 2026EI-Part: Explode for Completion and Implode for Refinementcited by 1
  21. 2026SK-Adapter: Skeleton-Based Structural Control for Native 3D Generationcited by 1
  22. 2026AnySurf: Any Surface Generation with Directed Edgecited by 1
  23. 2026GASE: Gaussian Splatting-Based Automated System for Reconstructing Embodied-Simulation Environmentscited by 1
  24. 2026Artic-O: End-to-End Articulated Object Reconstruction via Latent Geometry Learningcited by 1
  25. 2026UnfoldArt: Zero-Shot Recovery of Full Articulated 3D Objects from Text or Imagecited by 1
  26. 2026EditVerse3D: High-Quality 3D Object Editing with Region-Aware Learningcited by 1
  27. 2026ViSculpt: Visual-Centric Agentic Geometry Editingcited by 1
  28. 2026DiagGen: Agentic Generation of Deformable Assets with Sim-based Diagnostics for Robotic Simulationcited by 1
  29. 2025XDen-1K: A Density Field Dataset of Real-World Objectscited by 0
  30. 2026Muses: Designing, Composing, Generating Nonexistent Fantasy 3D Creatures without Trainingcited by 0
  31. 2026Functionalization via Structure Completion and Motion Rectificationcited by 0
  32. 2026CompoSE: Compositional Synthesis and Editing of 3D Shapes via Part-Aware Controlcited by 0
  33. 2026ISAP-3D: Identity-Slot Aligned Part-Aware 3D Generationcited by 0
  34. 20263D-PLOT-LLM: Part-Level Object Tokens for 3D Large Language Modelscited by 0
  35. 2026Arbor: Explicit Geometric Conditioning for Controllable 3D Asset Generationcited by 0
  36. 2026InSpace: Structure-Aware 3D Indoor Scene Generation from a Single 360deg Imagecited by 0
  37. 2026Hi-TOPS: Hierarchical Topology-aware Scoring Prior for 3D Part Decompositioncited by 0
  38. 2026PartMat: Material-Aware 3D Part Decomposition with a Single Global Latentcited by 0

50 most cited of 61 All 61 (JSON)

Similar, not cited

Close in wording, no citation either way

  1. 2026From Part to Whole: 3D Generative World Model with an Adaptive Structural Hierarchy
  2. 2025From One to More: Contextual Part Latents for 3D Generation
  3. 2025Chirpy3D: Part-Aware Multi-View Diffusion for Creative Fine-Grained Object Generation
  4. 2025HierOctFusion: Multi-scale Octree-based 3D Shape Generation via Part-Whole-Hierarchy Message Passing
  5. 2026Quartet of Diffusions: Structure-Aware Point Cloud Generation through Part and Symmetry Guidance
  6. 2025Assembler: Scalable 3D Part Assembly via Anchor Point Diffusion
  7. 2026PartRAG: Retrieval-Augmented Part-Level 3D Generation and Editing
  8. 2024MeshArt: Generating Articulated Meshes with Structure-Guided Transformers