PartNet: A Large-scale Benchmark for Fine-grained and Hierarchical Part-level 3D Object Understanding
Not on the map. Why?
Cited by 25 in Diffusion models, but placed by its own abstract, which didn’t fit.
Abstract (arXiv)
We present PartNet: a consistent, large-scale dataset of 3D objects annotated with fine-grained, instance-level, and hierarchical 3D part information. Our dataset consists of 573,585 part instances over 26,671 3D models covering 24 object categories. This dataset enables and serves as a catalyst for many tasks such as shape analysis, dynamic 3D scene modeling and simulation, affordance analysis, and others. Using our dataset, we establish three benchmarking tasks for evaluating 3D part recognition: fine-grained semantic segmentation, hierarchical semantic segmentation, and instance segmentation. We benchmark four state-of-the-art 3D deep learning algorithms for fine-grained semantic segmentation and three baseline methods for hierarchical semantic segmentation. We also propose a novel method for part instance segmentation and demonstrate its superior performance over existing methods.
Key facts. Cited by 521 papers in the map (data through 7 Oct 2026). First posted on arXiv 6 Dec 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 71; 2022: 76; 2023: 90; 2024: 107; 2025: 91; 2026: 86.
521 papers.
Sort:
By area:
- 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,522
- 2022OpenScene: 3D Scene Understanding with Open Vocabulariescited by 556
- 20213D Shape Generation and Completion through Point-Voxel Diffusioncited by 516
- 2025RoboTwin 2.0: A Scalable Data Generator and Benchmark with Strong Domain Randomization for Robust Bimanual Robotic Manipulationcited by 477
- 2021ARKitScenes: A Diverse Real-World Dataset For 3D Indoor Scene Understanding Using Mobile RGB-D Datacited by 442
- 2022ProcTHOR: Large-Scale Embodied AI Using Procedural Generationcited by 369
- 2022HOI4D: A 4D Egocentric Dataset for Category-Level Human-Object Interactioncited by 321
- 2023PointOdyssey: A Large-Scale Synthetic Dataset for Long-Term Point Trackingcited by 274
- 2021A Survey of Embodied AI: From Simulators to Research Taskscited by 256
- 2023Orbit: A Unified Simulation Framework for Interactive Robot Learning Environmentscited by 239
- 2024ManiSkill3: GPU Parallelized Robotics Simulation and Rendering for Generalizable Embodied AIcited by 216
- 2021Concealed Object Detectioncited by 212
38 more
- 2023Scalable 3D Captioning with Pretrained Modelscited by 201
- 2022SoftGroup for 3D Instance Segmentation on Point Cloudscited by 197
- 2021ManiSkill: Generalizable Manipulation Skill Benchmark with Large-Scale Demonstrationscited by 193
- 2021Where2Act: From Pixels to Actions for Articulated 3D Objectscited by 179
- 2023ManipLLM: Embodied Multimodal Large Language Model for Object-Centric Robotic Manipulationcited by 157
- 2022Ditto: Building Digital Twins of Articulated Objects from Interactioncited by 152
- 2022GAPartNet: Cross-Category Domain-Generalizable Object Perception and Manipulation via Generalizable and Actionable Partscited by 135
- 2023Weakly Supervised 3D Open-vocabulary Segmentationcited by 133
- 2024ShapeLLM: Universal 3D Object Understanding for Embodied Interactioncited by 133
- 2024SceneVerse: Scaling 3D Vision-Language Learning for Grounded Scene Understandingcited by 130
- 2021Hierarchical Aggregation for 3D Instance Segmentationcited by 126
- 2021Capturing, Reconstructing, and Simulating: the UrbanScene3D Datasetcited by 117
- 2022PartSLIP: Low-Shot Part Segmentation for 3D Point Clouds via Pretrained Image-Language Modelscited by 117
- 2023PointGPT: Auto-regressively Generative Pre-training from Point Cloudscited by 115
- 2023PARIS: Part-level Reconstruction and Motion Analysis for Articulated Objectscited by 115
- 2024GARField: Group Anything with Radiance Fieldscited by 108
- 2021PartImageNet: A Large, High-Quality Dataset of Partscited by 107
- 2022ShapeFormer: Transformer-based Shape Completion via Sparse Representationcited by 106
- 2024URDFormer: A Pipeline for Constructing Articulated Simulation Environments from Real-World Imagescited by 106
- 2021Deep Generative Models in Engineering Design: A Reviewcited by 103
- 2024RoboMamba: Efficient Vision-Language-Action Model for Robotic Reasoning and Manipulationcited by 102
- 20213D AffordanceNet: A Benchmark for Visual Object Affordance Understandingcited by 100
- 2021A Conditional Point Diffusion-Refinement Paradigm for 3D Point Cloud Completioncited by 100
- 2024SAMPart3D: Segment Any Part in 3D Objectscited by 95
- 2022FlowBot3D: Learning 3D Articulation Flow to Manipulate Articulated Objectscited by 91
- 2023Unified Human-Scene Interaction via Prompted Chain-of-Contactscited by 91
- 2025PARTFIELD: Learning 3D Feature Fields for Part Segmentation and Beyondcited by 91
- 2024Articulate-Anything: Automatic Modeling of Articulated Objects via a Vision-Language Foundation Modelcited by 90
- 2023OpenIns3D: Snap and Lookup for 3D Open-vocabulary Instance Segmentationcited by 82
- 2022AKB-48: A Real-World Articulated Object Knowledge Basecited by 81
- 2024General Flow as Foundation Affordance for Scalable Robot Learningcited by 80
- 2021VAT-Mart: Learning Visual Action Trajectory Proposals for Manipulating 3D ARTiculated Objectscited by 78
- 2025PartCrafter: Structured 3D Mesh Generation via Compositional Latent Diffusion Transformerscited by 78
- 2021JoinABLe: Learning Bottom-up Assembly of Parametric CAD Jointscited by 77
- 2022Full-Body Articulated Human-Object Interactioncited by 76
- 2023OmniSeg3D: Omniversal 3D Segmentation via Hierarchical Contrastive Learningcited by 75
- 2021Unsupervised 3D Shape Completion through GAN Inversioncited by 70
- 2023SALAD: Part-Level Latent Diffusion for 3D Shape Generation and Manipulationcited by 66
50 most cited of 521 All 521 (JSON)
- 2026AssemblyWorld: Rethinking 3D Assembly with General-Purpose Agents30 Sep 2026
- 2026Point2Part: Unified 3D Partitioning from Point Prompts29 Sep 2026
- 2026Seg3DParts: Segmentation-Grounded Controllable Part-Level 3D Generation29 Sep 2026
- 2026Scaling Versatile 3D Assets Editing with a Million-Scale Dataset28 Sep 2026
- 2026ArticulateArena: A Metric for Articulated Kinematics27 Sep 2026
- 2026Geometric and Semantic Coupling for Interaction Understanding in 3D Scenes21 Sep 2026
- 2026Workspace Models: Lightweight Robotic Memory via Saliency-Driven Supervision17 Sep 2026
- 2026FAMOS: Feed-Forward 3D Articulation Modeling from Sparse Observations17 Sep 2026
- 2026DepthBenchCAD: When Does Deeper Auditing Yield More Reliable Conclusions?14 Sep 2026
- 2026SNAP3D: Physically Grounded 3D Parts for Assembly from a Single Image11 Sep 2026
- 2026UniPart: Towards Zero-shot Language-Grounded 3D Part Segmentation for Embodied Interaction11 Sep 2026
- 2026Gen2Physics: Grounding Generated 3D Meshes in Physics via Multi-View Material Decomposition24 Aug 2026
38 more
- 2026PVRA: A Pointwise Key-point Voting Framework for Robotic Assembly20 Aug 2026
- 2026Beyond Placement and Articulation: Usage-Driven Code Scenes for Embodied Interaction19 Aug 2026
- 2026Beyond Similarity Matching: Structured Reasoning for Open-Vocabulary Referring Segmentation in 3DGS17 Aug 2026
- 2026Owner3D: Ownership-Guided Style Writing for Training-Free Localized 3D Stylization14 Aug 2026
- 2026SCULPT: Subtractive Composition for 3D Part Generation13 Aug 2026
- 2026OmniMech: All-in-one Multimodal Mechanical Benchmark for 3D Reconstruction6 Aug 2026
- 2026Hunyuan3D-Buffalo 1.0: A Unified Multimodal Model for Scalable 3D Generation, Understanding, and Editing3 Aug 2026
- 2026PartMat: Material-Aware 3D Part Decomposition with a Single Global Latent3 Aug 2026
- 2026Articulated Object Reconstruction from Rest-State Observation30 Jul 2026
- 2026Nova3D: Code-Native Generation of Programmable 3D Assets22 Jul 2026
- 2026UniPhysGen: Unified Physical Grounding for Simulation-Ready 3D Assets15 Jul 2026
- 2026Prompting Image Generators for Training-free Primitive Shape Abstraction6 Jul 2026
- 2026PWM-ArtGen: Part World Model for Articulated Object Generation2 Jul 2026
- 2026UnfoldArt: Zero-Shot Recovery of Full Articulated 3D Objects from Text or Image29 Jun 2026
- 2026OP3DSG: Open-Vocabulary Part-Aware 3D Scene Graph Generation for Real-World Environments29 Jun 2026
- 2026Deep Learning Approaches for 3D Medical Scene Completion: From Geometric Modeling to Generative Paradigms23 Jun 2026
- 2026Boundary-by-Mask: Few-Shot Instance Segmentation with Mask-Conditioned Boundary Learning for Texture-Poor Industrial Parts19 Jun 2026
- 20263D-PLOT-LLM: Part-Level Object Tokens for 3D Large Language Models18 Jun 2026
- 2026Instruct-Particulate: Scaling Feed-Forward 3D Object Articulation with Kinematic Control12 Jun 2026
- 20263D-CBM: A Framework for Concept-Based Interpretability in Generative 3D Modeling9 Jun 2026
- 2026Revisiting Articulated Parts Perception in Robot Manipulation6 Jun 2026
- 2026PAR3D: A Unified 3D-MLLM with Part-Aware Representation for Scene Understanding4 Jun 2026
- 2026GSAM: A Generalizable and Safe Robotic Framework for Articulated Object Manipulation29 May 2026
- 2026S2MDF: A Plug-And-Play Layer for Intersection-Free Multi-Object Signed Distance Fields28 May 2026
- 2026Embodied3DBench: Benchmarking Low-Level Embodied Spatial Intelligence of Vision Language Models27 May 2026
- 2026Category-Level 3D Correspondence in Camera Space via Morphable Object Priors27 May 2026
- 2026Artiverse: A Diverse and Physically Grounded Dataset for Articulated Objects23 May 2026
- 2026ArtSplat: Feed-Forward Articulated 3D Gaussian Splatting from Sparse Multi-State Uncalibrated Views23 May 2026
- 2026SceneCode: Executable World Programs for Editable Indoor Scenes with Articulated Objects19 May 2026
- 2026Trust It or Not: Evidential Uncertainty for Feed-Forward 3D Reconstruction with Trust3R19 May 2026
- 2026Articulation in Prime: Primitive-Based Articulated Object Understanding from a Single Casual Video18 May 2026
- 2026Best Segmentation Buddies for Image-Shape Correspondence18 May 2026
- 2026Articraft: An Agentic System for Scalable Articulated 3D Asset Generation14 May 2026
- 2026AssemblyBench: Physics-Aware Assembly of Complex Industrial Objects13 May 2026
- 2026Beyond Spatial Compression: Interface-Centric Generative States for Open-World 3D Structure11 May 2026
- 2026PhysForge: Generating Physics-Grounded 3D Assets for Interactive Virtual World6 May 2026
- 2026CADFS: A Big CAD Program Dataset and Framework for Computer-Aided Design with Large Language Models3 May 2026
- 2026VoxAfford: Multi-Scale Voxel-Token Fusion for Open-Vocabulary 3D Affordance Detection2 May 2026
50 newest of 521 All 521 (JSON)
- 2021A Conditional Point Diffusion-Refinement Paradigm for 3D Point Cloud Completioncited by 100
- 2025PartCrafter: Structured 3D Mesh Generation via Compositional Latent Diffusion Transformerscited by 78
- 2023SALAD: Part-Level Latent Diffusion for 3D Shape Generation and Manipulationcited by 66
- 2024Beyond the Contact: Discovering Comprehensive Affordance for 3D Objects from Pre-trained 2D Diffusion Modelscited by 32
- 2024DiffAssemble: A Unified Graph-Diffusion Model for 2D and 3D Reassemblycited by 31
- 2025From One to More: Contextual Part Latents for 3D Generationcited by 26
- 2023DiMSam: Diffusion Models as Samplers for Task and Motion Planning under Partial Observabilitycited by 21
- 2024Composable Part-Based Manipulationcited by 17
- 2025DemoDiffusion: One-Shot Human Imitation using pre-trained Diffusion Policycited by 16
- 2024Diffusion Models in 3D Vision: A Surveycited by 11
- 2023C3DM: Constrained-Context Conditional Diffusion Models for Imitation Learningcited by 7
- 2024Efficient and Scalable Point Cloud Generation with Sparse Point-Voxel Diffusion Modelscited by 7
12 most cited of 25 All 25 (JSON)
- 2026PartMat: Material-Aware 3D Part Decomposition with a Single Global Latent3 Aug 2026
- 2026DMAligner: Enhancing Image Alignment via Diffusion Model Based View Synthesis26 Feb 2026
- 2026BoxSplitGen: A Generative Model for 3D Part Bounding Boxes in Varying Granularity24 Feb 2026
- 2025ArticFlow: Generative Simulation of Articulated Mechanisms22 Nov 2025
- 2025ASIA: Adaptive 3D Segmentation using Few Image Annotations29 Sep 2025
- 2025StrucADT: Generating Structure-controlled 3D Point Clouds with Adjacency Diffusion Transformer28 Sep 2025
- 2025Guiding Diffusion-Based Articulated Object Generation by Partial Point Cloud Alignment and Physical Plausibility Constraints1 Aug 2025
- 2025From One to More: Contextual Part Latents for 3D Generation11 Jul 2025
- 2025DemoDiffusion: One-Shot Human Imitation using pre-trained Diffusion Policy25 Jun 2025
- 2025PartCrafter: Structured 3D Mesh Generation via Compositional Latent Diffusion Transformers5 Jun 2025
- 2025Generative Data Augmentation for Object Point Cloud Segmentation23 May 2025
- 2025Leveraging Pretrained Diffusion Models for Zero-Shot Part Assembly1 May 2025
12 newest of 25 All 25 (JSON)
- 2024ShapeLLM: Universal 3D Object Understanding for Embodied Interactioncited by 133
- 2024Articulate-Anything: Automatic Modeling of Articulated Objects via a Vision-Language Foundation Modelcited by 90
- 2024A3VLM: Actionable Articulation-Aware Vision Language Modelcited by 33
- 2023PartDistill: 3D Shape Part Segmentation by Vision-Language Model Distillationcited by 27
- 2024A Self-Correcting Vision-Language-Action Model for Fast and Slow System Manipulationcited by 20
- 2024PhyGrasp: Generalizing Robotic Grasping with Physics-informed Large Multimodal Modelscited by 11
- 2023CLIPXPlore: Coupled CLIP and Shape Spaces for 3D Shape Explorationcited by 9
- 2024Kestrel: 3D Multimodal LLM for Part-Aware Grounded Descriptioncited by 9
- 2026CADFS: A Big CAD Program Dataset and Framework for Computer-Aided Design with Large Language Modelscited by 4
- 2026Embodied3DBench: Benchmarking Low-Level Embodied Spatial Intelligence of Vision Language Modelscited by 3
- 2025Towards Fast, Memory-based and Data-Efficient Vision-Language Policycited by 2
- 2026Instruct-Particulate: Scaling Feed-Forward 3D Object Articulation with Kinematic Controlcited by 2
12 most cited of 17 All 17 (JSON)
- 2026OmniMech: All-in-one Multimodal Mechanical Benchmark for 3D Reconstruction6 Aug 2026
- 20263D-PLOT-LLM: Part-Level Object Tokens for 3D Large Language Models18 Jun 2026
- 2026Instruct-Particulate: Scaling Feed-Forward 3D Object Articulation with Kinematic Control12 Jun 2026
- 2026PAR3D: A Unified 3D-MLLM with Part-Aware Representation for Scene Understanding4 Jun 2026
- 2026Embodied3DBench: Benchmarking Low-Level Embodied Spatial Intelligence of Vision Language Models27 May 2026
- 2026CADFS: A Big CAD Program Dataset and Framework for Computer-Aided Design with Large Language Models3 May 2026
- 20263D-Agent:Tri-Modal Multi-Agent Collaboration for Scalable 3D Object Annotation7 Jan 2026
- 20253DFroMLLM: 3D Prototype Generation only from Pretrained Multimodal LLMs12 Aug 2025
- 2025Towards Fast, Memory-based and Data-Efficient Vision-Language Policy13 Mar 2025
- 2024Articulate-Anything: Automatic Modeling of Articulated Objects via a Vision-Language Foundation Model3 Oct 2024
- 2024A3VLM: Actionable Articulation-Aware Vision Language Model11 Jun 2024
- 2024Kestrel: 3D Multimodal LLM for Part-Aware Grounded Description29 May 2024
12 newest of 17 All 17 (JSON)
- 2023ManipLLM: Embodied Multimodal Large Language Model for Object-Centric Robotic Manipulationcited by 157
- 2025MMR: A Large-scale Benchmark Dataset for Multi-target and Multi-granularity Reasoning Segmentationcited by 28
- 2024AIC MLLM: Autonomous Interactive Correction MLLM for Robust Robotic Manipulationcited by 20
- 2022What do Toothbrushes do in the Kitchen? How Transformers Think our World is Structuredcited by 5
- 2026DeepVision-103K: A Visually Diverse, Broad-Coverage, and Verifiable Mathematical Dataset for Multimodal Reasoningcited by 5
- 2023Analogy-Forming Transformers for Few-Shot 3D Parsingcited by 1
- 2026DeepVision-103K: A Visually Diverse, Broad-Coverage, and Verifiable Mathematical Dataset for Multimodal Reasoning18 Feb 2026
- 2025MMR: A Large-scale Benchmark Dataset for Multi-target and Multi-granularity Reasoning Segmentation18 Mar 2025
- 2024AIC MLLM: Autonomous Interactive Correction MLLM for Robust Robotic Manipulation17 Jun 2024
- 2023ManipLLM: Embodied Multimodal Large Language Model for Object-Centric Robotic Manipulation24 Dec 2023
- 2023Analogy-Forming Transformers for Few-Shot 3D Parsing27 Apr 2023
- 2022What do Toothbrushes do in the Kitchen? How Transformers Think our World is Structured12 Apr 2022
- 20253D and 4D World Modeling: A Surveycited by 64
- 2025URDF-Anything: Constructing Articulated Objects with 3D Multimodal Language Modelcited by 20
- 2025Cognitive Science-Inspired Evaluation of Core Capabilities for Object Understanding in AIcited by 1
- 2026DailyArt: Discovering Articulation from Single Static Images via Latent Dynamicscited by 0
- 2026PWM-ArtGen: Part World Model for Articulated Object Generationcited by 0
- 2026PWM-ArtGen: Part World Model for Articulated Object Generation2 Jul 2026
- 2026DailyArt: Discovering Articulation from Single Static Images via Latent Dynamics9 Apr 2026
- 2025URDF-Anything: Constructing Articulated Objects with 3D Multimodal Language Model2 Nov 2025
- 20253D and 4D World Modeling: A Survey4 Sep 2025
- 2025Cognitive Science-Inspired Evaluation of Core Capabilities for Object Understanding in AI27 Mar 2025
- 2024RoboMamba: Efficient Vision-Language-Action Model for Robotic Reasoning and Manipulationcited by 102
- 2026Beyond Short-Horizon: VQ-Memory for Robust Long-Horizon Manipulation in Non-Markovian Simulation Benchmarkscited by 5
- 2025Boosting Robotic Manipulation Generalization with Minimal Costly Datacited by 1
- 2026Beyond Short-Horizon: VQ-Memory for Robust Long-Horizon Manipulation in Non-Markovian Simulation Benchmarks10 Mar 2026
- 2025Boosting Robotic Manipulation Generalization with Minimal Costly Data25 Mar 2025
- 2024RoboMamba: Efficient Vision-Language-Action Model for Robotic Reasoning and Manipulation6 Jun 2024
- 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,522
- 2022OpenScene: 3D Scene Understanding with Open Vocabulariescited by 556
- 20213D Shape Generation and Completion through Point-Voxel Diffusioncited by 516
- 2025RoboTwin 2.0: A Scalable Data Generator and Benchmark with Strong Domain Randomization for Robust Bimanual Robotic Manipulationcited by 477
- 2021ARKitScenes: A Diverse Real-World Dataset For 3D Indoor Scene Understanding Using Mobile RGB-D Datacited by 442
- 2022ProcTHOR: Large-Scale Embodied AI Using Procedural Generationcited by 369
- 2022HOI4D: A 4D Egocentric Dataset for Category-Level Human-Object Interactioncited by 321
- 2023PointOdyssey: A Large-Scale Synthetic Dataset for Long-Term Point Trackingcited by 274
- 2021A Survey of Embodied AI: From Simulators to Research Taskscited by 256
- 2023Orbit: A Unified Simulation Framework for Interactive Robot Learning Environmentscited by 239
- 2024ManiSkill3: GPU Parallelized Robotics Simulation and Rendering for Generalizable Embodied AIcited by 216
- 2021Concealed Object Detectioncited by 212
12 most cited of 461 All 461 (JSON)
- 2026AssemblyWorld: Rethinking 3D Assembly with General-Purpose Agents30 Sep 2026
- 2026Point2Part: Unified 3D Partitioning from Point Prompts29 Sep 2026
- 2026Seg3DParts: Segmentation-Grounded Controllable Part-Level 3D Generation29 Sep 2026
- 2026Scaling Versatile 3D Assets Editing with a Million-Scale Dataset28 Sep 2026
- 2026ArticulateArena: A Metric for Articulated Kinematics27 Sep 2026
- 2026Geometric and Semantic Coupling for Interaction Understanding in 3D Scenes21 Sep 2026
- 2026Workspace Models: Lightweight Robotic Memory via Saliency-Driven Supervision17 Sep 2026
- 2026FAMOS: Feed-Forward 3D Articulation Modeling from Sparse Observations17 Sep 2026
- 2026DepthBenchCAD: When Does Deeper Auditing Yield More Reliable Conclusions?14 Sep 2026
- 2026SNAP3D: Physically Grounded 3D Parts for Assembly from a Single Image11 Sep 2026
- 2026UniPart: Towards Zero-shot Language-Grounded 3D Part Segmentation for Embodied Interaction11 Sep 2026
- 2026Gen2Physics: Grounding Generated 3D Meshes in Physics via Multi-View Material Decomposition24 Aug 2026
12 newest of 461 All 461 (JSON)