PartLLM: A Unified Multimodal Foundation for 3D Part Segmentation
Not on the map. Why?
Abstract (arXiv)
Part segmentation is a fundamental problem in computer graphics and 3D vision. Recent works have expanded 3D part segmentation beyond fixed taxonomies, but existing approaches typically only address a specific setting, such as text-guided part segmentation or point-based interaction. In this work, we argue that these settings can be unified as an intent-conditioned generative problem, where different prompts specify the desired part decomposition. To this end, we introduce PartLLM, a unified multimodal model that formulates 3D part segmentation as autoregressive semantic decomposition. Conditioned on an input shape and a user prompt, PartLLM autoregressively generates semantic part hypotheses as queries for mask prediction and feeds them to a decomposition-aware decoder that jointly predicts coherent part masks. This unified design supports text-guided part segmentation, interactive segmentation, and full-shape semantic decomposition with controllable granularity within a single model. Extensive experiments across these task settings show that PartLLM consistently outperforms task-specific baselines, demonstrating the effectiveness of unifying 3D part segmentation under an intent-conditioned generative formulation.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 29 of its 49 references that are in the map. First posted on arXiv 22 Sep 2026.
Builds on
29 of 49 references.
References · 29
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2023Segment Anythingcited by 8,234
- 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,401
- 2025Qwen3-VL Technical Reportcited by 2,793
- 2023Qwen-VL: A Versatile Vision-Language Model for Understanding, Localization, Text Reading, and Beyondcited by 2,224
- 2018Dynamic Graph CNN for Learning on Point Cloudscited by 2,223
- 2020Point Transformercited by 1,470
- 2023Kosmos-2: Grounding Multimodal Large Language Models to the Worldcited by 1,089
- 2023Shikra: Unleashing Multimodal LLM's Referential Dialogue Magiccited by 906
- 2023GLaMM: Pixel Grounding Large Multimodal Modelcited by 455
- 2023PixelLM: Pixel Reasoning with Large Multimodal Modelcited by 222
- 2023LL3DA: Visual Interactive Instruction Tuning for Omni-3D Understanding, Reasoning, and Planningcited by 210
17 more
- 2022PointCLIP V2: Prompting CLIP and GPT for Powerful 3D Open-world Learningcited by 187
- 2024LLaVA-3D: A Simple yet Effective Pathway to Empowering LMMs with 3D-awarenesscited by 183
- 2023Chat-Scene: Bridging 3D Scene and Large Language Models with Object Identifierscited by 175
- 2022PartSLIP: Low-Shot Part Segmentation for 3D Point Clouds via Pretrained Image-Language Modelscited by 118
- 2024SAMPart3D: Segment Any Part in 3D Objectscited by 97
- 2022AKB-48: A Real-World Articulated Object Knowledge Basecited by 82
- 2025SpatialLM: Training Large Language Models for Structured Indoor Modelingcited by 65
- 2023SATR: Zero-Shot Semantic Segmentation of 3D Shapescited by 62
- 2024Language-Image Models with 3D Understandingcited by 31
- 2025PartNeXt: A Next-Generation Dataset for Fine-Grained and Hierarchical 3D Part Understandingcited by 26
- 2024MeshSegmenter: Zero-Shot Mesh Semantic Segmentation via Texture Synthesiscited by 22
- 2026Utonia: Toward One Encoder for All Point Cloudscited by 21
- 2023ZeroPS: High-quality Cross-modal Knowledge Transfer for Zero-Shot 3D Part Segmentationcited by 18
- 20243D Part Segmentation via Geometric Aggregation of 2D Visual Featurescited by 15
- 2026HY3D-Bench: Generation of 3D Assetscited by 11
- 2026SegviGen: Repurposing 3D Generative Model for Part Segmentationcited by 10
- 2026PatchAlign3D: Local Feature Alignment for Dense 3D Shape Understandingcited by 6
Built on by
Citing papers per year: 2026: 1.
1 paper.