mlsanityData to 14 Oct 2026

PartLLM: A Unified Multimodal Foundation for 3D Part Segmentation

arXiv 2609.25832 ↗First posted 22 Sep 2026cs.CV cs.GRcited by 1

Not on the map. Why?

Abstract (arXiv)

Part segmentation is a fundamental problem in computer graphics and 3D vision. Recent works have expanded 3D part segmentation beyond fixed taxonomies, but existing approaches typically only address a specific setting, such as text-guided part segmentation or point-based interaction. In this work, we argue that these settings can be unified as an intent-conditioned generative problem, where different prompts specify the desired part decomposition. To this end, we introduce PartLLM, a unified multimodal model that formulates 3D part segmentation as autoregressive semantic decomposition. Conditioned on an input shape and a user prompt, PartLLM autoregressively generates semantic part hypotheses as queries for mask prediction and feeds them to a decomposition-aware decoder that jointly predicts coherent part masks. This unified design supports text-guided part segmentation, interactive segmentation, and full-shape semantic decomposition with controllable granularity within a single model. Extensive experiments across these task settings show that PartLLM consistently outperforms task-specific baselines, demonstrating the effectiveness of unifying 3D part segmentation under an intent-conditioned generative formulation.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 29 of its 49 references that are in the map. First posted on arXiv 22 Sep 2026.

Builds on

29 of 49 references.

References · 29

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2023Segment Anythingcited by 8,234
  3. 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,401
  4. 2025Qwen3-VL Technical Reportcited by 2,793
  5. 2023Qwen-VL: A Versatile Vision-Language Model for Understanding, Localization, Text Reading, and Beyondcited by 2,224
  6. 2018Dynamic Graph CNN for Learning on Point Cloudscited by 2,223
  7. 2020Point Transformercited by 1,470
  8. 2023Kosmos-2: Grounding Multimodal Large Language Models to the Worldcited by 1,089
  9. 2023Shikra: Unleashing Multimodal LLM's Referential Dialogue Magiccited by 906
  10. 2023GLaMM: Pixel Grounding Large Multimodal Modelcited by 455
  11. 2023PixelLM: Pixel Reasoning with Large Multimodal Modelcited by 222
  12. 2023LL3DA: Visual Interactive Instruction Tuning for Omni-3D Understanding, Reasoning, and Planningcited by 210
17 more
  1. 2022PointCLIP V2: Prompting CLIP and GPT for Powerful 3D Open-world Learningcited by 187
  2. 2024LLaVA-3D: A Simple yet Effective Pathway to Empowering LMMs with 3D-awarenesscited by 183
  3. 2023Chat-Scene: Bridging 3D Scene and Large Language Models with Object Identifierscited by 175
  4. 2022PartSLIP: Low-Shot Part Segmentation for 3D Point Clouds via Pretrained Image-Language Modelscited by 118
  5. 2024SAMPart3D: Segment Any Part in 3D Objectscited by 97
  6. 2022AKB-48: A Real-World Articulated Object Knowledge Basecited by 82
  7. 2025SpatialLM: Training Large Language Models for Structured Indoor Modelingcited by 65
  8. 2023SATR: Zero-Shot Semantic Segmentation of 3D Shapescited by 62
  9. 2024Language-Image Models with 3D Understandingcited by 31
  10. 2025PartNeXt: A Next-Generation Dataset for Fine-Grained and Hierarchical 3D Part Understandingcited by 26
  11. 2024MeshSegmenter: Zero-Shot Mesh Semantic Segmentation via Texture Synthesiscited by 22
  12. 2026Utonia: Toward One Encoder for All Point Cloudscited by 21
  13. 2023ZeroPS: High-quality Cross-modal Knowledge Transfer for Zero-Shot 3D Part Segmentationcited by 18
  14. 20243D Part Segmentation via Geometric Aggregation of 2D Visual Featurescited by 15
  15. 2026HY3D-Bench: Generation of 3D Assetscited by 11
  16. 2026SegviGen: Repurposing 3D Generative Model for Part Segmentationcited by 10
  17. 2026PatchAlign3D: Local Feature Alignment for Dense 3D Shape Understandingcited by 6

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.