mlsanityData to 7 Oct 2026

Material Magic Wand: Material-Aware Grouping of 3D Parts in Untextured Meshes

arXiv 2603.17370 ↗First posted 18 Mar 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

We introduce the problem of material-aware part grouping in untextured meshes. Many real-world shapes, such as scales of pinecones or windows of buildings, contain repeated structures that share the same material but exhibit geometric variations. When assigning materials to such meshes, these repeated parts often require piece-by-piece manual identification and selection, which is tedious and time-consuming. To address this, we propose Material Magic Wand, a tool that allows artists to select part groups based on their estimated material properties -- when one part is selected, our algorithm automatically retrieves all other parts likely to share the same material. The key component of our approach is a part encoder that generates a material-aware embedding for each 3D part, accounting for both local geometry and global context. We train our model with a supervised contrastive loss that brings embeddings of material-consistent parts closer while separating those of different materials; therefore, part grouping can be achieved by retrieving embeddings that are close to the embedding of the selected part. To benchmark this task, we introduce a curated dataset of 100 shapes with 241 part-level queries. We verify the effectiveness of our method through extensive experiments and demonstrate its practical value in an interactive material assignment application.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 41 of its 57 references that are in the map. First posted on arXiv 18 Mar 2026.

Builds on

41 of 57 references.

References · 41

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2023Segment Anythingcited by 8,158
  3. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
  4. 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,048
  5. 2020Supervised Contrastive Learningcited by 2,803
  6. 2024SAM 2: Segment Anything in Images and Videoscited by 2,784
  7. 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,522
  8. 2025DINOv3cited by 1,297
  9. 2021Grounded Language-Image Pre-trainingcited by 1,147
  10. 2025SigLIP 2: Multilingual Vision-Language Encoders with Improved Semantic Understanding, Localization, and Dense Featurescited by 1,127
  11. 2018PartNet: A Large-scale Benchmark for Fine-grained and Hierarchical Part-level 3D Object Understandingcited by 521
  12. 2023OpenShape: Scaling Up 3D Shape Representation Towards Open-World Understandingcited by 183
29 more
  1. 2022PartSLIP: Low-Shot Part Segmentation for 3D Point Clouds via Pretrained Image-Language Modelscited by 117
  2. 2024GARField: Group Anything with Radiance Fieldscited by 108
  3. 2025PARTFIELD: Learning 3D Feature Fields for Part Segmentation and Beyondcited by 91
  4. 2023OmniSeg3D: Omniversal 3D Segmentation via Hierarchical Contrastive Learningcited by 75
  5. 2023SATR: Zero-Shot Semantic Segmentation of 3D Shapescited by 62
  6. 2024DreamMat: High-quality PBR Material Generation with Geometry- and Light-aware Diffusion Modelscited by 50
  7. 2024Point-SAM: Promptable 3D Segmentation Model for Point Cloudscited by 49
  8. 2015Sketch-based 3D Shape Retrieval using Convolutional Neural Networkscited by 41
  9. 2025TexVerse: A Universe of 3D Objects with High-Resolution Texturescited by 41
  10. 2023PartSLIP++: Enhancing Low-Shot 3D Part Segmentation via Multi-View Instance Segmentation and Maximum Likelihood Estimationcited by 37
  11. 2024Segment Any Meshcited by 37
  12. 2023Zero-Shot 3D Shape Correspondencecited by 33
  13. 2024Material Anything: Generating Materials for Any 3D Object via Diffusioncited by 31
  14. 2024Find Any Part in 3Dcited by 30
  15. 2023PartDistill: 3D Shape Part Segmentation by Vision-Language Model Distillationcited by 27
  16. 2023Materialistic: Selecting Similar Materials in Imagescited by 26
  17. 2024MeshSegmenter: Zero-Shot Mesh Semantic Segmentation via Texture Synthesiscited by 22
  18. 2022TriCoLo: Trimodal Contrastive Loss for Text to Shape Retrievalcited by 18
  19. 2023ZeroPS: High-quality Cross-modal Knowledge Transfer for Zero-Shot 3D Part Segmentationcited by 18
  20. 2024PartSTAD: 2D-to-3D Part Segmentation Task Adaptationcited by 18
  21. 2024iSeg: Interactive 3D Segmentation via Interactive Attentioncited by 14
  22. 2018Learning to Group and Label Fine-Grained Shape Componentscited by 9
  23. 2024SAMa: Material-aware 3D Selection and Segmentationcited by 9
  24. 2023Generalizing Single-View 3D Shape Retrieval to Occlusions and Unseen Objectscited by 8
  25. 2024View-Consistent Hierarchical 3D Segmentation Using Ultrametric Feature Fieldscited by 8
  26. 2024MaterialSeg3D: Segmenting Dense Materials from 2D Priors for 3D Assetscited by 6
  27. 2025Describe, Adapt and Combine: Empowering CLIP Encoders for Open-set 3D Object Retrievalcited by 5
  28. 2021The Neurally-Guided Shape Parser: Grammar-based Labeling of 3D Shape Regions with Approximate Inferencecited by 4
  29. 2025Fine-Grained Spatially Varying Material Selection in Imagescited by 3

Built on by

Not cited yet.