# Tags2Parts: Discovering Semantic Regions from Shape Tags

arXiv: https://arxiv.org/abs/1708.06673 · HTML: https://mlsanity.com/paper/1708.06673/

## Key facts

- Cited by 4 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 22 Aug 2017.

## Built on by (most cited first, 4 of 4)

- [SDF-StyleGAN: Implicit SDF-Based StyleGAN for 3D Shape Generation](https://mlsanity.com/paper/2206.12055/) (2022)
- [RIM-Net: Recursive Implicit Fields for Unsupervised Learning of Hierarchical Shape Structures](https://mlsanity.com/paper/2201.12763/) (2022)
- [Semi-supervised 3D shape segmentation with multilevel consistency and part substitution](https://mlsanity.com/paper/2204.08824/) (2022)
- [PriFit: Learning to Fit Primitives Improves Few Shot Point Cloud Segmentation](https://mlsanity.com/paper/2112.13942/) (2021)

## Abstract (arXiv)

We propose a novel method for discovering shape regions that strongly correlate with user-prescribed tags. For example, given a collection of chairs tagged as either "has armrest" or "lacks armrest", our system correctly highlights the armrest regions as the main distinctive parts between the two chair types. To obtain point-wise predictions from shape-wise tags we develop a novel neural network architecture that is trained with tag classification loss, but is designed to rely on segmentation to predict the tag. Our network is inspired by U-Net, but we replicate shallow U structures several times with new skip connections and pooling layers, and call the resulting architecture "WU-Net". We test our method on segmentation benchmarks and show that even with weak supervision of whole shape tags, our method can infer meaningful semantic regions, without ever observing shape segmentations. Further, once trained, the model can process shapes for which the tag is entirely unknown. As a bonus, our architecture is directly operational under full supervision and performs strongly on standard benchmarks. We validate our method through experiments with many variant architectures and prior baselines, and demonstrate several applications.
