Staying in Shape: Learning Invariant Shape Representations using Contrastive Learning
Not on the map. Why?
Abstract (arXiv)
Creating representations of shapes that are invari-ant to isometric or almost-isometric transforma-tions has long been an area of interest in shape anal-ysis, since enforcing invariance allows the learningof more effective and robust shape representations.Most existing invariant shape representations arehandcrafted, and previous work on learning shaperepresentations do not focus on producing invariantrepresentations. To solve the problem of learningunsupervised invariant shape representations, weuse contrastive learning, which produces discrimi-native representations through learning invarianceto user-specified data augmentations. To producerepresentations that are specifically isometry andalmost-isometry invariant, we propose new dataaugmentations that randomly sample these transfor-mations. We show experimentally that our methodoutperforms previous unsupervised learning ap-proaches in both effectiveness and robustness.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 27 of its 50 references that are in the map. First posted on arXiv 8 Jul 2021.
Builds on
27 of 50 references.
References · 27
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
- 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
- 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,482
- 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,223
- 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,384
- 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,088
- 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,880
- 2020Improved Baselines with Momentum Contrastive Learningcited by 2,282
- 2018Dynamic Graph CNN for Learning on Point Cloudscited by 2,220
- 20163D U-Net: Learning Dense Volumetric Segmentation from Sparse Annotationcited by 1,471
- 2016Context Encoders: Feature Learning by Inpaintingcited by 1,424
15 more
- 2016Unsupervised Learning of Visual Representations by Solving Jigsaw Puzzlescited by 1,379
- 2016Colorful Image Colorizationcited by 1,113
- 2015Unsupervised Visual Representation Learning by Context Predictioncited by 1,062
- 2018PointCNN: Convolution On X-Transformed Pointscited by 764
- 2016Learning a Probabilistic Latent Space of Object Shapes via 3D Generative-Adversarial Modelingcited by 558
- 2020PointContrast: Unsupervised Pre-training for 3D Point Cloud Understandingcited by 502
- 2019Relation-Shape Convolutional Neural Network for Point Cloud Analysiscited by 346
- 2020What Should Not Be Contrastive in Contrastive Learningcited by 224
- 2016Learning a Predictable and Generative Vector Representation for Objectscited by 173
- 2016Learning Features by Watching Objects Movecited by 138
- 2020PointMixup: Augmentation for Point Cloudscited by 104
- 2020PointAugment: an Auto-Augmentation Framework for Point Cloud Classificationcited by 65
- 2018Learning Descriptor Networks for 3D Shape Synthesis and Analysiscited by 56
- 2020On Isometry Robustness of Deep 3D Point Cloud Models under Adversarial Attackscited by 46
- 2018View Inter-Prediction GAN: Unsupervised Representation Learning for 3D Shapes by Learning Global Shape Memories to Support Local View Predictionscited by 43
Built on by
Citing papers per year: 2022: 3; 2023: 1.
4 papers.
- 2022Addressing Token Uniformity in Transformers via Singular Value Transformationcited by 14
- 2022Upsampling Autoencoder for Self-Supervised Point Cloud Learningcited by 4
- 2022A Simple Strategy to Provable Invariance via Orbit Mappingcited by 2
- 2023Advancing Perception in Artificial Intelligence through Principles of Cognitive Sciencecited by 1
- 2023Advancing Perception in Artificial Intelligence through Principles of Cognitive Science13 Oct 2023
- 2022A Simple Strategy to Provable Invariance via Orbit Mapping24 Sep 2022
- 2022Addressing Token Uniformity in Transformers via Singular Value Transformation24 Aug 2022
- 2022Upsampling Autoencoder for Self-Supervised Point Cloud Learning21 Mar 2022