Unsupervised 3D Learning for Shape Analysis via Multiresolution Instance Discrimination
Not on the map. Why?
Abstract (arXiv)
Although unsupervised feature learning has demonstrated its advantages to reducing the workload of data labeling and network design in many fields, existing unsupervised 3D learning methods still cannot offer a generic network for various shape analysis tasks with competitive performance to supervised methods. In this paper, we propose an unsupervised method for learning a generic and efficient shape encoding network for different shape analysis tasks. The key idea of our method is to jointly encode and learn shape and point features from unlabeled 3D point clouds. For this purpose, we adapt HR-Net to octree-based convolutional neural networks for jointly encoding shape and point features with fused multiresolution subnetworks and design a simple-yet-efficient Multiresolution Instance Discrimination (MID) loss for jointly learning the shape and point features. Our network takes a 3D point cloud as input and output both shape and point features. After training, the network is concatenated with simple task-specific back-end layers and fine-tuned for different shape analysis tasks. We evaluate the efficacy and generality of our method and validate our network and loss design with a set of shape analysis tasks, including shape classification, semantic shape segmentation, as well as shape registration tasks. With simple back-ends, our network demonstrates the best performance among all unsupervised methods and achieves competitive performance to supervised methods, especially in tasks with a small labeled dataset. For fine-grained shape segmentation, our method even surpasses existing supervised methods by a large margin.
Key facts. Cited by 31 papers in the map (data through 7 Oct 2026). First posted on arXiv 3 Aug 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 5; 2022: 15; 2023: 6; 2024: 4; 2025: 0; 2026: 1.
31 papers.
Sort:
- 2022Image-to-Lidar Self-Supervised Distillation for Autonomous Driving Datacited by 126
- 2023Swin3D: A Pretrained Transformer Backbone for 3D Indoor Scene Understandingcited by 111
- 2022ALSO: Automotive Lidar Self-supervision by Occupancy estimationcited by 68
- 20214DContrast: Contrastive Learning with Dynamic Correspondences for 3D Scene Understandingcited by 54
- 2022Unsupervised Point Cloud Representation Learning with Deep Neural Networks: A Surveycited by 54
- 2022Implicit Autoencoder for Point-Cloud Self-Supervised Representation Learningcited by 46
- 2021BuildingNet: Learning to Label 3D Buildingscited by 33
- 2022POS-BERT: Point Cloud One-Stage BERT Pre-Trainingcited by 16
- 2022SRFeat: Learning Locally Accurate and Globally Consistent Non-Rigid Shape Correspondencecited by 13
- 20233D Feature Prediction for Masked-AutoEncoder-Based Point Cloud Pretrainingcited by 13
- 2024HVDistill: Transferring Knowledge from Images to Point Clouds via Unsupervised Hybrid-View Distillationcited by 11
- 2022Data Efficient 3D Learner via Knowledge Transferred from 2D Modelcited by 10
19 more
- 2022MvDeCor: Multi-view Dense Correspondence Learning for Fine-grained 3D Segmentationcited by 10
- 2021Self-supervised Point Cloud Representation Learning via Separating Mixed Shapescited by 8
- 2022Semi-supervised 3D shape segmentation with multilevel consistency and part substitutioncited by 8
- 2022Self-Supervised Image Representation Learning with Geometric Set Consistencycited by 7
- 2021Task-Aware Sampling Layer for Point-Wise Analysiscited by 6
- 2022Randomized Quantization: A Generic Augmentation for Data Agnostic Self-supervised Learningcited by 6
- 2024Swin3D++: Effective Multi-Source Pretraining for 3D Indoor Scene Understandingcited by 6
- 2022PointCMC: Cross-Modal Multi-Scale Correspondences Learning for Point Cloud Understandingcited by 5
- 2022Upsampling Autoencoder for Self-Supervised Point Cloud Learningcited by 4
- 2023Multi-View Representation is What You Need for Point-Cloud Pre-Trainingcited by 3
- 2022Joint Data and Feature Augmentation for Self-Supervised Representation Learning on Point Cloudscited by 2
- 2023Self-supervised Learning of Rotation-invariant 3D Point Set Features using Transformer and its Self-distillationcited by 2
- 2023DBDNet:Partial-to-Partial Point Cloud Registration with Dual Branches Decouplingcited by 2
- 2024Oriented-grid Encoder for 3D Implicit Representationscited by 2
- 2024EPContrast: Effective Point-level Contrastive Learning for Large-scale Point Cloud Understandingcited by 2
- 2021Interpolation-Aware Padding for 3D Sparse Convolutional Neural Networkscited by 1
- 2022SHRED: 3D Shape Region Decomposition with Learned Local Operationscited by 1
- 2023Unsupervised Representation Learning for Diverse Deformable Shape Collectionscited by 1
- 2026Adaptive Scaling with Geometric and Visual Continuity of completed 3D objectscited by 0
- 2026Adaptive Scaling with Geometric and Visual Continuity of completed 3D objects13 Feb 2026
- 2024EPContrast: Effective Point-level Contrastive Learning for Large-scale Point Cloud Understanding22 Oct 2024
- 2024HVDistill: Transferring Knowledge from Images to Point Clouds via Unsupervised Hybrid-View Distillation18 Mar 2024
- 2024Swin3D++: Effective Multi-Source Pretraining for 3D Indoor Scene Understanding22 Feb 2024
- 2024Oriented-grid Encoder for 3D Implicit Representations9 Feb 2024
- 2023Unsupervised Representation Learning for Diverse Deformable Shape Collections27 Oct 2023
- 2023DBDNet:Partial-to-Partial Point Cloud Registration with Dual Branches Decoupling18 Oct 2023
- 2023Self-supervised Learning of Rotation-invariant 3D Point Set Features using Transformer and its Self-distillation9 Aug 2023
- 2023Multi-View Representation is What You Need for Point-Cloud Pre-Training5 Jun 2023
- 20233D Feature Prediction for Masked-AutoEncoder-Based Point Cloud Pretraining14 Apr 2023
- 2023Swin3D: A Pretrained Transformer Backbone for 3D Indoor Scene Understanding14 Apr 2023
- 2022Randomized Quantization: A Generic Augmentation for Data Agnostic Self-supervised Learning19 Dec 2022
19 more
- 2022ALSO: Automotive Lidar Self-supervision by Occupancy estimation12 Dec 2022
- 2022PointCMC: Cross-Modal Multi-Scale Correspondences Learning for Point Cloud Understanding22 Nov 2022
- 2022Joint Data and Feature Augmentation for Self-Supervised Representation Learning on Point Clouds2 Nov 2022
- 2022SRFeat: Learning Locally Accurate and Globally Consistent Non-Rigid Shape Correspondence16 Sep 2022
- 2022MvDeCor: Multi-view Dense Correspondence Learning for Fine-grained 3D Segmentation18 Aug 2022
- 2022SHRED: 3D Shape Region Decomposition with Learned Local Operations7 Jun 2022
- 2022Semi-supervised 3D shape segmentation with multilevel consistency and part substitution19 Apr 2022
- 2022POS-BERT: Point Cloud One-Stage BERT Pre-Training3 Apr 2022
- 2022Image-to-Lidar Self-Supervised Distillation for Autonomous Driving Data30 Mar 2022
- 2022Self-Supervised Image Representation Learning with Geometric Set Consistency29 Mar 2022
- 2022Upsampling Autoencoder for Self-Supervised Point Cloud Learning21 Mar 2022
- 2022Data Efficient 3D Learner via Knowledge Transferred from 2D Model16 Mar 2022
- 2022Unsupervised Point Cloud Representation Learning with Deep Neural Networks: A Survey28 Feb 2022
- 2022Implicit Autoencoder for Point-Cloud Self-Supervised Representation Learning3 Jan 2022
- 20214DContrast: Contrastive Learning with Dynamic Correspondences for 3D Scene Understanding6 Dec 2021
- 2021BuildingNet: Learning to Label 3D Buildings11 Oct 2021
- 2021Self-supervised Point Cloud Representation Learning via Separating Mixed Shapes1 Sep 2021
- 2021Interpolation-Aware Padding for 3D Sparse Convolutional Neural Networks16 Aug 2021
- 2021Task-Aware Sampling Layer for Point-Wise Analysis9 Jul 2021
- 2022Image-to-Lidar Self-Supervised Distillation for Autonomous Driving Datacited by 126
- 2023Swin3D: A Pretrained Transformer Backbone for 3D Indoor Scene Understandingcited by 111
- 2022ALSO: Automotive Lidar Self-supervision by Occupancy estimationcited by 68
- 20214DContrast: Contrastive Learning with Dynamic Correspondences for 3D Scene Understandingcited by 54
- 2022Unsupervised Point Cloud Representation Learning with Deep Neural Networks: A Surveycited by 54
- 2022Implicit Autoencoder for Point-Cloud Self-Supervised Representation Learningcited by 46
- 2021BuildingNet: Learning to Label 3D Buildingscited by 33
- 2022POS-BERT: Point Cloud One-Stage BERT Pre-Trainingcited by 16
- 2022SRFeat: Learning Locally Accurate and Globally Consistent Non-Rigid Shape Correspondencecited by 13
- 20233D Feature Prediction for Masked-AutoEncoder-Based Point Cloud Pretrainingcited by 13
- 2024HVDistill: Transferring Knowledge from Images to Point Clouds via Unsupervised Hybrid-View Distillationcited by 11
- 2022Data Efficient 3D Learner via Knowledge Transferred from 2D Modelcited by 10
12 most cited of 31 All 31 (JSON)
- 2026Adaptive Scaling with Geometric and Visual Continuity of completed 3D objects13 Feb 2026
- 2024EPContrast: Effective Point-level Contrastive Learning for Large-scale Point Cloud Understanding22 Oct 2024
- 2024HVDistill: Transferring Knowledge from Images to Point Clouds via Unsupervised Hybrid-View Distillation18 Mar 2024
- 2024Swin3D++: Effective Multi-Source Pretraining for 3D Indoor Scene Understanding22 Feb 2024
- 2024Oriented-grid Encoder for 3D Implicit Representations9 Feb 2024
- 2023Unsupervised Representation Learning for Diverse Deformable Shape Collections27 Oct 2023
- 2023DBDNet:Partial-to-Partial Point Cloud Registration with Dual Branches Decoupling18 Oct 2023
- 2023Self-supervised Learning of Rotation-invariant 3D Point Set Features using Transformer and its Self-distillation9 Aug 2023
- 2023Multi-View Representation is What You Need for Point-Cloud Pre-Training5 Jun 2023
- 20233D Feature Prediction for Masked-AutoEncoder-Based Point Cloud Pretraining14 Apr 2023
- 2023Swin3D: A Pretrained Transformer Backbone for 3D Indoor Scene Understanding14 Apr 2023
- 2022Randomized Quantization: A Generic Augmentation for Data Agnostic Self-supervised Learning19 Dec 2022
12 newest of 31 All 31 (JSON)