MetaSets: Meta-Learning on Point Sets for Generalizable Representations
Not on the map. Why?
Abstract (arXiv)
Deep learning techniques for point clouds have achieved strong performance on a range of 3D vision tasks. However, it is costly to annotate large-scale point sets, making it critical to learn generalizable representations that can transfer well across different point sets. In this paper, we study a new problem of 3D Domain Generalization (3DDG) with the goal to generalize the model to other unseen domains of point clouds without any access to them in the training process. It is a challenging problem due to the substantial geometry shift from simulated to real data, such that most existing 3D models underperform due to overfitting the complete geometries in the source domain. We propose to tackle this problem via MetaSets, which meta-learns point cloud representations from a group of classification tasks on carefully-designed transformed point sets containing specific geometry priors. The learned representations are more generalizable to various unseen domains of different geometries. We design two benchmarks for Sim-to-Real transfer of 3D point clouds. Experimental results show that MetaSets outperforms existing 3D deep learning methods by large margins.
Key facts. Cited by 22 papers in the map (data through 14 Oct 2026). Builds on 35 of its 42 references that are in the map. First posted on arXiv 15 Apr 2022.
Builds on
35 of 42 references.
References · 35
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
- 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,639
- 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,248
- 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,897
- 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,401
- 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,117
- 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,897
- 2018Dynamic Graph CNN for Learning on Point Cloudscited by 2,223
- 2019Invariant Risk Minimizationcited by 1,854
- 2017VoxelNet: End-to-End Learning for Point Cloud Based 3D Object Detectioncited by 1,323
23 more
- 2017Deeper, Broader and Artier Domain Generalizationcited by 986
- 2018PointCNN: Convolution On X-Transformed Pointscited by 764
- 2017Learning to Generalize: Meta-Learning for Domain Generalizationcited by 763
- 2018PointConv: Deep Convolutional Networks on 3D Point Cloudscited by 657
- 2017Frustum PointNets for 3D Object Detection from RGB-D Datacited by 640
- 2013Domain Generalization via Invariant Feature Representationcited by 623
- 2015Multi-view Convolutional Neural Networks for 3D Shape Recognitioncited by 565
- 2019Revisiting Point Cloud Classification: A New Benchmark Dataset and Classification Model on Real-World Datacited by 532
- 2018Generalizing to Unseen Domains via Adversarial Data Augmentationcited by 451
- 2018Generalizing Across Domains via Cross-Gradient Trainingcited by 268
- 2018SpiderCNN: Deep Learning on Point Sets with Parameterized Convolutional Filterscited by 261
- 2015Domain Generalization for Object Recognition with Multi-task Autoencoderscited by 253
- 2019Episodic Training for Domain Generalizationcited by 245
- 2016Volumetric and Multi-View CNNs for Object Classification on 3D Datacited by 240
- 2018SqueezeSegV2: Improved Model Structure and Unsupervised Domain Adaptation for Road-Object Segmentation from a LiDAR Point Cloudcited by 228
- 2016Statistics of Robust Optimization: A Generalized Empirical Likelihood Approachcited by 183
- 2019On the Convergence Theory of Gradient-Based Model-Agnostic Meta-Learning Algorithmscited by 132
- 2019PointDAN: A Multi-Scale 3D Domain Adaption Network for Point Cloud Representationcited by 114
- 2020Global-Local Bidirectional Reasoning for Unsupervised Representation Learning of 3D Point Cloudscited by 75
- 2019ConvPoint: Continuous Convolutions for Point Cloud Processingcited by 62
- 2019Linked Dynamic Graph CNN: Learning on Point Cloud via Linking Hierarchical Featurescited by 31
- 2019Addressing Model Vulnerability to Distributional Shifts over Image Transformation Setscited by 12
- 20173D Object Classification via Spherical Projectionscited by 9
Built on by
Citing papers per year: 2022: 4; 2023: 3; 2024: 6; 2025: 6; 2026: 3.
22 papers.
Sort:
By area:
- 2022Domain generalization of 3D semantic segmentation in autonomous drivingcited by 25
- 2022Meta Spatio-Temporal Debiasing for Video Scene Graph Generationcited by 20
- 2023A Survey of Label-Efficient Deep Learning for 3D Point Cloudscited by 20
- 2024Learning to Unlearn for Robust Machine Unlearningcited by 19
- 2023Meta Compositional Referring Expression Segmentationcited by 18
- 2024CloudFixer: Test-Time Adaptation for 3D Point Clouds via Diffusion-Guided Geometric Transformationcited by 11
- 2023Test-Time Adaptation for Point Cloud Upsampling Using Meta-Learningcited by 10
- 2022Improving the Reliability for Confidence Estimationcited by 6
- 2024Point-PRC: A Prompt Learning Based Regulation Framework for Generalizable Point Cloud Analysiscited by 6
- 2025Rotation-Adaptive Point Cloud Domain Generalization via Intricate Orientation Learningcited by 5
- 2025Point-Cache: Test-time Dynamic and Hierarchical Cache for Robust and Generalizable Point Cloud Analysiscited by 4
- 2024InvariantOODG: Learning Invariant Features of Point Clouds for Out-of-Distribution Generalizationcited by 2
10 more
- 2024PointDGMamba: Domain Generalization of Point Cloud Classification via Generalized State Space Modelcited by 2
- 2025DG-MVP: 3D Domain Generalization via Multiple Views of Point Clouds for Classificationcited by 1
- 20223D-model ShapeNet Core Classification using Meta-Semantic Learningcited by 0
- 2024Boosting Cross-Domain Point Classification via Distilling Relational Priors from 2D Transformerscited by 0
- 2025Topology-Aware Modeling for Unsupervised Simulation-to-Reality Point Cloud Recognitioncited by 0
- 2025Exploring Single Domain Generalization of LiDAR-based Semantic Segmentation under Imperfect Labelscited by 0
- 2025Learning to Generate Cross-Task Unexploitable Examplescited by 0
- 2026Adapting Point Cloud Analysis via Multimodal Bayesian Distribution Learningcited by 0
- 2026Domain Generalizable Adaptation of 3D Vision-Language Models via Regularized Fine-Tuningcited by 0
- 2026Annotation-Free Furniture Codes: What They Encode, and How Far They Transfercited by 0
- 2026Annotation-Free Furniture Codes: What They Encode, and How Far They Transfer11 Jul 2026
- 2026Domain Generalizable Adaptation of 3D Vision-Language Models via Regularized Fine-Tuning16 Jun 2026
- 2026Adapting Point Cloud Analysis via Multimodal Bayesian Distribution Learning23 Mar 2026
- 2025Learning to Generate Cross-Task Unexploitable Examples15 Dec 2025
- 2025Exploring Single Domain Generalization of LiDAR-based Semantic Segmentation under Imperfect Labels10 Oct 2025
- 2025Topology-Aware Modeling for Unsupervised Simulation-to-Reality Point Cloud Recognition26 Jun 2025
- 2025DG-MVP: 3D Domain Generalization via Multiple Views of Point Clouds for Classification16 Apr 2025
- 2025Point-Cache: Test-time Dynamic and Hierarchical Cache for Robust and Generalizable Point Cloud Analysis15 Mar 2025
- 2025Rotation-Adaptive Point Cloud Domain Generalization via Intricate Orientation Learning4 Feb 2025
- 2024Point-PRC: A Prompt Learning Based Regulation Framework for Generalizable Point Cloud Analysis27 Oct 2024
- 2024PointDGMamba: Domain Generalization of Point Cloud Classification via Generalized State Space Model24 Aug 2024
- 2024Boosting Cross-Domain Point Classification via Distilling Relational Priors from 2D Transformers26 Jul 2024
10 more
- 2024CloudFixer: Test-Time Adaptation for 3D Point Clouds via Diffusion-Guided Geometric Transformation23 Jul 2024
- 2024Learning to Unlearn for Robust Machine Unlearning15 Jul 2024
- 2024InvariantOODG: Learning Invariant Features of Point Clouds for Out-of-Distribution Generalization8 Jan 2024
- 2023Test-Time Adaptation for Point Cloud Upsampling Using Meta-Learning31 Aug 2023
- 2023A Survey of Label-Efficient Deep Learning for 3D Point Clouds31 May 2023
- 2023Meta Compositional Referring Expression Segmentation10 Apr 2023
- 2022Domain generalization of 3D semantic segmentation in autonomous driving7 Dec 2022
- 2022Improving the Reliability for Confidence Estimation13 Oct 2022
- 2022Meta Spatio-Temporal Debiasing for Video Scene Graph Generation23 Jul 2022
- 20223D-model ShapeNet Core Classification using Meta-Semantic Learning28 May 2022
- 2024Learning to Unlearn for Robust Machine Unlearningcited by 19
- 2024Learning to Unlearn for Robust Machine Unlearning15 Jul 2024
- 2022Domain generalization of 3D semantic segmentation in autonomous drivingcited by 25
- 2022Meta Spatio-Temporal Debiasing for Video Scene Graph Generationcited by 20
- 2023A Survey of Label-Efficient Deep Learning for 3D Point Cloudscited by 20
- 2023Meta Compositional Referring Expression Segmentationcited by 18
- 2023Test-Time Adaptation for Point Cloud Upsampling Using Meta-Learningcited by 10
- 2022Improving the Reliability for Confidence Estimationcited by 6
- 2024Point-PRC: A Prompt Learning Based Regulation Framework for Generalizable Point Cloud Analysiscited by 6
- 2025Rotation-Adaptive Point Cloud Domain Generalization via Intricate Orientation Learningcited by 5
- 2025Point-Cache: Test-time Dynamic and Hierarchical Cache for Robust and Generalizable Point Cloud Analysiscited by 4
- 2024InvariantOODG: Learning Invariant Features of Point Clouds for Out-of-Distribution Generalizationcited by 2
- 2024PointDGMamba: Domain Generalization of Point Cloud Classification via Generalized State Space Modelcited by 2
- 2025DG-MVP: 3D Domain Generalization via Multiple Views of Point Clouds for Classificationcited by 1
12 most cited of 18 All 18 (JSON)
- 2026Annotation-Free Furniture Codes: What They Encode, and How Far They Transfer11 Jul 2026
- 2025Learning to Generate Cross-Task Unexploitable Examples15 Dec 2025
- 2025Exploring Single Domain Generalization of LiDAR-based Semantic Segmentation under Imperfect Labels10 Oct 2025
- 2025Topology-Aware Modeling for Unsupervised Simulation-to-Reality Point Cloud Recognition26 Jun 2025
- 2025DG-MVP: 3D Domain Generalization via Multiple Views of Point Clouds for Classification16 Apr 2025
- 2025Point-Cache: Test-time Dynamic and Hierarchical Cache for Robust and Generalizable Point Cloud Analysis15 Mar 2025
- 2025Rotation-Adaptive Point Cloud Domain Generalization via Intricate Orientation Learning4 Feb 2025
- 2024Point-PRC: A Prompt Learning Based Regulation Framework for Generalizable Point Cloud Analysis27 Oct 2024
- 2024PointDGMamba: Domain Generalization of Point Cloud Classification via Generalized State Space Model24 Aug 2024
- 2024Boosting Cross-Domain Point Classification via Distilling Relational Priors from 2D Transformers26 Jul 2024
- 2024InvariantOODG: Learning Invariant Features of Point Clouds for Out-of-Distribution Generalization8 Jan 2024
- 2023Test-Time Adaptation for Point Cloud Upsampling Using Meta-Learning31 Aug 2023
12 newest of 18 All 18 (JSON)