Topology-Aware Modeling for Unsupervised Simulation-to-Reality Point Cloud Recognition
Not on the map. Why?
Abstract (arXiv)
Learning semantic representations from point sets of 3D object shapes is often challenged by significant geometric variations, primarily due to differences in data acquisition methods. Typically, training data is generated using point simulators, while testing data is collected with distinct 3D sensors, leading to a simulation-to-reality (Sim2Real) domain gap that limits the generalization ability of point classifiers. Current unsupervised domain adaptation (UDA) techniques struggle with this gap, as they often lack robust, domain-insensitive descriptors capable of capturing global topological information, resulting in overfitting to the limited semantic patterns of the source domain. To address this issue, we introduce a novel Topology-Aware Modeling (TAM) framework for Sim2Real UDA on object point clouds. Our approach mitigates the domain gap by leveraging global spatial topology, characterized by low-level, high-frequency 3D structures, and by modeling the topological relations of local geometric features through a novel self-supervised learning task. Additionally, we propose an advanced self-training strategy that combines cross-domain contrastive learning with self-training, effectively reducing the impact of noisy pseudo-labels and enhancing the robustness of the adaptation process. Experimental results on three public Sim2Real benchmarks validate the effectiveness of our TAM framework, showing consistent improvements over state-of-the-art methods across all evaluated tasks. The source code of this work will be available at https://github.com/zou-longkun/TAG.git.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 49 of its 73 references that are in the map. First posted on arXiv 26 Jun 2025.
Builds on
49 of 73 references.
References · 49
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 7,005
- 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,248
- 2017mixup: Beyond Empirical Risk Minimizationcited by 5,183
- 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,401
- 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,117
- 2015Domain-Adversarial Training of Neural Networkscited by 3,044
- 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,897
- 2019CutMix: Regularization Strategy to Train Strong Classifiers with Localizable Featurescited by 2,884
- 2020Supervised Contrastive Learningcited by 2,829
- 2018Dynamic Graph CNN for Learning on Point Cloudscited by 2,223
- 2020Fourier Features Let Networks Learn High Frequency Functions in Low Dimensional Domainscited by 2,200
37 more
- 2018ImageNet-trained CNNs are biased towards texture; increasing shape bias improves accuracy and robustnesscited by 1,432
- 2017VoxelNet: End-to-End Learning for Point Cloud Based 3D Object Detectioncited by 1,323
- 2019KPConv: Flexible and Deformable Convolution for Point Cloudscited by 1,205
- 2018PointCNN: Convolution On X-Transformed Pointscited by 764
- 2020PCT: Point cloud transformercited by 732
- 2017Maximum Classifier Discrepancy for Unsupervised Domain Adaptationcited by 683
- 2019Revisiting Point Cloud Classification: A New Benchmark Dataset and Classification Model on Real-World Datacited by 532
- 2019DeepGCNs: Can GCNs Go as Deep as CNNs?cited by 527
- 2018Spherical CNNscited by 456
- 2019Contrastive Adaptation Network for Unsupervised Domain Adaptationcited by 407
- 2020Puzzle Mix: Exploiting Saliency and Local Statistics for Optimal Mixupcited by 261
- 2019Interpolation Consistency Training for Semi-Supervised Learningcited by 251
- 2020PointASNL: Robust Point Clouds Processing using Nonlocal Neural Networks with Adaptive Samplingcited by 239
- 2018SO-Net: Self-Organizing Network for Point Cloud Analysiscited by 210
- 2022Vision GNN: An Image is Worth Graph of Nodescited by 186
- 2019Modeling Point Clouds with Self-Attention and Gumbel Subset Samplingcited by 151
- 2019Transferrable Prototypical Networks for Unsupervised Domain Adaptationcited by 141
- 2019PointDAN: A Multi-Scale 3D Domain Adaption Network for Point Cloud Representationcited by 114
- 2018PointCloud Saliency Mapscited by 112
- 2020PointMixup: Augmentation for Point Cloudscited by 104
- 2020Self-Supervised Learning for Domain Adaptation on Point-Cloudscited by 99
- 2021PointCutMix: Regularization Strategy for Point Cloud Classificationcited by 69
- 2020PointAugment: an Auto-Augmentation Framework for Point Cloud Classificationcited by 65
- 2019Reconstructing continuous distributions of 3D protein structure from cryo-EM imagescited by 56
- 2018Improving Generalization via Scalable Neighborhood Component Analysiscited by 53
- 2021VPFNet: Improving 3D Object Detection with Virtual Point based LiDAR and Stereo Data Fusioncited by 48
- 2021Learning Cross-modal Contrastive Features for Video Domain Adaptationcited by 47
- 2023Parameter is Not All You Need: Starting from Non-Parametric Networks for 3D Point Cloud Analysiscited by 34
- 2021Geometry-Aware Self-Training for Unsupervised Domain Adaptationon Object Point Cloudscited by 31
- 2022Real-time 3D Single Object Tracking with Transformercited by 27
- 2021Domain Adaptation on Point Clouds via Geometry-Aware Implicitscited by 26
- 2022MetaSets: Meta-Learning on Point Sets for Generalizable Representationscited by 22
- 2022Self-Distillation for Unsupervised 3D Domain Adaptationcited by 12
- 2020Improving Semantic Analysis on Point Clouds via Auxiliary Supervision of Local Geometric Priorscited by 11
- 2022Quasi-Balanced Self-Training on Noise-Aware Synthesis of Object Point Clouds for Closing Domain Gapcited by 5
- 2023Synergizing Contrastive Learning and Optimal Transport for 3D Point Cloud Domain Adaptationcited by 5
- 2024PointGL: A Simple Global-Local Framework for Efficient Point Cloud Analysiscited by 5
Built on by
Not cited yet.