Point-SRA: Self-Representation Alignment for 3D Representation Learning
Not on the map. Why?
Abstract (arXiv)
Masked autoencoders (MAE) have become a dominant paradigm in 3D representation learning, setting new performance benchmarks across various downstream tasks. Existing methods with fixed mask ratio neglect multi-level representational correlations and intrinsic geometric structures, while relying on point-wise reconstruction assumptions that conflict with the diversity of point cloud. To address these issues, we propose a 3D representation learning method, termed Point-SRA, which aligns representations through self-distillation and probabilistic modeling. Specifically, we assign different masking ratios to the MAE to capture complementary geometric and semantic information, while the MeanFlow Transformer (MFT) leverages cross-modal conditional embeddings to enable diverse probabilistic reconstruction. Our analysis further reveals that representations at different time steps in MFT also exhibit complementarity. Therefore, a Dual Self-Representation Alignment mechanism is proposed at both the MAE and MFT levels. Finally, we design a Flow-Conditioned Fine-Tuning Architecture to fully exploit the point cloud distribution learned via MeanFlow. Point-SRA outperforms Point-MAE by 5.37% on ScanObjectNN. On intracranial aneurysm segmentation, it reaches 96.07% mean IoU for arteries and 86.87% for aneurysms. For 3D object detection, Point-SRA achieves 47.3% AP@50, surpassing MaskPoint by 5.12%.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 31 of its 39 references that are in the map. First posted on arXiv 5 Jan 2026.
Builds on
31 of 39 references.
References · 31
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,223
- 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,384
- 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,088
- 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,880
- 2018Dynamic Graph CNN for Learning on Point Cloudscited by 2,220
- 20194D Spatio-Temporal ConvNets: Minkowski Convolutional Neural Networkscited by 1,201
- 2016A Point Set Generation Network for 3D Object Reconstruction from a Single Imagecited by 972
- 2018PointCNN: Convolution On X-Transformed Pointscited by 764
- 2021Point-BERT: Pre-training 3D Point Cloud Transformers with Masked Point Modelingcited by 647
- 2019Revisiting Point Cloud Classification: A New Benchmark Dataset and Classification Model on Real-World Datacited by 532
19 more
- 2025Mean Flows for One-step Generative Modelingcited by 524
- 2020PointContrast: Unsupervised Pre-training for 3D Point Cloud Understandingcited by 502
- 2022PointNeXt: Revisiting PointNet++ with Improved Training and Scaling Strategiescited by 432
- 2022Point-M2AE: Multi-scale Masked Autoencoders for Hierarchical Point Cloud Pre-trainingcited by 263
- 2021Self-Supervised Pretraining of 3D Features on any Point-Cloudcited by 217
- 2018SO-Net: Self-Organizing Network for Point Cloud Analysiscited by 210
- 2021Spatio-temporal Self-Supervised Representation Learning for 3D Point Cloudscited by 180
- 2023Contrast with Reconstruct: Contrastive 3D Representation Learning Guided by Generative Pretrainingcited by 162
- 2022Masked Discrimination for Self-Supervised Learning on Point Cloudscited by 155
- 2022Learning 3D Representations from 2D Pre-trained Models via Image-to-Point Masked Autoencoderscited by 143
- 2022Autoencoders as Cross-Modal Teachers: Can Pretrained 2D Image Transformers Help 3D Representation Learning?cited by 121
- 2022P2P: Tuning Pre-trained Image Models for Point Cloud Analysis with Point-to-Pixel Promptingcited by 74
- 2023Point Cloud Pre-training with Diffusion Modelscited by 47
- 2019VoteNet: A Deep Learning Label Fusion Method for Multi-Atlas Segmentationcited by 44
- 2023Towards Compact 3D Representations via Point Feature Enhancement Masked Autoencoderscited by 42
- 2020IntrA: 3D Intracranial Aneurysm Dataset for Deep Learningcited by 41
- 2024Point-JEPA: A Joint Embedding Predictive Architecture for Self-Supervised Learning on Point Cloudcited by 29
- 2024RI-MAE: Rotation-Invariant Masked AutoEncoders for Self-Supervised Point Cloud Representation Learningcited by 15
- 2022Pix4Point: Image Pretrained Standard Transformers for 3D Point Cloud Understandingcited by 6
Built on by
Citing papers per year: 2026: 1.
1 paper.
- 2026Tri-Efficient Transfer Learning for Point Cloud Videoscited by 5
- 2026Tri-Efficient Transfer Learning for Point Cloud Videos23 Jun 2026