mlsanityData to 7 Oct 2026

Point-SRA: Self-Representation Alignment for 3D Representation Learning

arXiv 2601.01746 ↗First posted 5 Jan 2026cs.CVcited by 1

Not on the map. Why?

Abstract (arXiv)

Masked autoencoders (MAE) have become a dominant paradigm in 3D representation learning, setting new performance benchmarks across various downstream tasks. Existing methods with fixed mask ratio neglect multi-level representational correlations and intrinsic geometric structures, while relying on point-wise reconstruction assumptions that conflict with the diversity of point cloud. To address these issues, we propose a 3D representation learning method, termed Point-SRA, which aligns representations through self-distillation and probabilistic modeling. Specifically, we assign different masking ratios to the MAE to capture complementary geometric and semantic information, while the MeanFlow Transformer (MFT) leverages cross-modal conditional embeddings to enable diverse probabilistic reconstruction. Our analysis further reveals that representations at different time steps in MFT also exhibit complementarity. Therefore, a Dual Self-Representation Alignment mechanism is proposed at both the MAE and MFT levels. Finally, we design a Flow-Conditioned Fine-Tuning Architecture to fully exploit the point cloud distribution learned via MeanFlow. Point-SRA outperforms Point-MAE by 5.37% on ScanObjectNN. On intracranial aneurysm segmentation, it reaches 96.07% mean IoU for arteries and 86.87% for aneurysms. For 3D object detection, Point-SRA achieves 47.3% AP@50, surpassing MaskPoint by 5.12%.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 31 of its 39 references that are in the map. First posted on arXiv 5 Jan 2026.

Builds on

31 of 39 references.

References · 31

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  3. 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,223
  4. 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,384
  5. 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,088
  6. 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,880
  7. 2018Dynamic Graph CNN for Learning on Point Cloudscited by 2,220
  8. 20194D Spatio-Temporal ConvNets: Minkowski Convolutional Neural Networkscited by 1,201
  9. 2016A Point Set Generation Network for 3D Object Reconstruction from a Single Imagecited by 972
  10. 2018PointCNN: Convolution On X-Transformed Pointscited by 764
  11. 2021Point-BERT: Pre-training 3D Point Cloud Transformers with Masked Point Modelingcited by 647
  12. 2019Revisiting Point Cloud Classification: A New Benchmark Dataset and Classification Model on Real-World Datacited by 532
19 more
  1. 2025Mean Flows for One-step Generative Modelingcited by 524
  2. 2020PointContrast: Unsupervised Pre-training for 3D Point Cloud Understandingcited by 502
  3. 2022PointNeXt: Revisiting PointNet++ with Improved Training and Scaling Strategiescited by 432
  4. 2022Point-M2AE: Multi-scale Masked Autoencoders for Hierarchical Point Cloud Pre-trainingcited by 263
  5. 2021Self-Supervised Pretraining of 3D Features on any Point-Cloudcited by 217
  6. 2018SO-Net: Self-Organizing Network for Point Cloud Analysiscited by 210
  7. 2021Spatio-temporal Self-Supervised Representation Learning for 3D Point Cloudscited by 180
  8. 2023Contrast with Reconstruct: Contrastive 3D Representation Learning Guided by Generative Pretrainingcited by 162
  9. 2022Masked Discrimination for Self-Supervised Learning on Point Cloudscited by 155
  10. 2022Learning 3D Representations from 2D Pre-trained Models via Image-to-Point Masked Autoencoderscited by 143
  11. 2022Autoencoders as Cross-Modal Teachers: Can Pretrained 2D Image Transformers Help 3D Representation Learning?cited by 121
  12. 2022P2P: Tuning Pre-trained Image Models for Point Cloud Analysis with Point-to-Pixel Promptingcited by 74
  13. 2023Point Cloud Pre-training with Diffusion Modelscited by 47
  14. 2019VoteNet: A Deep Learning Label Fusion Method for Multi-Atlas Segmentationcited by 44
  15. 2023Towards Compact 3D Representations via Point Feature Enhancement Masked Autoencoderscited by 42
  16. 2020IntrA: 3D Intracranial Aneurysm Dataset for Deep Learningcited by 41
  17. 2024Point-JEPA: A Joint Embedding Predictive Architecture for Self-Supervised Learning on Point Cloudcited by 29
  18. 2024RI-MAE: Rotation-Invariant Masked AutoEncoders for Self-Supervised Point Cloud Representation Learningcited by 15
  19. 2022Pix4Point: Image Pretrained Standard Transformers for 3D Point Cloud Understandingcited by 6

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.