Mitigating Object Dependencies: Improving Point Cloud Self-Supervised Learning through Object Exchange
Not on the map. Why?
Abstract (arXiv)
In the realm of point cloud scene understanding, particularly in indoor scenes, objects are arranged following human habits, resulting in objects of certain semantics being closely positioned and displaying notable inter-object correlations. This can create a tendency for neural networks to exploit these strong dependencies, bypassing the individual object patterns. To address this challenge, we introduce a novel self-supervised learning (SSL) strategy. Our approach leverages both object patterns and contextual cues to produce robust features. It begins with the formulation of an object-exchanging strategy, where pairs of objects with comparable sizes are exchanged across different scenes, effectively disentangling the strong contextual dependencies. Subsequently, we introduce a context-aware feature learning strategy, which encodes object patterns without relying on their specific context by aggregating object features across various scenes. Our extensive experiments demonstrate the superiority of our method over existing SSL techniques, further showing its better robustness to environmental changes. Moreover, we showcase the applicability of our approach by transferring pre-trained models to diverse point cloud datasets.
Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Builds on 28 of its 40 references that are in the map. First posted on arXiv 11 Apr 2024.
Builds on
28 of 40 references.
References · 28
- 2020Bootstrap your own latent: A new approach to self-supervised Learningcited by 4,750
- 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,117
- 2017Improved Regularization of Convolutional Neural Networks with Cutoutcited by 1,628
- 2017Random Erasing Data Augmentationcited by 1,239
- 20194D Spatio-Temporal ConvNets: Minkowski Convolutional Neural Networkscited by 1,208
- 2020Simple Copy-Paste is a Strong Data Augmentation Method for Instance Segmentationcited by 596
- 2020PointContrast: Unsupervised Pre-training for 3D Point Cloud Understandingcited by 504
- 2020Searching Efficient 3D Architectures with Sparse Point-Voxel Convolutioncited by 423
- 2021In-Place Scene Labelling and Understanding with Implicit Scene Representationcited by 415
- 2020PointGroup: Dual-Set Point Grouping for 3D Instance Segmentationcited by 321
- 2021Self-Supervised Pretraining of 3D Features on any Point-Cloudcited by 217
- 2020Exploring Data-Efficient 3D Scene Understanding with Contrastive Scene Contextscited by 210
16 more
- 2017Cut, Paste and Learn: Surprisingly Easy Synthesis for Instance Detectioncited by 209
- 2021Spatio-temporal Self-Supervised Representation Learning for 3D Point Cloudscited by 180
- 2021Mix3D: Out-of-Context Data Augmentation for 3D Scenescited by 126
- 2020GridMask Data Augmentationcited by 123
- 2023OctFormer: Octree-based Transformers for 3D Point Cloudscited by 109
- 2018Modeling Visual Context is Key to Augmenting Object Detection Datasetscited by 106
- 2020Self-Supervised Learning for Domain Adaptation on Point-Cloudscited by 99
- 2023Masked Scene Contrast: A Scalable Framework for Unsupervised 3D Representation Learningcited by 56
- 20214DContrast: Contrastive Learning with Dynamic Correspondences for 3D Scene Understandingcited by 54
- 2019Learning to Generate Synthetic Data via Compositingcited by 52
- 2018Hide-and-Seek: A Data Augmentation Technique for Weakly-Supervised Localization and Beyondcited by 36
- 2023Spatiotemporal Self-supervised Learning for Point Clouds in the Wildcited by 23
- 2020Self-supervised Modal and View Invariant Feature Learningcited by 20
- 2023Boosting Low-Data Instance Segmentation by Unsupervised Pre-training with Saliency Promptcited by 11
- 2021Self-Improving Semantic Perception for Indoor Localisationcited by 5
- 2021Learning Spatiotemporal Occupancy Grid Maps for Lifelong Navigation in Dynamic Scenescited by 2
Built on by
Citing papers per year: 2024: 1; 2025: 3; 2026: 1.
5 papers.
- 2024Point-JEPA: A Joint Embedding Predictive Architecture for Self-Supervised Learning on Point Cloudcited by 30
- 2025Generalized Few-shot 3D Point Cloud Segmentation with Vision-Language Modelcited by 17
- 2025Refining CLIP's Spatial Awareness: A Visual-Centric Perspectivecited by 13
- 2025Masked Scene Modeling: Narrowing the Gap Between Supervised and Self-Supervised Learning in 3D Scene Understandingcited by 4
- 2026PointCSP: Cross-Sample Semantic Propagation and Stability Preservation in Self-Supervised Point Cloud Learningcited by 1
- 2026PointCSP: Cross-Sample Semantic Propagation and Stability Preservation in Self-Supervised Point Cloud Learning3 May 2026
- 2025Masked Scene Modeling: Narrowing the Gap Between Supervised and Self-Supervised Learning in 3D Scene Understanding9 Apr 2025
- 2025Refining CLIP's Spatial Awareness: A Visual-Centric Perspective3 Apr 2025
- 2025Generalized Few-shot 3D Point Cloud Segmentation with Vision-Language Model20 Mar 2025
- 2024Point-JEPA: A Joint Embedding Predictive Architecture for Self-Supervised Learning on Point Cloud25 Apr 2024